cassandra

Type Members

1. case class AnalyzedPredicates(handledByCassandra: Set[Filter], handledBySpark: Set[Filter]) extends Product with Serializable

   

2. case class Auto(ratio: Double) extends DseSearchOptimizationSetting with Product with Serializable

   

3. class BasicCassandraPredicatePushDown[Predicate] extends AnyRef

   

   Determines which filter predicates can be pushed down to Cassandra.

   Determines which filter predicates can be pushed down to Cassandra.

   1. Only push down no-partition key column predicates with =, >, <, >=, <= predicate 2. Only push down primary key column predicates with = or IN predicate. 3. If there are regular columns in the pushdown predicates, they should have at least one EQ expression on an indexed column and no IN predicates. 4. All partition column predicates must be included in the predicates to be pushed down, only the last part of the partition key can be an IN predicate. For each partition column, only one predicate is allowed. 5. For cluster column predicates, only last predicate can be non-EQ predicate including IN predicate, and preceding column predicates must be EQ predicates. If there is only one cluster column predicate, the predicates could be any non-IN predicate. 6. There is no pushdown predicates if there is any OR condition or NOT IN condition. 7. We're not allowed to push down multiple predicates for the same column if any of them is equality or IN predicate.

   The list of predicates to be pushed down is available in predicatesToPushDown property. The list of predicates that cannot be pushed down is available in predicatesToPreserve property.

4. trait CassandraPredicateRules extends AnyRef

   

5. implicit final class CassandraSQLContextFunctions extends AnyVal

   

6. final class CassandraSQLRow extends GettableData with Row with Serializable

   

7. case class CassandraSourceOptions(pushdown: Boolean = true, confirmTruncate: Boolean = false, cassandraConfs: Map[String, String] = Map.empty) extends Product with Serializable

   

   Store data source options

8. class CassandraSourceRelation extends BaseRelation with InsertableRelation with PrunedFilteredScan with Logging

   

   Implements BaseRelation]], InsertableRelation]] and PrunedFilteredScan]] It inserts data to and scans Cassandra table.

   Implements BaseRelation]], InsertableRelation]] and PrunedFilteredScan]] It inserts data to and scans Cassandra table. If filterPushdown is true, it pushs down some filters to CQL

9. implicit final class CassandraSparkSessionFunctions extends AnyVal

   

10. class CassandraStreamingSinkRelation extends Sink

    

11. implicit final class DataFrameReaderWrapper extends AnyVal

    

12. implicit final class DataFrameWriterWrapper[T] extends AnyVal

    

13. implicit final class DataStreamWriterWrapper[T] extends AnyVal

    

14. class DefaultSource extends RelationProvider with SchemaRelationProvider with CreatableRelationProvider with StreamSinkProvider with Logging

    

    Cassandra data source extends RelationProvider, SchemaRelationProvider and CreatableRelationProvider.

    Cassandra data source extends RelationProvider, SchemaRelationProvider and CreatableRelationProvider. It's used internally by Spark SQL to create Relation for a table which specifies the Cassandra data source e.g.

    CREATE TEMPORARY TABLE tmpTable USING org.apache.spark.sql.cassandra OPTIONS ( table "table", keyspace "keyspace", cluster "test_cluster", pushdown "true", spark.cassandra.input.fetch.sizeInRows "10", spark.cassandra.output.consistency.level "ONE", spark.cassandra.connection.timeoutMS "1000" )

15. sealed trait DirectJoinSetting extends AnyRef

    

16. sealed trait DseSearchOptimizationSetting extends AnyRef

    

17. trait PredicateOps[Predicate] extends AnyRef

    

    A unified API for predicates, used by BasicCassandraPredicatePushDown.

    A unified API for predicates, used by BasicCassandraPredicatePushDown.

    Keeps all the Spark-specific stuff out of BasicCassandraPredicatePushDown It is also easy to plug-in custom predicate implementations for unit-testing.

18. case class TableRef(table: String, keyspace: String, cluster: Option[String] = None) extends Product with Serializable

    

    Store table name, keyspace name and option cluster name, keyspace is equivalent to database