cassandra

Type Members

1. case class AnalyzedPredicates(handledByCassandra: Set[Filter], handledBySpark: Set[Filter]) extends Product with Serializable

   

2. case class Auto(ratio: Double) extends DseSearchOptimizationSetting with Product with Serializable

   

3. class BasicCassandraPredicatePushDown[Predicate] extends AnyRef

   

   Determines which filter predicates can be pushed down to Cassandra.

   Determines which filter predicates can be pushed down to Cassandra.

   1. Only push down no-partition key column predicates with =, >, <, >=, <= predicate 2. Only push down primary key column predicates with = or IN predicate. 3. If there are regular columns in the pushdown predicates, they should have at least one EQ expression on an indexed column and no IN predicates. 4. All partition column predicates must be included in the predicates to be pushed down, only the last part of the partition key can be an IN predicate. For each partition column, only one predicate is allowed. 5. For cluster column predicates, only last predicate can be non-EQ predicate including IN predicate, and preceding column predicates must be EQ predicates. If there is only one cluster column predicate, the predicates could be any non-IN predicate. 6. There is no pushdown predicates if there is any OR condition or NOT IN condition. 7. We're not allowed to push down multiple predicates for the same column if any of them is equality or IN predicate.

   The list of predicates to be pushed down is available in predicatesToPushDown property. The list of predicates that cannot be pushed down is available in predicatesToPreserve property.

4. trait CassandraMetadataFunction extends UnaryExpression with Unevaluable

   

5. trait CassandraPredicateRules extends AnyRef

   

6. implicit final class CassandraSQLContextFunctions extends AnyVal

   

7. final class CassandraSQLRow extends GettableData with Row with Serializable

   

8. case class CassandraSourceOptions(pushdown: Boolean = true, confirmTruncate: Boolean = false, cassandraConfs: Map[String, String] = Map.empty) extends Product with Serializable

   

   Store data source options

9. case class CassandraSourceRelation(tableRef: TableRef, userSpecifiedSchema: Option[StructType], filterPushdown: Boolean, confirmTruncate: Boolean, tableSizeInBytes: Option[Long], connector: CassandraConnector, readConf: ReadConf, writeConf: WriteConf, sparkConf: SparkConf, sqlContext: SQLContext, directJoinSetting: DirectJoinSetting = Automatic) extends BaseRelation with InsertableRelation with PrunedFilteredScan with CassandraTableDefProvider with Logging with Product with Serializable

   

   Implements BaseRelation]], InsertableRelation]] and PrunedFilteredScan]] It inserts data to and scans Cassandra table.

   Implements BaseRelation]], InsertableRelation]] and PrunedFilteredScan]] It inserts data to and scans Cassandra table. If filterPushdown is true, it pushs down some filters to CQL

10. implicit final class CassandraSparkSessionFunctions extends AnyVal

    

11. class CassandraStreamingSinkRelation extends Sink

    

12. case class CassandraTTL(child: Expression) extends UnaryExpression with CassandraMetadataFunction with Product with Serializable

    

13. trait CassandraTableDefProvider extends AnyRef

    

14. case class CassandraWriteTime(child: Expression) extends UnaryExpression with CassandraMetadataFunction with Product with Serializable

    

15. implicit final class DataFrameReaderWrapper extends AnyVal

    

16. implicit final class DataFrameWriterWrapper[T] extends AnyVal

    

17. implicit final class DataStreamWriterWrapper[T] extends AnyVal

    

18. class DefaultSource extends RelationProvider with SchemaRelationProvider with CreatableRelationProvider with StreamSinkProvider with Logging

    

    Cassandra data source extends RelationProvider, SchemaRelationProvider and CreatableRelationProvider.

    Cassandra data source extends RelationProvider, SchemaRelationProvider and CreatableRelationProvider. It's used internally by Spark SQL to create Relation for a table which specifies the Cassandra data source e.g.

    CREATE TEMPORARY TABLE tmpTable USING org.apache.spark.sql.cassandra OPTIONS ( table "table", keyspace "keyspace", cluster "test_cluster", pushdown "true", spark.cassandra.input.fetch.sizeInRows "10", spark.cassandra.output.consistency.level "ONE", spark.cassandra.connection.timeoutMS "1000" )

19. sealed trait DirectJoinSetting extends AnyRef

    

20. sealed trait DseSearchOptimizationSetting extends AnyRef

    

21. class NullableUnresolvedAttribute extends UnresolvedAttribute

    

22. trait PredicateOps[Predicate] extends AnyRef

    

    A unified API for predicates, used by BasicCassandraPredicatePushDown.

    A unified API for predicates, used by BasicCassandraPredicatePushDown.

    Keeps all the Spark-specific stuff out of BasicCassandraPredicatePushDown It is also easy to plug-in custom predicate implementations for unit-testing.

23. class SolrPredicateRules extends CassandraPredicateRules with Logging

    

24. case class TableRef(table: String, keyspace: String, cluster: Option[String] = None) extends Product with Serializable

    

    Store table name, keyspace name and option cluster name, keyspace is equivalent to database