Object

com.datastax.spark.connector.util

ConfigCheck

Related Doc: package util

Permalink

object ConfigCheck

Helper class to throw exceptions if there are environment variables in the spark.cassandra namespace which don't map to Spark Cassandra Connector known properties.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ConfigCheck
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. class ConnectorConfigurationException extends ConfigurationException

    Permalink

    Exception to be thrown when unknown properties are found in the SparkConf

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. val ConfObjects: (WriteConf.type, ReadConf.type, ColumnTypeConf.type, CassandraSourceRelation.type, CassandraConnectorConf.type, AuthConfFactory.type, CassandraConnectionFactory.type)

    Permalink

    Force creation of all Parameters.

    Force creation of all Parameters. Any New Parameter Holding Objects should be added here *

  5. val MatchThreshold: Double

    Permalink
  6. val Prefix: String

    Permalink
  7. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  8. def checkConfig(conf: SparkConf): Unit

    Permalink

    Checks the SparkConf Object for any unknown spark.cassandra.* properties and throws an exception with suggestions if an unknown property is found.

    Checks the SparkConf Object for any unknown spark.cassandra.* properties and throws an exception with suggestions if an unknown property is found.

    conf

    SparkConf object to check

  9. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  10. val deprecatedProperties: Set[DeprecatedConfigParameter[_]]

    Permalink
  11. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  12. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  13. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  14. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  15. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  16. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  17. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  18. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  19. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  20. def suggestedProperties(unknownProp: String, extraProps: Set[String] = Set.empty): Seq[String]

    Permalink

    For a given unknown property determine if we have any guesses as to what the property should be.

    For a given unknown property determine if we have any guesses as to what the property should be. Suggestions are found by breaking the unknown property into fragments. spark.cassandra.foo.bar => [foo,bar] Any known property which has some fragments which fuzzy match all of the fragments of the unknown property are considered a suggestion.

    Fuzziness is determined by MatchThreshold

  21. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  22. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  23. def unknownProperties(conf: SparkConf, extraProps: Set[String] = Set.empty): Seq[String]

    Permalink
  24. val validStaticProperties: Set[ConfigParameter[_]]

    Permalink

    Set of valid static properties hardcoded in the connector.

    Set of valid static properties hardcoded in the connector. Custom CassandraConnectionFactory and AuthConf properties are not listed here.

  25. val validStaticPropertyNames: Set[String]

    Permalink
  26. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  27. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  28. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped