Class

com.datastax.bdp.graph.spark.graphframe.classic

ClassicDseGraphFrameBuilder

Related Doc: package classic

Permalink

class ClassicDseGraphFrameBuilder extends DseGraphFrameBuilder

Helper class to create GraphFrame from C* backend. The GraphFrame caches dataframes on creation. It is recommended to call withVertex method to create subgraph prior graph frame creation to reduce memory footprint

Usage: val dataFrame = DseGraphFrameBuilder("graph", spark).dseGraph()

Linear Supertypes
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ClassicDseGraphFrameBuilder
  2. DseGraphFrameBuilder
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  6. def edges(): DataFrame

    Permalink

    DSE Graph store 2 copy of each edge, as "IN" and "OUT", it also can "cache" partition one of the direction in local C* table, in this case only one copy of the edge available in general table.

    DSE Graph store 2 copy of each edge, as "IN" and "OUT", it also can "cache" partition one of the direction in local C* table, in this case only one copy of the edge available in general table. Thus following algorithm is used to gather edges 1. If requested vertices has no partition edges or only "IN" vertices were partitioned, select all "OUT" vertices for given vertexLabels. 2. if only "OUT" vertices were partitioned select all "IN" vertices 3. in case both IN and OUT partition exists, select both and then call distinct on them, to remove duplicates that is slower on startup but spark-repartition edges DF for beter join performance in the future.

    Note: If subset of vertex label was passed to the Builder, some edges could point to non-existent vertices.

    returns

    GraphFrame compatible non-cached edge DataFrame

    Definition Classes
    ClassicDseGraphFrameBuilderDseGraphFrameBuilder
  7. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  8. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  9. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  10. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  11. def graphFrame(): DseGraphFrame

    Permalink

    Create new DseGraphFrame from provided GraphFrame or load data from the DSE

    Create new DseGraphFrame from provided GraphFrame or load data from the DSE

    returns

    graph frame

    Definition Classes
    ClassicDseGraphFrameBuilderDseGraphFrameBuilder
  12. val graphName: String

    Permalink
  13. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  14. def ignoreUnauthorizedLabelsDefined(graphOptions: Map[String, String]): Boolean

    Permalink
    Definition Classes
    DseGraphFrameBuilder
  15. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  16. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  17. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  18. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  19. def option(key: String, value: String): DseGraphFrameBuilder

    Permalink

    provide additional spark cassandra connector options examples: builder.option("cluster", "ClusterOne") builder.option("spark.cassandra.connection.host", "192.168.0.1")

    provide additional spark cassandra connector options examples: builder.option("cluster", "ClusterOne") builder.option("spark.cassandra.connection.host", "192.168.0.1")

    key

    cassandra connector option name

    value

    value

    returns

    this

    Definition Classes
    ClassicDseGraphFrameBuilderDseGraphFrameBuilder
  20. def options(options: Map[String, String]): DseGraphFrameBuilder

    Permalink

    provide additional spark cassandra connector options examples: builder.options(Map ("cluster" -> "ClusterOne", "spark.cassandra.connection.host" -> "192.168.0.1")

    provide additional spark cassandra connector options examples: builder.options(Map ("cluster" -> "ClusterOne", "spark.cassandra.connection.host" -> "192.168.0.1")

    options

    cassandra connector option map

    returns

    this

    Definition Classes
    ClassicDseGraphFrameBuilderDseGraphFrameBuilder
  21. val spark: SparkSession

    Permalink
  22. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  23. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  24. lazy val vertexLabels: Seq[String]

    Permalink
  25. def vertices(): DataFrame

    Permalink

    returns

    GraphFrame compatible non-cached vertex DataFrame

    Definition Classes
    ClassicDseGraphFrameBuilderDseGraphFrameBuilder
  26. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  27. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  28. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  29. def withEdgeLabels(labels: Seq[String]): DseGraphFrameBuilder

    Permalink

    limit edge labels to create a sub graph

    limit edge labels to create a sub graph

    Definition Classes
    ClassicDseGraphFrameBuilderDseGraphFrameBuilder
  30. def withGraphFrame(gf: GraphFrame): DseGraphFrameBuilder

    Permalink

    provide data from external source the builder will only read schema from DSE

    provide data from external source the builder will only read schema from DSE

    Definition Classes
    ClassicDseGraphFrameBuilderDseGraphFrameBuilder
  31. def withVertexLabels(labels: Seq[String]): DseGraphFrameBuilder

    Permalink

    limit vertex labels to create a sub graph

    limit vertex labels to create a sub graph

    Definition Classes
    ClassicDseGraphFrameBuilderDseGraphFrameBuilder

Inherited from DseGraphFrameBuilder

Inherited from AnyRef

Inherited from Any

Ungrouped