Overview of BYOS support in DataStax Enterprise

Bring Your Own Spark (BYOS) support in DataStax Enterprise consists of a JAR file and a generated configuration file that provide all the necessary classes and configuration settings for connecting to a particular DataStax Enterprise cluster from an external Spark cluster. To specify a different classpath to accommodate applications originally written for open source Apache Spark, specify the -framework option with dse spark commands.

All DSE resources, including DSEFS file locations, can be accessed from the external Spark cluster.

BYOS is tested against the version of Spark integrated into DSE (described in the following Spark distributions:

  • Hortonworks Data Platform (HDP) 2.5

  • Cloudera CDH 5.10

Was this helpful?

Give Feedback

How can we improve the documentation?

© 2024 DataStax | Privacy policy | Terms of use

Apache, Apache Cassandra, Cassandra, Apache Tomcat, Tomcat, Apache Lucene, Apache Solr, Apache Hadoop, Hadoop, Apache Pulsar, Pulsar, Apache Spark, Spark, Apache TinkerPop, TinkerPop, Apache Kafka and Kafka are either registered trademarks or trademarks of the Apache Software Foundation or its subsidiaries in Canada, the United States and/or other countries. Kubernetes is the registered trademark of the Linux Foundation.

General Inquiries: +1 (650) 389-6000, info@datastax.com