Overview of BYOS support in DataStax Enterprise

DataStax Enterprise provides a JAR and configuration files for connected to DataStax Enterprise clusters from external Spark clusters.

BYOS support in DataStax Enterprise consists of a JAR file and a generated configuration file that provides all the necessary classes and configuration settings for connecting to a particular DataStax Enterprise cluster from an external Spark cluster. To specify a different classpath to accommodate applications originally written for open source Apache Spark, specify the -framework option with dse spark commands.

All DSE resources, including DSEFS file locations, can be accessed from the external Spark cluster.

BYOS is tested against the version of Spark integrated into DSE (described in the DataStax Enterprise 6.0 release notes) and the following Spark distributions:

• Hortonworks Data Platform (HDP) 2.5
• Cloudera CDH 5.10