Using Apache Spark™ with DataStax Enterprise
DataStax Enterprise integrates with Apache Spark to allow distributed analytic applications to run using database data.
- Starting Spark
-
How you start Spark depends on the installation and if want to run in Spark mode or
SearchAnalytics
mode. - Running Spark commands against a remote cluster
-
To run Spark commands against a remote cluster, you must export the DSE configuration from one of the remote nodes to the local client machine.
- Monitoring Spark with the web interface
-
A Spark web interface is bundled with DataStax Enterprise. The Spark web interface facilitates monitoring, debugging, and managing Spark.
- Using DSE Spark with third party tools and integrations
-
The
dse exec
command sets the environment variables required to run third-party tools that integrate with Spark.