Generating Spark SQL schema files
Spark SQL can import schema files generated by DataStax Enterprise.
Procedure
-
Export the schema file using dse client-tool.
dse client-tool --use-server-config spark sql-schema --all > output.sql -
Copy the schema to an external Spark node.
scp output.sql user@sparknode1.example.com: -
On a Spark node, import the schema using Spark.
spark-sql --jars byos-5.1.jar --properties-file byos.properties -f output.sql
