Generating Spark SQL schema files
Spark SQL can import schema files generated by DataStax Enterprise.
Procedure
-
Export the schema file using dse client-tool.
dse client-tool --use-server-config spark sql-schema --all > output.sql
-
Copy the schema to an external Spark node.
scp output.sql user@sparknode1.example.com:
-
On a Spark node, import the schema using Spark.
spark-sql --jars byos-5.1.jar --properties-file byos.properties -f output.sql