Generating Spark SQL schema files

Generate Spark SQL schema files for use with Spark SQL on external Spark clusters.

Spark SQL can import schema files generated by DataStax Enterprise.

Procedure

  1. Export the schema file using dse client-tool. 
    dse client-tool --use-server-config spark sql-schema --all > output.sql
  2. Copy the schema to an external Spark node. 
    scp output.sql user@sparknode1.example.com:
  3. On a Spark node, import the schema using Spark. 
    spark-sql --jars byos-5.1.jar --properties-file  byos.properties -f  output.sql