dse spark-sql-thriftserver

Starts and stops the Spark SQL Thriftserver. The Spark SQL Server uses a JDBC and an ODBC interface for client connections to DSE.

Configuration is required for the Spark SQL Thriftserver. See Using the Spark SQL Thrift server.

Synopsis

$ dse spark-sql-thriftserver
start [--conf spark_prop] [--hiveconf hive_prop]|stop
Syntax conventions
Syntax conventions Description

UPPERCASE

Literal keyword.

Lowercase

Not literal.

Italics

Variable value. Replace with a valid option or user-defined value.

[ ]

Optional. Square brackets ( [ ] ) surround optional command arguments. Do not type the square brackets.

( )

Group. Parentheses ( ( ) ) identify a group to choose from. Do not type the parentheses.

|

Or. A vertical bar ( | ) separates alternative elements. Type any one of the elements. Do not type the vertical bar.

...

Repeatable. An ellipsis ( ... ) indicates that you can repeat the syntax element as often as required.

'Literal string'

Single quotation ( ' ) marks must surround literal strings in CQL statements. Use single quotation marks to preserve upper case.

{ key:value }

Map collection. Braces ( { } ) enclose map collections or key value pairs. A colon separates the key and the value.

<datatype1,datatype2>

Set, list, map, or tuple. Angle brackets ( < > ) enclose data types in a set, list, map, or tuple. Separate the data types with a comma.

cql_statement;

End CQL statement. A semicolon ( ; ) terminates all CQL statements.

[ -- ]

Separate the command line options from the command arguments with two hyphens ( -- ). This syntax is useful when arguments might be mistaken for command line options.

' <schema> …​ </schema> '

Search CQL only: Single quotation marks ( ' ) surround an entire XML schema declaration.

@xml_entity='xml_entity_type'

Search CQL only: Identify the entity and literal value to overwrite the XML element in the schema and solrconfig files.

start

Starts the Spark SQL Thriftserver. The user who runs the command to start the Spark SQL Thriftserver requires permissions to write to the Spark directories.

--conf spark_prop

Pass in general Spark configuration settings, like spark.cores.max=4.

-hiveconf config_file

Pass in a hive configuration property, like hive.server2.thrift.port=10001.

stop

Stops the Spark SQL Thriftserver.

Examples

Start the Spark SQL Thriftserver with a Spark configuration option

$ dse spark-sql-thrift-server start --conf spark.cores.max=4

Start the Spark SQL Thriftserver with a Hive configuration option

$ dse spark-sql-thrift-server start --hiveconf hive.server2.thrift.port=10001

Stop the Spark SQL Thriftserver

$ dse spark-sql-thriftserver stop

Was this helpful?

Give Feedback

How can we improve the documentation?

© 2024 DataStax | Privacy policy | Terms of use

Apache, Apache Cassandra, Cassandra, Apache Tomcat, Tomcat, Apache Lucene, Apache Solr, Apache Hadoop, Hadoop, Apache Pulsar, Pulsar, Apache Spark, Spark, Apache TinkerPop, TinkerPop, Apache Kafka and Kafka are either registered trademarks or trademarks of the Apache Software Foundation or its subsidiaries in Canada, the United States and/or other countries. Kubernetes is the registered trademark of the Linux Foundation.

General Inquiries: +1 (650) 389-6000, info@datastax.com