dse spark-history-server
Starts and stops the Spark history server, the front-end application that displays logging data from all nodes in the Spark cluster.
Restriction: Configuration is required for the Spark history server. See Spark history server.
Synopsis
dse spark-history-server
start [--properties-file <properties_file>]|stop
Syntax conventions | Description |
---|---|
UPPERCASE |
Literal keyword. |
Lowercase |
Not literal. |
<`Italics>` |
Variable value. Replace with a valid option or user-defined value. |
|
Optional.
Square brackets ( |
|
Group.
Parentheses ( |
|
Or.
A vertical bar ( |
|
Repeatable.
An ellipsis ( |
|
Single quotation ( |
|
Map collection.
Braces ( |
|
Set, list, map, or tuple.
Angle brackets ( |
|
End CQL statement.
A semicolon ( |
|
Separate the command line options from the command arguments with two hyphens ( |
|
Search CQL only: Single quotation marks ( |
|
Search CQL only: Identify the entity and literal value to overwrite the XML element in the schema and solrconfig files. |
- start
-
Starts the Spark history server to load the event logs from Spark jobs that were run with event logging enabled. The Spark history server can be started from any node in the cluster.
- --properties-file properties_file
-
The properties file to overwrite the default Spark configuration in conf/spark-defaults.conf. The properties file can include settings like the authentication method and credentials and event log location.
- stop
-
Stops the Spark history server.
Examples
Start the Spark history server on the local node
dse spark-history-server start
The Spark history server is started with the default configuration in conf/spark-defaults.conf
.
Start the Spark history server with a properties file
dse spark-history-server start --properties-file sparkproperties.conf
The Spark history server is started with the configuration specified in sparkproperties.conf
.