Creating configuration files for DataStax Bulk Loader
Use configuration files to set values for DataStax Bulk Loader.
By default, the
configuration files are located under the DataStax Bulk Loader conf
directory. The main configuration file is named application.conf. The
default location can be changed via the -f
switch on the
dsbulk
command line.
DataStax Bulk Loader provides a default, initially empty application.conf file that you can customize for your environment. DataStax Bulk Loader also provides a template configuration file that can serve as a starting point for further customization. Template configuration files for DataStax Bulk Loader and the Java driver are also included in the tarball, under the ./manual folder.
dsbulk {
connector {
name = "csv"
csv {
url = "C:\\Users\\My Folder"
delimiter = "\t"
}
}
}
The
example above is equivalent to the following snippet using dotted notation instead of
blocks:
dsbulk.connector.name = "csv"
dsbulk.connector.csv.url = "C:\\Users\\My Folder"
dsbulk.connector.csv.delimiter = "\t"
You
can split your configuration in more than one file using file inclusions. For details, see
the HOCON documentation. The default configuration file includes another file called
driver.conf, also located in the DataStax Bulk Loader
conf
directory. Use the driver.conf file to
configure the DataStax Java Driver for DataStax Bulk Loader. This file is initally empty as
well; you can customize it to your needs. A driver template configuration file can serve as a starting
point for further customization; the driver template file is also included in the DataStax
Bulk Loader tarball, under the ./manual folder
Important caveats
- You cannot omit the prefix
dsbulk
. For example, to select the connector to use in a configuration file, usedsbulk.connector.name = csv
, as in the example above; on the command line, however, you can use--dsbulk.connector.name csv
or--connector.name csv
to achieve the same effect. - You cannot abbreviate the prefix
datastax-java-driver
todriver
. For example, to select the consistency level to use in a configuration file, usedatastax-java-driver.basic.request.consistency = QUORUM
in a configuration file; on the command line, however, you can use both--datastax-java-driver.basic.request.consistency = QUORUM
or--driver.basic.request.consistency = QUORUM
to achieve the same effect.