About DataStax Bulk Loader for Apache Cassandra

Introduction to DataStax Bulk Loader for Apache Cassandra.

DataStax Bulk Loader for Apache Cassandra® is open-source software (OSS). Use the product to load and unload CSV or JSON data in and out of supported databases. You can also use DataStax Bulk Loader to count the loaded records and return related information.

About this document

To ensure that you get the best experience in using this document, take a moment to read Tips for using DataStax documentation.

About DataStax Bulk Loader for Apache Cassandra

DataStax Bulk Loader for Apache Cassandra is supported on Linux, macOS, and Windows platforms.

This OSS product efficiently and reliably loads small or large amounts of data, supporting developer and production environments. Using dsbulk commands, CSV or JSON files can be rapidly loaded or unloaded to or from the following supported databases:
  • DataStax Astra cloud databases
  • DataStax Enterprise (DSE) 4.7 and later databases
  • Open source Apache Cassandra® 2.1 and later databases

Features in DataStax Bulk Loader for Apache Cassandra

  • Open source for contributions from a community of software developers. See the public GitHub repo: https://github.com/datastax/dsbulk
  • CSV and JSON are supported formats, and optionally you can load or unload the data from/to compressed files.
  • Files, directories, stdin/stdout, and web URLs can be used for either source or destination.
  • Performance improvements of 2-3 times faster compared to cqlsh COPY, due to multi-threaded operation.
  • Connect to a cloud-based DataStax Astra database by including the path to the secure connect bundle, which participants can download from the DataStax Aastra cloud console after creating an Astra database.
  • DataStax Java driver options are available directly with dsbulk commands via the datastax-java-driver prefix.
  • Secure authentication via Kerberos or username/password over SSL options.
  • Configurable data parsing. For instance, date formatting is configurable.
  • Performance and progress reporting.
  • Command line tool for both Linux and Windows:
    • Can use configuration files to simplify command line calls to dsbulk
    • Tunable parameters to optimize loading and unloading times.
    • Enhancements allow secure connections for loading and unloading data.
  • In addition to the dsbulk load and dsbulk unload commands, you can use dsbulk count to return information about loaded records in supported database tables.
  • Print basic information about the associated cluster when you request verbose logging on the dsbulk command. Refer to Printing cluster information.
  • Diagnose issues encountered during write operations. Refer to Detection of write failures.
Also see the DataStax blog post Introducing the DataStax Bulk Loader.