Migrating data to DataStax Enterprise
DataStax Enterprise (DSE) uses several solutions for migrating data from other databases:
Use DataStax Bulk Loader (dsbulk) to load and unload CSV or JSON data in and out of the DSE database.
DSE Graph Loader is a command line utility for loading graph datasets into DSE Graph from various input sources.
COPY TOcommand mirrors what the PostgreSQL RDBMS uses for file/export import.
You can use
COPYin the CQL shell to read CSV data to DSE and write CSV data from DSE to a file system. Typically, an RDBMS has unload utilities for writing table data to a file system.
sstableloaderprovides the ability to bulk load external data into a cluster.
The DataStax Apache Kafka™ Connector synchronizes records from a Kafka topic with rows in one or more DSE database tables.
If you need more sophistication applied to a data movement situation than just extract-load, you can use any number of extract-transform-load (ETL) solutions that support DSE. These tools provide transformation routines for manipulating source data and then loading the data into a DSE target. The tools offer features such as visual, point-and-click interfaces, scheduling engines, and more.
Many ETL vendors who support DSE supply community editions of their products that are free and able to solve many different use cases. Enterprise editions are also available.
You can download ETL tools that work with DSE from Talend, Informatica, and Streamsets.