• Glossary
  • Support
  • Downloads
  • DataStax Home
Get Live Help
Expand All
Collapse All

DataStax Streaming Home

Luna Streaming Documentation

    • Luna Streaming FAQs
    • Luna Streaming Installation on Azure Kubernetes Service
    • Luna Streaming Installation on Amazon Elastic Kubernetes Environment
    • Luna Streaming Installation on Google Kubernetes Environment
    • Install & Upgrade
      • Quick Start for Helm Chart installs
      • Quick Start for Bare Metal/VM installs
      • Supported Software
    • Components
      • Pulsar Admin Console
      • Install Pulsar Admin Console on Server/VM
      • Pulsar Heartbeat
      • Heartbeat on VM/Server
      • Pulsar Beam
      • Pulsar SQL
      • Starlight for Luna Streaming
    • Operations
      • Luna Streaming Authentication
      • Luna Streaming Functions
      • Luna Streaming IO connectors
      • Elasticsearch sink connector
      • Scaling your Luna Streaming cluster
      • Troubleshooting
  • Luna Streaming Documentation
  • Operations
  • Luna Streaming IO connectors
2.10-3.x 2.10-2.x 2.10-1.x
Edit this Page

Luna Streaming IO connectors

When you have Luna Streaming installed and running, add IO connectors to connect your deployment to external systems like Apache Cassandra, ElasticSearch, and more.

  • Source connectors: Source connectors read messages from external topics and persist the messages to Apache Pulsar™ topics. For more, see Pulsar built-in connectors.

  • Sink connectors: Sink connectors read messages from Pulsar topics and persist the messages to external systems. For more, see Pulsar built-in connectors.

This doc lists the connectors supported by Luna Streaming.

Sink Connectors

Sink connectors read messages from Pulsar topics and persist the messages to external systems.

The following sink connectors are included in the <luna-streaming-all> deployment and are supported by DataStax Luna Streaming.

DataStax enhanced Cassandra sink connector

To configure, deploy, and use the DataStax enhanced Cassandra sink connector, see the DataStax Pulsar connector documentation.

The DataStax enhanced Cassandra sink connector offers the following advantages over the OSS Pulsar Cassandra sink connector:

  • Flexibility in mapping Apache Pulsar™ messages to DSE and Cassandra tables.

  • Enterprise grade security support including built-in SSL, and LDAP integration.

  • Consumes all Apache Pulsar™ primitives including primitives, JSON and Avro formats.

  • Flexible time/date formatting.

  • Configurable consistency level.

  • Row-level Time-to-Live (TTL).

  • Distributed mode, high availability (HA) support.

  • Standalone mode support for development.

ElasticSearch sink

To configure, deploy, and use the ElasticSearch sink connector, see the Elasticsearch sink connector documentation.

JDBC-Clickhouse sink

To configure, deploy, and use the JDBC-Clickhouse sink connector, see the Pulsar documentation.

JDBC-MariaDB sink

To configure, deploy, and use the JDBC-MariaDB sink connector, see the Pulsar documentation.

JDBC-PostgreSQL sink

To configure, deploy, and use the JDBC-PostgreSQL connector, see the Pulsar documentation.

Kafka sink

To configure, deploy, and use the Kafka sink connector, see the Pulsar documentation.

Kinesis sink

To configure, deploy, and use the Kinesis sink connector, see the Pulsar documentation.

Source Connectors

Source connectors read messages from external topics and persist the messages to Pulsar topics.

The following sink connectors are included in the <luna-streaming-all> deployment and are supported by DataStax Luna Streaming.

Debezium MongoDB source

To configure, deploy, and use the Debezium MongoDB source connector, see the Pulsar documentation.

Debezium MySQL source

To configure, deploy, and use the Debezium MySQL source connector, see the Pulsar documentation.

Debezium Postgres source

To configure, deploy, and use the Debezium PostgreSQL source connector, see the Pulsar documentation.

Kafka source

To configure, deploy, and use the Kafka source connector, see the Pulsar documentation.

Kinesis source

To configure, deploy, and use the Kinesis source connector, see the Pulsar documentation.

What’s next?

For more on Pulsar IO connectors, see the Pulsar documentation.

Luna Streaming Functions Elasticsearch sink connector

General Inquiries: +1 (650) 389-6000 info@datastax.com

© DataStax | Privacy policy | Terms of use

DataStax, Titan, and TitanDB are registered trademarks of DataStax, Inc. and its subsidiaries in the United States and/or other countries.

Apache, Apache Cassandra, Cassandra, Apache Tomcat, Tomcat, Apache Lucene, Apache Solr, Apache Hadoop, Hadoop, Apache Pulsar, Pulsar, Apache Spark, Spark, Apache TinkerPop, TinkerPop, Apache Kafka and Kafka are either registered trademarks or trademarks of the Apache Software Foundation or its subsidiaries in Canada, the United States and/or other countries.

Kubernetes is the registered trademark of the Linux Foundation.

landing_page landingpage