Luna Streaming IO connectors
When you have Luna Streaming installed and running, add IO connectors to connect your deployment to external systems like Apache Cassandra, ElasticSearch, and more.
-
Source connectors: Source connectors read messages from external topics and persist the messages to Apache Pulsar™ topics. For more, see Pulsar built-in connectors.
-
Sink connectors: Sink connectors read messages from Pulsar topics and persist the messages to external systems. For more, see Pulsar built-in connectors.
This doc lists the connectors supported by Luna Streaming.
Sink Connectors
Sink connectors read messages from Pulsar topics and persist the messages to external systems.
The following sink connectors are included in the <luna-streaming-all> deployment and are supported by DataStax Luna Streaming.
DataStax enhanced Cassandra sink connector
To configure, deploy, and use the DataStax enhanced Cassandra sink connector, see the DataStax Pulsar connector documentation.
The DataStax enhanced Cassandra sink connector offers the following advantages over the OSS Pulsar Cassandra sink connector:
-
Flexibility in mapping Apache Pulsar™ messages to DSE and Cassandra tables.
-
Enterprise grade security support including built-in SSL, and LDAP integration.
-
Consumes all Apache Pulsar™ primitives including primitives, JSON and Avro formats.
-
Flexible time/date formatting.
-
Configurable consistency level.
-
Row-level Time-to-Live (TTL).
-
Distributed mode, high availability (HA) support.
-
Standalone mode support for development.
ElasticSearch sink
To configure, deploy, and use the ElasticSearch sink connector, see the Elasticsearch sink connector documentation.
JDBC-Clickhouse sink
To configure, deploy, and use the JDBC-Clickhouse sink connector, see the Pulsar documentation.
JDBC-MariaDB sink
To configure, deploy, and use the JDBC-MariaDB sink connector, see the Pulsar documentation.
JDBC-PostgreSQL sink
To configure, deploy, and use the JDBC-PostgreSQL connector, see the Pulsar documentation.
Kafka sink
To configure, deploy, and use the Kafka sink connector, see the Pulsar documentation.
Kinesis sink
To configure, deploy, and use the Kinesis sink connector, see the Pulsar documentation.
Source Connectors
Source connectors read messages from external topics and persist the messages to Pulsar topics.
The following sink connectors are included in the <luna-streaming-all> deployment and are supported by DataStax Luna Streaming.
Debezium MongoDB source
To configure, deploy, and use the Debezium MongoDB source connector, see the Pulsar documentation.
Debezium MySQL source
To configure, deploy, and use the Debezium MySQL source connector, see the Pulsar documentation.
Debezium Postgres source
To configure, deploy, and use the Debezium PostgreSQL source connector, see the Pulsar documentation.
Kafka source
To configure, deploy, and use the Kafka source connector, see the Pulsar documentation.
Kinesis source
To configure, deploy, and use the Kinesis source connector, see the Pulsar documentation.
What’s next?
For more on Pulsar IO connectors, see the Pulsar documentation.