Kafka topic-to-table settings

Capture Kafka topics in the DataStax database by specifying a target keyspace, table, and then map the topic fields to table columns.

Capture Kafka topics in the DataStax database by specifying a target keyspace, table, and then map the topic fields to table columns in the name of the parameter.

Parameters

Use the following syntax for standalone properties file:
topics=topic_list
prefix.mapping=mapping_specification
prefix.consistencyLevel=WRITE_CONSISTENCY_LEVEL
prefix.ttl=seconds
prefix.nullToUnset=true
prefix.deletesEnabled=true
topics
A comma separated list of all topics to which the DataStax Connector subscribes.
prefix
Defines the topic-to-table to which the parameters apply. This allows records from a single topic to be ingested into multiple DataStax database tables. Define the parameter prefix using the following syntax:
topic.topic_name.keyspace_name.table_name
where:
  • topic_name - Kafka topic name.
  • keyspace_name - DataStax database keyspace where the table is located.
  • table_name - DataStax database table where data is written.
mapping
Required, field-to-column mapping. See Mapping kafka topics to DataStax Enterprise database tables.
consistencyLevel
Query consistency level. DSE settings are:See How are consistent read and write operations handled?

Default: LOCAL_ONE

nullToUnset
Whether to treat nulls in Kafka as UNSET in DSE. DataStax recommends using the default to avoid creating unnecessary tombstones.

Default: true

ttl
Time-to-live. Set to the number of seconds before the data is automatically deleted from the DSE table.

Default: -1 ( disabled )

deletesEnabled
When enabled, treat records that after mapping would result in only non-null values for primary key columns as deletes, rather than inserting/updating nulls for all regular columns.
Note: Only triggers if the setting is enabled and the mapping specification contains all DSE table columns.

Default: true