Removing a field map

DataStax Apache Kafka™ Connector processing fails if any mapped Kafka topic fields are missing from the record. If a field is missing or if the schema change is known ahead, remove the topic-column mapping.

Warning: DataStax database table schema have PRIMARY KEY columns that uniquely identify and partition rows. See CQL data modeling. A NULL is not allowed in a PRIMARY KEY column. Therefore, each PRIMARY KEY column must have a field-column map.

Procedure

  1. On a DataStax database node, use the CQLSH DESCRIBE TABLE command to verify that the field is not a PRIMARY KEY (PK) column.
    Note: If the field is a PK column, map a different field to the column.
  2. Remove the field to column mapping from the configuration. See Mapping kafka topics to DataStax Enterprise database tables.
  3. Update the configuration with the new settings. See Updating the DataStax Apache Kafka Connector configuration.
  4. Start the Kafka producer that had the schema change.