Have a question or want live help from a DataStax engineer? Let's chat.

Jump to main content
DataStax Home Page
  • Support
  • DataStax Home
  • Downloads
  • Learn
    • Academy
    • Developers
    • Community
    • Blog
    • Resource library
    • Examples on GitHub
  • Drivers
    • Driver home page
    • C++ Driver Guide
    • C# Driver Guide
    • Java Driver Guide
    • Node.js Driver Guide
    • Python Driver Guide
  • Glossary
  • world icon
  • Get Live Help
  • About the Kafka Connector
  • Kafka Connector release notes
  • Installing DataStax Apache Kafka Connector 1.4.0
  • Configuration
  • Operations
  • Security
  • Monitoring
  • Troubleshooting
  • Cycling comments example

Can't find what you're looking for? Try searching other guides

DataStax Apache Kafka™ Connector 1.4.0 Latest version
  • About the Kafka Connector

    Explanation of how the Kafka Connector ingests topics to supported database tables.

  • Kafka Connector release notes

    Release notes for open source DataStax Apache Kafka Connector.

  • Installing DataStax Apache Kafka Connector 1.4.0

    Install on Linux-based platform using a binary tarball.

  • Configuration

    Configuring the connector.

  • Operations

    Maintaining and operating the DataStax Apache Kafka Connector.

    • About maintenance tasks

      Use the Kafka Connect REST API to operate and maintain the DataStax Connector.

    • Deploy

      Start the connector from the Kafka installation directory.

    • Scaling the DataStax Connector

      Respond to increases or decreases in workload.

    • Schema changes

      How to update the DataStax Connector when schema changes are required.

      • New field

        Steps to change the Kafka Topic schema.

      • Remove field

      • New column

        Add a column to the database table to synchronize an existing field from a Kafka topic.

      • Remove column

        Remove a database column from the schema.

    • Verify data

      Verify that data from a mapped Kafka topic was written to the database table column.

    • Restart connector

      Restart the DataStax Apache Kafka™ Connector .

    • Restart tasks

      Restart DataStax Apache Kafka Connector tasks.

    • Pause

      Stops the tasks that the DataStax Apache Kafka™ Connector is running without removing the configuration from the worker.

    • Resume

      After a pause resume the DataStax Apache Kafka™ Connector .

    • Display configuration

      Display configuration of a running connector.

    • Update configuration

      Change the configuration of a running connector.

    • Delete

      Remove the DataStax Apache Kafka™ Connector and all of its tasks.

    • Status

      Displaying the status.

  • Security

    Configure security between the DataStax Apache Kafka Connector and the cluster.

  • Monitoring

    Use metrics reported for both the Kafka Connect Workers and the DataStax Apache Kafka Connector by using Java Management Extension MBeans to monitor the connector.

  • Troubleshooting

    Find answers to common issues and errors.

  • Cycling comments example

    Step-by-step implementation for test or demonstration environments running Apache Kafka and the target database on the same system.

Adding a field to a Kafka Topic

Steps to change the Kafka Topic schema.

Use these steps to write a new field to an existing supported database table column.

Procedure

  1. In the DataStax Apache Kafka Connector configuration file, add the field-to-column definition. See Mapping kafka topics to database tables.
  2. Update the configuration with the new settings. See Updating the DataStax Apache Kafka Connector configuration.
  3. Start the Kafka producer that had the schema change.

General Inquiries:   +1 (650) 389-6000  info@datastax.com

© DataStax | Privacy policy | Terms of use | Updated: 18 February 2022

Build time: 2022-02-18 10:32:33.626

DataStax, Titan, and TitanDB are registered trademarks of DataStax, Inc. and its subsidiaries in the United States and/or other countries.

Apache, Apache Cassandra, Cassandra, Apache Tomcat, Tomcat, Apache Lucene, Apache Solr, Apache Hadoop, Hadoop, Apache Pulsar, Pulsar, Apache Spark, Spark, Apache TinkerPop, TinkerPop, Apache Kafka and Kafka are either registered trademarks or trademarks of the Apache Software Foundation or its subsidiaries in Canada, the United States and/or other countries.

Kubernetes is the registered trademark of the Linux Foundation.

kafka kafka