• Glossary
  • Support
  • Downloads
  • DataStax Home
Get Live Help
Expand All
Collapse All

DataStax Streaming Home

Streaming Learning

    • Pulsar IO
      • Sinks
        • Astra DB
        • Elasticsearch
        • JDBC PostgreSQL
        • JDBC MariaDB
        • JDBC Clickhouse
        • JDBC SQLite
        • Kafka
        • Kinesis
        • Snowflake
      • Sources
        • Data Generator
        • Debezium MongoDB
        • Debezium MySQL
        • Debezium Oracle
        • Debezium PostgreSQL
        • Debezium SQL Server
        • Kafka
        • Kinesis
    • Transform functions
      • Cast
      • Compute
      • Deploy transform function in sink
      • Drop fields
      • Drop
      • Flatten
      • Merge KeyValue
      • Unwrap KeyValue
    • Real-time Processing
      • Real-time data pipelines with DataStax Astra and Decodable
    • Pulsar extensions
      • Starlight for Kafka
      • Starlight for RabbitMQ
      • Starlight for JMS
  • Streaming Learning
  • Transform functions
  • Merge KeyValue
Edit this Page

Merge KeyValue

The merge-key-value transform function merges the fields of KeyValue records where both the key and value are structured types of the same schema type. (Currently only AVRO is supported).
The step name is merge-key-value and the UserConfig is controlled here: {"steps": [{"type": "merge-key-value"}]}.

Example

  1. Produce an AVRO message with the payload: {key={keyField: key}, value={valueField: value}}.

    • AVRO

    • Result

    {key={keyField: key}, value={valueField: value}}
    {key={keyField: key}, value={keyField: key, valueField: value}}
  2. The function merges the KeyValue fields (because both are AVRO type) and outputs {key={keyField: key}, value={keyField: key, valueField: value}} to the output topic.

What’s next?

For more, see Transform Functions or the Pulsar documentation.

Flatten Unwrap KeyValue

General Inquiries: +1 (650) 389-6000 info@datastax.com

© DataStax | Privacy policy | Terms of use

DataStax, Titan, and TitanDB are registered trademarks of DataStax, Inc. and its subsidiaries in the United States and/or other countries.

Apache, Apache Cassandra, Cassandra, Apache Tomcat, Tomcat, Apache Lucene, Apache Solr, Apache Hadoop, Hadoop, Apache Pulsar, Pulsar, Apache Spark, Spark, Apache TinkerPop, TinkerPop, Apache Kafka and Kafka are either registered trademarks or trademarks of the Apache Software Foundation or its subsidiaries in Canada, the United States and/or other countries.

Kubernetes is the registered trademark of the Linux Foundation.

landing_page landingpage