• Glossary
  • Support
  • Downloads
  • DataStax Home
Get Live Help
Expand All
Collapse All

DataStax Streaming Home

Streaming Learning

    • Processing Data
      • Change Data Capture
        • Overview
        • Table schema evolution
        • Consuming change data
        • Questions and patterns
      • Data Pipelines
    • Migrating to Apache Pulsar
      • Starlight for Kafka
      • Starlight for RabbitMQ
      • Starlight for JMS
    • APIs & References
      • Connectors
        • Sources
          • Data Generator
          • Debezium MongoDB
          • Debezium MySQL
          • Debezium Oracle
          • Debezium PostgreSQL
          • Debezium SQL Server
          • Kafka
          • Kinesis
        • Sinks
          • Astra DB (Cassandra Enhanced)
          • Cloud Storage
          • Elasticsearch
          • Google BigQuery
          • JDBC PostgreSQL
          • JDBC MariaDB
          • JDBC Clickhouse
          • JDBC SQLite
          • Kafka
          • Kinesis
          • Snowflake
      • Pulsar Functions
      • Transformation Functions
        • Overview
        • Cast
        • Compute
        • Drop
        • Flatten
        • Merge KeyValue
        • Unwrap KeyValue
        • Deploy transform function in sink
        • Drop fields
      • Topic Subscriptions
        • Overview
        • Exclusive
        • Failover
        • Shared
        • Key Shared
  • Streaming Learning
  • APIs & References
  • Transformation Functions
  • Drop
Edit this Page

Drop

The drop transform function drops a record from further processing.
Use in conjunction with when to selectively drop records.
The step name is drop, and the UserConfig is controlled here: {"steps": [{"type": "drop", "when": "value.firstName == value1"}]}.

Parameters:

Parameter Description

when

By default, the record is dropped. Set this parameter to selectively choose when to drop a message.

Example

  1. Produce an AVRO message with the payload: {firstName: value1, lastName: value2}.

  2. The function drops records matching the when statement value.firstName == value1.
    There is no output.

What’s next?

For more, see Transform Functions or the Pulsar documentation.

Compute Flatten

General Inquiries: +1 (650) 389-6000 info@datastax.com

© DataStax | Privacy policy | Terms of use

DataStax, Titan, and TitanDB are registered trademarks of DataStax, Inc. and its subsidiaries in the United States and/or other countries.

Apache, Apache Cassandra, Cassandra, Apache Tomcat, Tomcat, Apache Lucene, Apache Solr, Apache Hadoop, Hadoop, Apache Pulsar, Pulsar, Apache Spark, Spark, Apache TinkerPop, TinkerPop, Apache Kafka and Kafka are either registered trademarks or trademarks of the Apache Software Foundation or its subsidiaries in Canada, the United States and/or other countries.

Kubernetes is the registered trademark of the Linux Foundation.

landing_page landingpage