Flume series: interceptor filtering data

One 、kafka Null data

ConsumerRecord(topic=‘debezium-prod-optics_prod_1h.optics_prod.user_order’, partition=2, offset=3636705, timestamp=1656746091521, timestamp_type=0, key=b’{“schema”:{“type”:“struct”,“fields”:[{“type”:“int32”,“optional”:false,“field”:“order_id”}],“optional”:false,“name”:“debezium_prod_optics_prod_1h.order_prod.user_order.Key”},“playload”:{“order_id”:2752094}}', value=None, headers=[], checksum=None, serialized_key_size=223, serialized_value_size=-1, serialized_header_size=-1)

As shown above ：

• value=None
• flume You can use interceptors to filter out value by None Of kafka news

Two 、 Interceptors filter null data

For more interceptor related blogs, please refer to the blogger's next two articles ：