当前位置:网站首页>flume系列之:拦截器过滤数据
flume系列之:拦截器过滤数据
2022-07-05 18:45:00 【目标博客专家】
flume系列之:拦截器过滤数据
一、kafka空值数据
ConsumerRecord(topic=‘debezium-prod-optics_prod_1h.optics_prod.user_order’, partition=2, offset=3636705, timestamp=1656746091521, timestamp_type=0, key=b’{“schema”:{“type”:“struct”,“fields”:[{“type”:“int32”,“optional”:false,“field”:“order_id”}],“optional”:false,“name”:“debezium_prod_optics_prod_1h.order_prod.user_order.Key”},“playload”:{“order_id”:2752094}}', value=None, headers=[], checksum=None, serialized_key_size=223, serialized_value_size=-1, serialized_header_size=-1)
如上所示:
- value=None
- flume可以使用拦截器过滤掉value为None的kafka消息
二、拦截器过滤空值数据
更多拦截器相关博客请参考博主下面两篇文章:
边栏推荐
- All you want to know about clothing ERP is here
- XML basic knowledge concept
- CDB 实例的启动与关闭
- Optimization of middle alignment of loading style of device player in easycvr electronic map
- Lombok @builder annotation
- Common time complexity
- Ant group open source trusted privacy computing framework "argot": open and universal
- 泰山OFFICE技术讲座:由行的布局高度,谈绘制高度的高度溢出、高度缩水(全网首发)
- 2022 the most complete Tencent background automation testing and continuous deployment practice in the whole network [10000 words]
- 在线协作产品哪家强?微软 Loop 、Notion、FlowUs
猜你喜欢
尚硅谷尚优选项目教程发布
MySQL优化六个点的总结
进程间通信(IPC):共享内存
How to quickly advance automated testing? Listen to the personal feelings of the three bat test engineers
技术分享 | 常见接口协议解析
图扑软件数字孪生 | 基于 BIM 技术的可视化管理系统
面试官:Redis 过期删除策略和内存淘汰策略有什么区别?
5. Data access - entityframework integration
The era of Web3.0 is coming. See how Tianyi cloud storage resources revitalize the system to enable new infrastructure (Part 2)
为什么 BI 软件都搞不定关联分析?带你分析分析
随机推荐
Solutions contents have differences only in line separators
尚硅谷尚优选项目教程发布
图扑软件数字孪生 | 基于 BIM 技术的可视化管理系统
AI open2022 | overview of recommendation systems based on heterogeneous information networks: concepts, methods, applications and resources
Use of websocket tool
华为让出的高端市场,小米12S靠徕卡能抢到吗?
Go deep into the underlying C source code and explain the core design principles of redis
泰山OFFICE技术讲座:由行的布局高度,谈绘制高度的高度溢出、高度缩水(全网首发)
EasyCVR电子地图中设备播放器loading样式的居中对齐优化
5. 数据访问 - EntityFramework集成
2022年5月腾讯云开发者社区视频月度榜单公布
达梦数据库udf实现
集合处理的利器
Case sharing | integrated construction of data operation and maintenance in the financial industry
A cloud opens a new future of smart transportation
What is text mining? "Suggested collection"
Mathematical modeling of oil pipeline layout MATLAB, mathematical model of oil pipeline layout
Windows Oracle 开启远程连接 Windows Server Oracle 开启远程连接
紧固件行业供应商绩效考核繁琐?选对工具才能轻松逆袭!
从外卖点单浅谈伪需求