当前位置:网站首页>Flink partition policy
Flink partition policy
2022-06-25 11:39:00 【Direction_ Wind】
- GlobalPartitioner The data will be distributed to the first instance of the downstream operator for processing
- RebalancePartitioner Count It is reported that Be followed Ring hair Deliver to Next Swimming each A reality In the example Into the Office The reason is .
- RescalePartitioner This kind of partition will be based on the parallelism of upstream and downstream operators , Loop output to every instance of the downstream operator .
- BroadcastPartitioner The broadcast partition will output the upstream data to each instance of the downstream operator . optimum close For big data sets and small data sets Jion Scene .
- ForwardPartitioner Used to output records to downstream local operator instances . It requires upstream and downstream count Son and That's ok degree One sample . To put it simply , ForwardPartitioner Console printing for data .( It's also chain Conditions for operators )
- KeyGroupStreamPartitioner Hash Comparator . Will press the data Key Of Hash Value output to downstream operator instance .
- CustomPartitionerWrapper User defined partition . It needs to be implemented by users themselves Partitioner Interface , To define your own partition logic
RescalePartitioner It's a little hard to understand , Suppose the upstream parallelism is 2, The number is A and B. The downstream parallelism is 4, The number is 1,2,3,4. that A Then send the data loop to 1 and 2,B Then send the data loop to 3 and 4. Suppose the upstream parallelism is 4, The number is A,B,C,D. Downstream parallel Line degree , The number is 1,2. that A and B Send the data to 1,C and D Send the data to 2.
边栏推荐
- 记一次给OpenHarmony提交代码的过程
- 查询法,中断法实现USART通信
- 金仓KFS数据级联场景部署
- Crawler scheduling framework of scratch+scratch+grammar
- How PHP extracts image addresses from strings
- JVM shutdown hook details
- Detailed explanation of spark specification
- Comparable的使用(用于Arrays.sort)
- Query method and interrupt method to realize USART communication
- Nacos installation and use
猜你喜欢

牛客网:旋转数组

杭州/北京内推 | 阿里达摩院招聘视觉生成方向学术实习生(人才计划)

Démarrer avec Apache shenyu

What is the development history, specific uses and structure of the chip

Whole process of web page request

Double tampon transparent cryptage et décryptage basé sur le cadre minifilter

Apache ShenYu 入門

基于C语言的图书信息管理系统 课程论文+代码及可执行exe文件

c盘使用100%清理方法

ThingsPanel 发布物联网手机客户端(多图)
随机推荐
Sentinel integrated Nacos data source
Design and implementation of university laboratory goods management information system based on SSH
Database Series: MySQL index optimization summary (comprehensive version)
寿命分布 4种
Gaussdb cluster maintenance case set - slow SQL execution
Big Endian 和 Little Endian
龙书虎书鲸书啃不动?试试豆瓣评分9.5的猴书
Hangzhou / Beijing neitui Ali Dharma academy recruits academic interns in visual generation (talent plan)
【上云精品】节能提效!加速纺织业“智造”转型
CFCA Anxin sign access
Openfeign uses
try-catch-finally
反应c语言程序结构特点的程序
Use of Presto visualization client-yanagishima20.0
c盘使用100%清理方法
Upload and modify the use of avatars
GaussDB 如何统计用户sql的响应时间
Comparable的使用(用于Arrays.sort)
Spark history server and event log details
Causes and solutions of over fitting