当前位置:网站首页>Why is the cluster mode of spark on Yan better than the client mode
Why is the cluster mode of spark on Yan better than the client mode
2022-07-06 21:43:00 【Big data Xiaochen】
1、 Because in this way , bring Driver towards Executor Our communications are all in the same cluster network segment , High communication efficiency . And vice versa yarn-client Mode Driver In the submitted network segment ,Executor We are in yarn The network segment of the cluster ,2 The network segments may be different , Communication efficiency is low .
2、 Generally, the machines submitted in the enterprise are so 1-2 platform , If everyone uses the same machine client Modes run their respective Spark application , Then it will cause all Driver Processes are started on this machine , The burden on this machine is heavy , All tasks are affected . And random and idle WorkerNode Scattered all Driver, Load balancing .

边栏推荐
- Yyds dry inventory run kubeedge official example_ Counter demo counter
- [Digital IC manual tearing code] Verilog automatic beverage machine | topic | principle | design | simulation
- After working for 5 years, this experience is left when you reach P7. You have helped your friends get 10 offers
- Description of web function test
- Vim 基本配置和经常使用的命令
- C language char, wchar_ t, char16_ t, char32_ Relationship between T and character set
- 分糖果
- 数字化转型挂帅复产复工,线上线下全融合重建商业逻辑
- Caching strategies overview
- 【力扣刷题】一维动态规划记录(53零钱兑换、300最长递增子序列、53最大子数组和)
猜你喜欢

爬虫实战(五):爬豆瓣top250

Is it profitable to host an Olympic Games?

JS method to stop foreach

numpy 下载安装

50个常用的Numpy函数解释,参数和使用示例

Shake Sound poussera l'application indépendante de plantation d'herbe "louable", les octets ne peuvent pas oublier le petit livre rouge?

KDD 2022 | realize unified conversational recommendation through knowledge enhanced prompt learning

Internet News: Geely officially acquired Meizu; Intensive insulin purchase was fully implemented in 31 provinces
![[in depth learning] pytorch 1.12 was released, officially supporting Apple M1 chip GPU acceleration and repairing many bugs](/img/66/4d94ae24e99599891636013ed734c5.png)
[in depth learning] pytorch 1.12 was released, officially supporting Apple M1 chip GPU acceleration and repairing many bugs

This year, Jianzhi Tencent
随机推荐
C语言:#if、#def和#ifndef综合应用
js 根据汉字首字母排序(省份排序) 或 根据英文首字母排序——za排序 & az排序
Proxy and reverse proxy
JS get array subscript through array content
强化学习-学习笔记5 | AlphaGo
JS method to stop foreach
Yyds dry inventory run kubeedge official example_ Counter demo counter
Explain ESM module and commonjs module in simple terms
This year, Jianzhi Tencent
Search map website [quadratic] [for search map, search fan, search book]
One line by line explanation of the source code of anchor free series network yolox (a total of ten articles, you can change the network at will after reading it, if you won't complain to me)
Fastjson parses JSON strings (deserialized to list, map)
Michael smashed the minority milk sign
14 years Bachelor degree, transferred to software testing, salary 13.5k
[in depth learning] pytorch 1.12 was released, officially supporting Apple M1 chip GPU acceleration and repairing many bugs
SQL:存储过程和触发器~笔记
C# 如何在dataGridView里设置两个列comboboxcolumn绑定级联事件的一个二级联动效果
Caching strategies overview
[Li Kou brush questions] 32 Longest valid bracket
Technology sharing | packet capturing analysis TCP protocol