当前位置:网站首页>Why is the cluster mode of spark on Yan better than the client mode
Why is the cluster mode of spark on Yan better than the client mode
2022-07-06 21:43:00 【Big data Xiaochen】
1、 Because in this way , bring Driver towards Executor Our communications are all in the same cluster network segment , High communication efficiency . And vice versa yarn-client Mode Driver In the submitted network segment ,Executor We are in yarn The network segment of the cluster ,2 The network segments may be different , Communication efficiency is low .
2、 Generally, the machines submitted in the enterprise are so 1-2 platform , If everyone uses the same machine client Modes run their respective Spark application , Then it will cause all Driver Processes are started on this machine , The burden on this machine is heavy , All tasks are affected . And random and idle WorkerNode Scattered all Driver, Load balancing .

边栏推荐
- In JS, string and array are converted to each other (II) -- the method of converting array into string
- From campus to Tencent work for a year of those stumbles!
- 20220211 failure - maximum amount of data supported by mongodb
- What can one line of code do?
- C how to set two columns comboboxcolumn in DataGridView to bind a secondary linkage effect of cascading events
- Summary of cross partition scheme
- el-table表格——sortable排序 & 出现小数、%时排序错乱
- The use method of string is startwith () - start with XX, endswith () - end with XX, trim () - delete spaces at both ends
- Dialogue with Jia Yangqing, vice president of Alibaba: pursuing a big model is not a bad thing
- uni-app App端半屏连续扫码
猜你喜欢

红杉中国,刚刚募资90亿美元

【Redis设计与实现】第一部分 :Redis数据结构和对象 总结
![Leetcode topic [array] -118 Yang Hui triangle](/img/77/d8a7085968cc443260b4c0910bd04b.jpg)
Leetcode topic [array] -118 Yang Hui triangle

C# 如何在dataGridView里设置两个列comboboxcolumn绑定级联事件的一个二级联动效果

抖音将推独立种草App“可颂”,字节忘不掉小红书?

3D face reconstruction: from basic knowledge to recognition / reconstruction methods!

The difference between break and continue in the for loop -- break completely end the loop & continue terminate this loop

爬虫实战(五):爬豆瓣top250

Quick news: the flybook players' conference is held online; Wechat payment launched "education and training service toolbox"

039. (2.8) thoughts in the ward
随机推荐
c语言char, wchar_t, char16_t, char32_t和字符集的关系
JPEG2000 matlab source code implementation
From campus to Tencent work for a year of those stumbles!
JS learning notes OO create suspicious objects
Description of web function test
Guava: use of multiset
50 commonly used numpy function explanations, parameters and usage examples
R语言做文本挖掘 Part4文本分类
Forward maximum matching method
[interpretation of the paper] machine learning technology for Cataract Classification / classification
缓存更新策略概览(Caching Strategies Overview)
Web开发小妙招:巧用ThreadLocal规避层层传值
Redistemplate common collection instructions opsforzset (VI)
C how to set two columns comboboxcolumn in DataGridView to bind a secondary linkage effect of cascading events
mysql根据两个字段去重
The use method of string is startwith () - start with XX, endswith () - end with XX, trim () - delete spaces at both ends
Replace Internet TV set-top box application through digital TV and broadband network
jvm:大对象在老年代的分配
Thinking about agile development
R3live notes: image processing section