当前位置:网站首页>Why is the cluster mode of spark on Yan better than the client mode
Why is the cluster mode of spark on Yan better than the client mode
2022-07-06 21:43:00 【Big data Xiaochen】
1、 Because in this way , bring Driver towards Executor Our communications are all in the same cluster network segment , High communication efficiency . And vice versa yarn-client Mode Driver In the submitted network segment ,Executor We are in yarn The network segment of the cluster ,2 The network segments may be different , Communication efficiency is low .
2、 Generally, the machines submitted in the enterprise are so 1-2 platform , If everyone uses the same machine client Modes run their respective Spark application , Then it will cause all Driver Processes are started on this machine , The burden on this machine is heavy , All tasks are affected . And random and idle WorkerNode Scattered all Driver, Load balancing .
边栏推荐
- 强化学习-学习笔记5 | AlphaGo
- el-table表格——获取单击的是第几行和第几列 & 表格排序之el-table与sort-change、el-table-column与sort-method & 清除排序-clearSort
- guava:创建immutableXxx对象的3种方式
- Fastjson parses JSON strings (deserialized to list, map)
- It's not my boast. You haven't used this fairy idea plug-in!
- string的底层实现
- string的底层实现
- for循环中break与continue的区别——break-完全结束循环 & continue-终止本次循环
- Guava: use of multiset
- JS method to stop foreach
猜你喜欢
[sliding window] group B of the 9th Landbridge cup provincial tournament: log statistics
C how to set two columns comboboxcolumn in DataGridView to bind a secondary linkage effect of cascading events
麦趣尔砸了小众奶招牌
Shake Sound poussera l'application indépendante de plantation d'herbe "louable", les octets ne peuvent pas oublier le petit livre rouge?
[Digital IC manual tearing code] Verilog automatic beverage machine | topic | principle | design | simulation
【滑动窗口】第九届蓝桥杯省赛B组:日志统计
1292_FreeROS中vTaskResume()以及xTaskResumeFromISR()的实现分析
Z function (extended KMP)
ViT论文详解
OneNote in-depth evaluation: using resources, plug-ins, templates
随机推荐
mysql根据两个字段去重
npm run dev启动项目报错 document is not defined
在Pi和Jetson nano上运行深度网络,程序被Killed
The relationship between root and coefficient of quadratic equation with one variable
Enhance network security of kubernetes with cilium
JS get array subscript through array content
ROS error: could not find a package configuration file provided by "move_base“
ViT论文详解
Fastjson parses JSON strings (deserialized to list, map)
抖音將推獨立種草App“可頌”,字節忘不掉小紅書?
一行代码可以做些什么?
After working for 5 years, this experience is left when you reach P7. You have helped your friends get 10 offers
How do I remove duplicates from the list- How to remove duplicates from a list?
Hill | insert sort
Technology sharing | packet capturing analysis TCP protocol
Nodejs教程之让我们用 typescript 创建你的第一个 expressjs 应用程序
通过数字电视通过宽带网络取代互联网电视机顶盒应用
@GetMapping、@PostMapping 和 @RequestMapping详细区别附实战代码(全)
Nodejs教程之Expressjs一篇文章快速入门
string的底层实现