当前位置:网站首页>Why is the cluster mode of spark on Yan better than the client mode
Why is the cluster mode of spark on Yan better than the client mode
2022-07-06 21:43:00 【Big data Xiaochen】
1、 Because in this way , bring Driver towards Executor Our communications are all in the same cluster network segment , High communication efficiency . And vice versa yarn-client Mode Driver In the submitted network segment ,Executor We are in yarn The network segment of the cluster ,2 The network segments may be different , Communication efficiency is low .
2、 Generally, the machines submitted in the enterprise are so 1-2 platform , If everyone uses the same machine client Modes run their respective Spark application , Then it will cause all Driver Processes are started on this machine , The burden on this machine is heavy , All tasks are affected . And random and idle WorkerNode Scattered all Driver, Load balancing .

边栏推荐
- Nodejs tutorial expressjs article quick start
- The role of applicationmaster in spark on Yan's cluster mode
- Yyds dry inventory run kubeedge official example_ Counter demo counter
- 50 commonly used numpy function explanations, parameters and usage examples
- 【滑动窗口】第九届蓝桥杯省赛B组:日志统计
- HMS core machine learning service creates a new "sound" state of simultaneous interpreting translation, and AI makes international exchanges smoother
- Caching strategies overview
- Why do job hopping take more than promotion?
- 038. (2.7) less anxiety
- 跨分片方案 总结
猜你喜欢

Set up a time server

After working for 5 years, this experience is left when you reach P7. You have helped your friends get 10 offers

抖音將推獨立種草App“可頌”,字節忘不掉小紅書?

50 commonly used numpy function explanations, parameters and usage examples
![Happy sound 2[sing.2]](/img/ca/1581e561c427cb5b9bd5ae2604b993.jpg)
Happy sound 2[sing.2]

【Redis设计与实现】第一部分 :Redis数据结构和对象 总结

Microsoft technology empowerment position - February course Preview

快讯:飞书玩家大会线上举行;微信支付推出“教培服务工具箱”

Chris LATTNER, the father of llvm: why should we rebuild AI infrastructure software

对话阿里巴巴副总裁贾扬清:追求大模型,并不是一件坏事
随机推荐
PostgreSQL 安装gis插件 CREATE EXTENSION postgis_topology
JS get array subscript through array content
What about the spectrogram
el-table表格——sortable排序 & 出现小数、%时排序错乱
In JS, string and array are converted to each other (II) -- the method of converting array into string
快讯:飞书玩家大会线上举行;微信支付推出“教培服务工具箱”
红杉中国,刚刚募资90亿美元
C language: comprehensive application of if, def and ifndef
KDD 2022 | realize unified conversational recommendation through knowledge enhanced prompt learning
[interpretation of the paper] machine learning technology for Cataract Classification / classification
Summary of cross partition scheme
抖音將推獨立種草App“可頌”,字節忘不掉小紅書?
Nodejs tutorial let's create your first expressjs application with typescript
SDL2来源分析7:演出(SDL_RenderPresent())
启动嵌入式间:资源有限的系统启动
jvm:大对象在老年代的分配
[Li Kou brushing questions] one dimensional dynamic planning record (53 change exchanges, 300 longest increasing subsequence, 53 largest subarray and)
guava:Collections.unmodifiableXXX创建的collection并不immutable
JPEG2000-Matlab源码实现
Redistemplate common collection instructions opsforset (V)