当前位置:网站首页>Why is the cluster mode of spark on Yan better than the client mode
Why is the cluster mode of spark on Yan better than the client mode
2022-07-06 21:43:00 【Big data Xiaochen】
1、 Because in this way , bring Driver towards Executor Our communications are all in the same cluster network segment , High communication efficiency . And vice versa yarn-client Mode Driver In the submitted network segment ,Executor We are in yarn The network segment of the cluster ,2 The network segments may be different , Communication efficiency is low .
2、 Generally, the machines submitted in the enterprise are so 1-2 platform , If everyone uses the same machine client Modes run their respective Spark application , Then it will cause all Driver Processes are started on this machine , The burden on this machine is heavy , All tasks are affected . And random and idle WorkerNode Scattered all Driver, Load balancing .
边栏推荐
- High precision face recognition based on insightface, which can directly benchmark hongruan
- 技术分享 | 抓包分析 TCP 协议
- PostgreSQL modifies the password of the database user
- Caching strategies overview
- JPEG2000-Matlab源码实现
- 1D convolution detail
- C how to set two columns comboboxcolumn in DataGridView to bind a secondary linkage effect of cascading events
- 跨分片方案 总结
- In JS, string and array are converted to each other (I) -- the method of converting string into array
- guava:Collections.unmodifiableXXX创建的collection并不immutable
猜你喜欢
Numpy download and installation
for循环中break与continue的区别——break-完全结束循环 & continue-终止本次循环
50个常用的Numpy函数解释,参数和使用示例
[sliding window] group B of the 9th Landbridge cup provincial tournament: log statistics
Chris LATTNER, the father of llvm: why should we rebuild AI infrastructure software
numpy 下载安装
爬虫实战(五):爬豆瓣top250
JPEG2000 matlab source code implementation
【Redis设计与实现】第一部分 :Redis数据结构和对象 总结
对话阿里巴巴副总裁贾扬清:追求大模型,并不是一件坏事
随机推荐
ACdreamoj1110(多重背包)
PostgreSQL install GIS plug-in create extension PostGIS_ topology
WEB功能测试说明
FZU 1686 龙之谜 重复覆盖
首批入选!腾讯安全天御风控获信通院业务安全能力认证
for循环中break与continue的区别——break-完全结束循环 & continue-终止本次循环
C language char, wchar_ t, char16_ t, char32_ Relationship between T and character set
R语言做文本挖掘 Part4文本分类
MySQL - transaction details
代理和反向代理
互联网快讯:吉利正式收购魅族;胰岛素集采在31省全面落地
Nodejs tutorial let's create your first expressjs application with typescript
JS according to the Chinese Alphabet (province) or according to the English alphabet - Za sort &az sort
string的底层实现
1D convolution detail
Four common ways and performance comparison of ArrayList de duplication (jmh performance analysis)
JS学习笔记-OO创建怀疑的对象
Nodejs教程之让我们用 typescript 创建你的第一个 expressjs 应用程序
Comparison between multithreaded CAS and synchronized
14年本科毕业,转行软件测试,薪资13.5K