当前位置:网站首页>Why is the cluster mode of spark on Yan better than the client mode
Why is the cluster mode of spark on Yan better than the client mode
2022-07-06 21:43:00 【Big data Xiaochen】
1、 Because in this way , bring Driver towards Executor Our communications are all in the same cluster network segment , High communication efficiency . And vice versa yarn-client Mode Driver In the submitted network segment ,Executor We are in yarn The network segment of the cluster ,2 The network segments may be different , Communication efficiency is low .
2、 Generally, the machines submitted in the enterprise are so 1-2 platform , If everyone uses the same machine client Modes run their respective Spark application , Then it will cause all Driver Processes are started on this machine , The burden on this machine is heavy , All tasks are affected . And random and idle WorkerNode Scattered all Driver, Load balancing .

边栏推荐
- Proxy and reverse proxy
- 1D convolution detail
- Reinforcement learning - learning notes 5 | alphago
- [Li Kou brush questions] 32 Longest valid bracket
- Tiktok will push the independent grass planting app "praiseworthy". Can't bytes forget the little red book?
- Sdl2 source analysis 7: performance (sdl_renderpresent())
- uni-app App端半屏连续扫码
- Acdreamoj1110 (multiple backpacks)
- 14 years Bachelor degree, transferred to software testing, salary 13.5k
- Microsoft technology empowerment position - February course Preview
猜你喜欢

一行代码可以做些什么?

1292_ Implementation analysis of vtask resume() and xtask resume fromisr() in freeros

袁小林:安全不只是标准,更是沃尔沃不变的信仰和追求

ViT论文详解
![[interpretation of the paper] machine learning technology for Cataract Classification / classification](/img/0c/b76e59f092c1b534736132faa76de5.png)
[interpretation of the paper] machine learning technology for Cataract Classification / classification

Numpy download and installation

中国白酒的5场大战

Seven original sins of embedded development

麦趣尔砸了小众奶招牌

【滑动窗口】第九届蓝桥杯省赛B组:日志统计
随机推荐
Vim 基本配置和经常使用的命令
一行代码可以做些什么?
ROS error: could not find a package configuration file provided by "move_base“
One line by line explanation of the source code of anchor free series network yolox (a total of ten articles, you can change the network at will after reading it, if you won't complain to me)
Happy sound 2[sing.2]
Absolute primes (C language)
string的底层实现
Nodejs教程之让我们用 typescript 创建你的第一个 expressjs 应用程序
Fzu 1686 dragon mystery repeated coverage
JS according to the Chinese Alphabet (province) or according to the English alphabet - Za sort &az sort
SDL2来源分析7:演出(SDL_RenderPresent())
FZU 1686 龙之谜 重复覆盖
[redis design and implementation] part I: summary of redis data structure and objects
R3live notes: image processing section
麦趣尔砸了小众奶招牌
JS学习笔记-OO创建怀疑的对象
npm run dev启动项目报错 document is not defined
抖音將推獨立種草App“可頌”,字節忘不掉小紅書?
Comparison between multithreaded CAS and synchronized
guava:Collections.unmodifiableXXX创建的collection并不immutable