当前位置:网站首页>Why is the cluster mode of spark on Yan better than the client mode
Why is the cluster mode of spark on Yan better than the client mode
2022-07-06 21:43:00 【Big data Xiaochen】
1、 Because in this way , bring Driver towards Executor Our communications are all in the same cluster network segment , High communication efficiency . And vice versa yarn-client Mode Driver In the submitted network segment ,Executor We are in yarn The network segment of the cluster ,2 The network segments may be different , Communication efficiency is low .
2、 Generally, the machines submitted in the enterprise are so 1-2 platform , If everyone uses the same machine client Modes run their respective Spark application , Then it will cause all Driver Processes are started on this machine , The burden on this machine is heavy , All tasks are affected . And random and idle WorkerNode Scattered all Driver, Load balancing .
边栏推荐
- [interpretation of the paper] machine learning technology for Cataract Classification / classification
- Digital transformation takes the lead to resume production and work, and online and offline full integration rebuilds business logic
- PostgreSQL install GIS plug-in create extension PostGIS_ topology
- In JS, string and array are converted to each other (II) -- the method of converting array into string
- PostgreSQL modifies the password of the database user
- JPEG2000 matlab source code implementation
- 1292_ Implementation analysis of vtask resume() and xtask resume fromisr() in freeros
- JS学习笔记-OO创建怀疑的对象
- 代理和反向代理
- Fzu 1686 dragon mystery repeated coverage
猜你喜欢
[in depth learning] pytorch 1.12 was released, officially supporting Apple M1 chip GPU acceleration and repairing many bugs
爬虫实战(五):爬豆瓣top250
It's not my boast. You haven't used this fairy idea plug-in!
抖音将推独立种草App“可颂”,字节忘不掉小红书?
Digital transformation takes the lead to resume production and work, and online and offline full integration rebuilds business logic
Caching strategies overview
Michael smashed the minority milk sign
This year, Jianzhi Tencent
Fastjson parses JSON strings (deserialized to list, map)
HMS core machine learning service creates a new "sound" state of simultaneous interpreting translation, and AI makes international exchanges smoother
随机推荐
Quick access to video links at station B
Digital transformation takes the lead to resume production and work, and online and offline full integration rebuilds business logic
[Li Kou brushing questions] one dimensional dynamic planning record (53 change exchanges, 300 longest increasing subsequence, 53 largest subarray and)
Internet News: Geely officially acquired Meizu; Intensive insulin purchase was fully implemented in 31 provinces
Explain ESM module and commonjs module in simple terms
Start the embedded room: system startup with limited resources
首批入选!腾讯安全天御风控获信通院业务安全能力认证
Binary tree node at the longest distance
Yuan Xiaolin: safety is not only a standard, but also Volvo's unchanging belief and pursuit
jvm:大对象在老年代的分配
SQL:存储过程和触发器~笔记
Is this the feeling of being spoiled by bytes?
Enhance network security of kubernetes with cilium
Sequoia China, just raised $9billion
This year, Jianzhi Tencent
npm run dev启动项目报错 document is not defined
强化学习-学习笔记5 | AlphaGo
[sliding window] group B of the 9th Landbridge cup provincial tournament: log statistics
Seven original sins of embedded development
guava: Multiset的使用