当前位置:网站首页>The role of applicationmaster in spark on Yan's cluster mode
The role of applicationmaster in spark on Yan's cluster mode
2022-07-06 21:37:00 【Big data Xiaochen】
Why? Spark On Yarn Through ApplicationMaster Whereabouts ResourceManager Apply to start Executors, Not through Driver To do these things ?
Because in standalone In cluster mode ,Driver towards Master apply Worker Resources for starting Executor, And the same , stay Yarn In cluster mode ,Spark The application needs to ResourceManager apply NodeManager Resources for starting Executor, This responsibility can make ApplicationMaster To do , Rather than let Driver To do , It can make Driver More relaxed , Achieve decoupling .
边栏推荐
- 红杉中国,刚刚募资90亿美元
- Quick news: the flybook players' conference is held online; Wechat payment launched "education and training service toolbox"
- [go][转载]vscode配置完go跑个helloworld例子
- Redistemplate common collection instructions opsforlist (III)
- 039. (2.8) thoughts in the ward
- 愛可可AI前沿推介(7.6)
- Seven original sins of embedded development
- 在最长的距离二叉树结点
- ROS error: could not find a package configuration file provided by "move_base“
- 快讯:飞书玩家大会线上举行;微信支付推出“教培服务工具箱”
猜你喜欢
numpy 下载安装
[Li Kou brush questions] 32 Longest valid bracket
Numpy download and installation
缓存更新策略概览(Caching Strategies Overview)
Tiktok will push the independent grass planting app "praiseworthy". Can't bytes forget the little red book?
【力扣刷题】32. 最长有效括号
Quick news: the flybook players' conference is held online; Wechat payment launched "education and training service toolbox"
嵌入式开发的7大原罪
Sequoia China, just raised $9billion
uni-app App端半屏连续扫码
随机推荐
14 years Bachelor degree, transferred to software testing, salary 13.5k
Binary tree node at the longest distance
50个常用的Numpy函数解释,参数和使用示例
C语言:#if、#def和#ifndef综合应用
Nodejs tutorial let's create your first expressjs application with typescript
Enhance network security of kubernetes with cilium
Torch Cookbook
JS学习笔记-OO创建怀疑的对象
Acdreamoj1110 (multiple backpacks)
3D face reconstruction: from basic knowledge to recognition / reconstruction methods!
Sdl2 source analysis 7: performance (sdl_renderpresent())
document. Usage of write () - write text - modify style and position control
Start the embedded room: system startup with limited resources
快讯:飞书玩家大会线上举行;微信支付推出“教培服务工具箱”
对话阿里巴巴副总裁贾扬清:追求大模型,并不是一件坏事
Web开发小妙招:巧用ThreadLocal规避层层传值
guava:Collections. The collection created by unmodifiablexxx is not immutable
Sql: stored procedures and triggers - Notes
ROS error: could not find a package configuration file provided by "move_base“
MySQL - 事务(Transaction)详解