当前位置:网站首页>The role of applicationmaster in spark on Yan's cluster mode
The role of applicationmaster in spark on Yan's cluster mode
2022-07-06 21:37:00 【Big data Xiaochen】
Why? Spark On Yarn Through ApplicationMaster Whereabouts ResourceManager Apply to start Executors, Not through Driver To do these things ?
Because in standalone In cluster mode ,Driver towards Master apply Worker Resources for starting Executor, And the same , stay Yarn In cluster mode ,Spark The application needs to ResourceManager apply NodeManager Resources for starting Executor, This responsibility can make ApplicationMaster To do , Rather than let Driver To do , It can make Driver More relaxed , Achieve decoupling .
边栏推荐
- 3D face reconstruction: from basic knowledge to recognition / reconstruction methods!
- C language char, wchar_ t, char16_ t, char32_ Relationship between T and character set
- ViT论文详解
- ACdreamoj1110(多重背包)
- 中国白酒的5场大战
- VIM basic configuration and frequently used commands
- 038. (2.7) less anxiety
- Nodejs tutorial expressjs article quick start
- MySQL - 事务(Transaction)详解
- 039. (2.8) thoughts in the ward
猜你喜欢
Yuan Xiaolin: safety is not only a standard, but also Volvo's unchanging belief and pursuit
C# 如何在dataGridView里设置两个列comboboxcolumn绑定级联事件的一个二级联动效果
50个常用的Numpy函数解释,参数和使用示例
[sliding window] group B of the 9th Landbridge cup provincial tournament: log statistics
Why does MySQL index fail? When do I use indexes?
966 minimum path sum
ICML 2022 | flowformer: task generic linear complexity transformer
麦趣尔砸了小众奶招牌
3D人脸重建:从基础知识到识别/重建方法!
Five wars of Chinese Baijiu
随机推荐
14年本科毕业,转行软件测试,薪资13.5K
039. (2.8) thoughts in the ward
npm run dev启动项目报错 document is not defined
First batch selected! Tencent security tianyufeng control has obtained the business security capability certification of the ICT Institute
50个常用的Numpy函数解释,参数和使用示例
Set up a time server
Internet News: Geely officially acquired Meizu; Intensive insulin purchase was fully implemented in 31 provinces
@Detailed differences among getmapping, @postmapping and @requestmapping, with actual combat code (all)
袁小林:安全不只是标准,更是沃尔沃不变的信仰和追求
【力扣刷题】32. 最长有效括号
Sql: stored procedures and triggers - Notes
JS操作dom元素(一)——获取DOM节点的六种方式
20220211 failure - maximum amount of data supported by mongodb
Redistemplate common collection instructions opsforhash (IV)
Three schemes of SVM to realize multi classification
分糖果
038. (2.7) less anxiety
How do I remove duplicates from the list- How to remove duplicates from a list?
JS operation DOM element (I) -- six ways to obtain DOM nodes
Redistemplate common collection instructions opsforset (V)