当前位置：网站首页>The role of applicationmaster in spark on Yan's cluster mode
The role of applicationmaster in spark on Yan's cluster mode
2022-07-06 21:37:00 【Big data Xiaochen】
Why? Spark On Yarn Through ApplicationMaster Whereabouts ResourceManager Apply to start Executors, Not through Driver To do these things ？
Because in standalone In cluster mode ,Driver towards Master apply Worker Resources for starting Executor, And the same , stay Yarn In cluster mode ,Spark The application needs to ResourceManager apply NodeManager Resources for starting Executor, This responsibility can make ApplicationMaster To do , Rather than let Driver To do , It can make Driver More relaxed , Achieve decoupling .
边栏推荐
- Why does MySQL index fail? When do I use indexes?
- Quick access to video links at station B
- Chris LATTNER, the father of llvm: why should we rebuild AI infrastructure software
- Absolute primes (C language)
- 1292_FreeROS中vTaskResume()以及xTaskResumeFromISR()的实现分析
- JS学习笔记-OO创建怀疑的对象
- js中，字符串和数组互转（二）——数组转为字符串的方法
- PostgreSQL 修改数据库用户的密码
- Four common ways and performance comparison of ArrayList de duplication (jmh performance analysis)
- 3D face reconstruction: from basic knowledge to recognition / reconstruction methods!
猜你喜欢
Efficiency tool +wps check box shows the solution to the sun problem
HMS core machine learning service creates a new "sound" state of simultaneous interpreting translation, and AI makes international exchanges smoother
![[in depth learning] pytorch 1.12 was released, officially supporting Apple M1 chip GPU acceleration and repairing many bugs](/img/66/4d94ae24e99599891636013ed734c5.png)
[in depth learning] pytorch 1.12 was released, officially supporting Apple M1 chip GPU acceleration and repairing many bugs
3D人脸重建：从基础知识到识别/重建方法！
KDD 2022 | realize unified conversational recommendation through knowledge enhanced prompt learning
Shake Sound poussera l'application indépendante de plantation d'herbe "louable", les octets ne peuvent pas oublier le petit livre rouge?
跨分片方案 总结
互联网快讯：吉利正式收购魅族；胰岛素集采在31省全面落地
1292_FreeROS中vTaskResume()以及xTaskResumeFromISR()的实现分析
MLP (multilayer perceptron neural network) is a multilayer fully connected neural network model.
随机推荐
Web开发小妙招：巧用ThreadLocal规避层层传值
[in depth learning] pytorch 1.12 was released, officially supporting Apple M1 chip GPU acceleration and repairing many bugs
039. (2.8) thoughts in the ward
Z function (extended KMP)
JS traversal array and string
Binary tree node at the longest distance
b站视频链接快速获取
Replace Internet TV set-top box application through digital TV and broadband network
Is this the feeling of being spoiled by bytes?
Is it profitable to host an Olympic Games?
Divide candy
JPEG2000-Matlab源码实现
Yyds dry inventory run kubeedge official example_ Counter demo counter
Start the embedded room: system startup with limited resources
Description of web function test
Four common ways and performance comparison of ArrayList de duplication (jmh performance analysis)
El table table - sortable sorting & disordered sorting when decimal and% appear
966 minimum path sum
Comparison between multithreaded CAS and synchronized
50个常用的Numpy函数解释，参数和使用示例