当前位置:网站首页>Why is the cluster mode of spark on Yan better than the client mode
Why is the cluster mode of spark on Yan better than the client mode
2022-07-06 21:43:00 【Big data Xiaochen】
1、 Because in this way , bring Driver towards Executor Our communications are all in the same cluster network segment , High communication efficiency . And vice versa yarn-client Mode Driver In the submitted network segment ,Executor We are in yarn The network segment of the cluster ,2 The network segments may be different , Communication efficiency is low .
2、 Generally, the machines submitted in the enterprise are so 1-2 platform , If everyone uses the same machine client Modes run their respective Spark application , Then it will cause all Driver Processes are started on this machine , The burden on this machine is heavy , All tasks are affected . And random and idle WorkerNode Scattered all Driver, Load balancing .

边栏推荐
- PostgreSQL modifies the password of the database user
- The relationship between root and coefficient of quadratic equation with one variable
- el-table表格——获取单击的是第几行和第几列 & 表格排序之el-table与sort-change、el-table-column与sort-method & 清除排序-clearSort
- Quick news: the flybook players' conference is held online; Wechat payment launched "education and training service toolbox"
- Vim 基本配置和经常使用的命令
- R language for text mining Part4 text classification
- SQL:存储过程和触发器~笔记
- Michael smashed the minority milk sign
- @GetMapping、@PostMapping 和 @RequestMapping详细区别附实战代码(全)
- 【力扣刷题】32. 最长有效括号
猜你喜欢

Efficiency tool +wps check box shows the solution to the sun problem

OneNote in-depth evaluation: using resources, plug-ins, templates

Chris LATTNER, the father of llvm: why should we rebuild AI infrastructure software
![[in depth learning] pytorch 1.12 was released, officially supporting Apple M1 chip GPU acceleration and repairing many bugs](/img/66/4d94ae24e99599891636013ed734c5.png)
[in depth learning] pytorch 1.12 was released, officially supporting Apple M1 chip GPU acceleration and repairing many bugs

PostgreSQL modifies the password of the database user

for循环中break与continue的区别——break-完全结束循环 & continue-终止本次循环

1292_ Implementation analysis of vtask resume() and xtask resume fromisr() in freeros
Why does MySQL index fail? When do I use indexes?

【Redis设计与实现】第一部分 :Redis数据结构和对象 总结

Four common ways and performance comparison of ArrayList de duplication (jmh performance analysis)
随机推荐
PostgreSQL install GIS plug-in create extension PostGIS_ topology
guava:Collections. The collection created by unmodifiablexxx is not immutable
After working for 5 years, this experience is left when you reach P7. You have helped your friends get 10 offers
Redistemplate common collection instructions opsforset (V)
MySQL - transaction details
1D convolution detail
1292_ Implementation analysis of vtask resume() and xtask resume fromisr() in freeros
KDD 2022 | realize unified conversational recommendation through knowledge enhanced prompt learning
[sliding window] group B of the 9th Landbridge cup provincial tournament: log statistics
numpy 下载安装
【力扣刷题】一维动态规划记录(53零钱兑换、300最长递增子序列、53最大子数组和)
PostgreSQL 安装gis插件 CREATE EXTENSION postgis_topology
Fzu 1686 dragon mystery repeated coverage
El table table - sortable sorting & disordered sorting when decimal and% appear
JS学习笔记-OO创建怀疑的对象
The underlying implementation of string
Caching strategies overview
039. (2.8) thoughts in the ward
ROS error: could not find a package configuration file provided by "move_base“
038. (2.7) less anxiety