当前位置:网站首页>Sparkcontext: error initializing sparkcontext solution
Sparkcontext: error initializing sparkcontext solution
2022-07-02 12:12:00 【Ostrich5yw】
SparkContext: Error initializing SparkContext resolvent
Spark In configuring a highly available cluster , There is an error ERROR SparkContext: Error initializing SparkContext. java.net.ConnectException: Call From hadoop102/192.168.10.102 to hadoop102:8020 failed on connection exception: java.net.ConnectException: Connection refused;
This is because we configured Spark Logs are stored in HDFS in , But it's opening Spark After cluster , But it didn't open Hadoop, Cause the task submission times to be wrong .
Solution :
- No longer store event logs
find Spark The installation directory /conf/spark-defaults.conf file , As shown in the figure , Comment out the corresponding event log section
- Store the event log locally , Instead of HDFS in
Replace the directory in the second line in the above figure with Linux Local directory - start-up Hadoop colony ( namely HDFS service )
Investigate the cause of the error , Or we configured spark Log stored in HDFS in , But it didn't open HDFS, So open Hadoop Just cluster
边栏推荐
猜你喜欢

mysql索引和事务

SVO2系列之深度滤波DepthFilter

GGPUBR: HOW TO ADD ADJUSTED P-VALUES TO A MULTI-PANEL GGPLOT

Natural language processing series (I) -- RNN Foundation

Discrimination of the interval of dichotomy question brushing record (Luogu question sheet)
![[geek challenge 2019] upload](/img/04/731323142161a4994c14fedae38b81.jpg)
[geek challenge 2019] upload

mysql数据库基础

甜心教主:王心凌

自然语言处理系列(一)——RNN基础

H5,为页面添加遮罩层,实现类似于点击右上角在浏览器中打开
随机推荐
[C language] Yang Hui triangle, customize the number of lines of the triangle
Applet link generation
ThreadLocal的简单理解
HR wonderful dividing line
drools中then部分的写法
XSS labs master shooting range environment construction and 1-6 problem solving ideas
GGPlot Examples Best Reference
[C language] convert decimal numbers to binary numbers
[geek challenge 2019] upload
史上最易懂的f-string教程,收藏這一篇就够了
计算二叉树的最大路径和
Test shift left and right
Jenkins用户权限管理
LeetCode—<动态规划专项>剑指 Offer 19、49、60
SVO2系列之深度滤波DepthFilter
Those logs in MySQL
高德地图测试用例
Log4j2
史上最易懂的f-string教程,收藏这一篇就够了
Full link voltage measurement