当前位置:网站首页>Sparkcontext: error initializing sparkcontext solution
Sparkcontext: error initializing sparkcontext solution
2022-07-02 12:12:00 【Ostrich5yw】
SparkContext: Error initializing SparkContext resolvent
Spark In configuring a highly available cluster , There is an error ERROR SparkContext: Error initializing SparkContext. java.net.ConnectException: Call From hadoop102/192.168.10.102 to hadoop102:8020 failed on connection exception: java.net.ConnectException: Connection refused;
This is because we configured Spark Logs are stored in HDFS in , But it's opening Spark After cluster , But it didn't open Hadoop, Cause the task submission times to be wrong .
Solution :
- No longer store event logs
find Spark The installation directory /conf/spark-defaults.conf file , As shown in the figure , Comment out the corresponding event log section
- Store the event log locally , Instead of HDFS in
Replace the directory in the second line in the above figure with Linux Local directory - start-up Hadoop colony ( namely HDFS service )
Investigate the cause of the error , Or we configured spark Log stored in HDFS in , But it didn't open HDFS, So open Hadoop Just cluster
边栏推荐
猜你喜欢

PyTorch nn. Full analysis of RNN parameters

Larvel modify table fields

Tas (file d'attente prioritaire)

kubenetes中port、targetPort、nodePort、containerPort的区别与联系

mysql数据库基础

GGPlot Examples Best Reference

MSI announced that its motherboard products will cancel all paper accessories

甜心教主:王心凌

自然语言处理系列(一)——RNN基础

Deep understanding of NN in pytorch Embedding
随机推荐
GGPUBR: HOW TO ADD ADJUSTED P-VALUES TO A MULTI-PANEL GGPLOT
drools决策表的简单使用
[untitled] how to mount a hard disk in armbian
Log4j2
drools执行String规则或执行某个规则文件
使用Sqoop把ADS层数据导出到MySQL
史上最易懂的f-string教程,收藏这一篇就够了
mysql数据库基础
测试左移和右移
5g era, learning audio and video development, a super hot audio and video advanced development and learning classic
自然语言处理系列(三)——LSTM
Small guide for rapid formation of manipulator (VII): description method of position and posture of manipulator
Log4j2
Tas (file d'attente prioritaire)
计算二叉树的最大路径和
LeetCode—剑指 Offer 37、38
(C语言)八进制转换十进制
小程序链接生成
Jenkins用户权限管理
(C语言)输入一行字符,分别统计出其中英文字母、空格、数字和其它字符的个数。