当前位置:网站首页>Sparkcontext: error initializing sparkcontext solution
Sparkcontext: error initializing sparkcontext solution
2022-07-02 12:12:00 【Ostrich5yw】
SparkContext: Error initializing SparkContext resolvent
Spark In configuring a highly available cluster , There is an error ERROR SparkContext: Error initializing SparkContext. java.net.ConnectException: Call From hadoop102/192.168.10.102 to hadoop102:8020 failed on connection exception: java.net.ConnectException: Connection refused;
This is because we configured Spark Logs are stored in HDFS in , But it's opening Spark After cluster , But it didn't open Hadoop, Cause the task submission times to be wrong .
Solution :
- No longer store event logs
find Spark The installation directory /conf/spark-defaults.conf file , As shown in the figure , Comment out the corresponding event log section - Store the event log locally , Instead of HDFS in
Replace the directory in the second line in the above figure with Linux Local directory - start-up Hadoop colony ( namely HDFS service )
Investigate the cause of the error , Or we configured spark Log stored in HDFS in , But it didn't open HDFS, So open Hadoop Just cluster
边栏推荐
- 倍增 LCA(最近公共祖先)
- 深入理解P-R曲线、ROC与AUC
- LeetCode—剑指 Offer 51. 数组中的逆序对
- CDH存在隐患 : 该角色的进程使用的交换内存为xx兆字节。警告阈值:200字节
- mysql索引和事务
- 自然语言处理系列(二)——使用RNN搭建字符级语言模型
- Le tutoriel F - String le plus facile à comprendre de l'histoire.
- SCM power supply
- drools中then部分的写法
- Repeat, tile and repeat in pytorch_ The difference between interleave
猜你喜欢
Small guide for rapid formation of manipulator (VII): description method of position and posture of manipulator
Fresh, 2022 advanced Android interview must know 100 questions (interview questions + answer analysis)
Experiment of connecting mobile phone hotspot based on Arduino and esp8266 (successful)
二分刷题记录(洛谷题单)区间的甄别
xss-labs-master靶场环境搭建与1-6关解题思路
记录一下MySql update会锁定哪些范围的数据
Deep understanding of P-R curve, ROC and AUC
PyTorch搭建LSTM实现服装分类(FashionMNIST)
[C language] convert decimal numbers to binary numbers
CONDA common command summary
随机推荐
Leetcode739 每日温度
drools动态增加、修改、删除规则
H5,为页面添加遮罩层,实现类似于点击右上角在浏览器中打开
ThreadLocal的简单理解
Leetcode922 按奇偶排序数组 II
Sort---
Leetcode122 买卖股票的最佳时机 II
使用Sqoop把ADS层数据导出到MySQL
Seriation in R: How to Optimally Order Objects in a Data Matrice
基于Arduino和ESP8266的Blink代码运行成功(包含错误分析)
FastDateFormat为什么线程安全
深入理解PyTorch中的nn.Embedding
小程序链接生成
子线程获取Request
Sub thread get request
HR wonderful dividing line
WSL 2 will not be installed yet? It's enough to read this article
Le tutoriel F - String le plus facile à comprendre de l'histoire.
CDA data analysis -- common knowledge points induction of Excel data processing
LeetCode—剑指 Offer 51. 数组中的逆序对