当前位置:网站首页>Sparkcontext: error initializing sparkcontext solution
Sparkcontext: error initializing sparkcontext solution
2022-07-02 12:12:00 【Ostrich5yw】
SparkContext: Error initializing SparkContext resolvent
Spark In configuring a highly available cluster , There is an error ERROR SparkContext: Error initializing SparkContext. java.net.ConnectException: Call From hadoop102/192.168.10.102 to hadoop102:8020 failed on connection exception: java.net.ConnectException: Connection refused;
This is because we configured Spark Logs are stored in HDFS in , But it's opening Spark After cluster , But it didn't open Hadoop, Cause the task submission times to be wrong .
Solution :
- No longer store event logs
find Spark The installation directory /conf/spark-defaults.conf file , As shown in the figure , Comment out the corresponding event log section - Store the event log locally , Instead of HDFS in
Replace the directory in the second line in the above figure with Linux Local directory - start-up Hadoop colony ( namely HDFS service )
Investigate the cause of the error , Or we configured spark Log stored in HDFS in , But it didn't open HDFS, So open Hadoop Just cluster
边栏推荐
- mysql索引和事务
- PyTorch搭建LSTM实现服装分类(FashionMNIST)
- Yygh-9-make an appointment to place an order
- 寻找二叉树中任意两个数的公共祖先
- Orb-slam2 data sharing and transmission between different threads
- Mysql database foundation
- conda常用命令汇总
- 堆(優先級隊列)
- 甜心教主:王心凌
- [old horse of industrial control] detailed explanation of Siemens PLC TCP protocol
猜你喜欢
Thesis translation: 2022_ PACDNN: A phase-aware composite deep neural network for speech enhancement
Deep understanding of NN in pytorch Embedding
jenkins 凭证管理
记录一下MySql update会锁定哪些范围的数据
mysql索引和事务
From scratch, develop a web office suite (3): mouse events
(C language) 3 small Codes: 1+2+3+ · · +100=? And judge whether a year is a leap year or a normal year? And calculate the circumference and area of the circle?
自然语言处理系列(一)——RNN基础
GGHIGHLIGHT: EASY WAY TO HIGHLIGHT A GGPLOT IN R
YYGH-BUG-04
随机推荐
Yygh-10-wechat payment
MySQL indexes and transactions
JZ63 股票的最大利润
Addition, deletion, modification and query of MySQL table (Advanced)
Lombok common annotations
计算二叉树的最大路径和
mysql数据库基础
drools决策表的简单使用
Log4j2
Leetcode14 longest public prefix
Map和Set
Natural language processing series (III) -- LSTM
SVO2系列之深度滤波DepthFilter
CONDA common command summary
Jenkins voucher management
5g era, learning audio and video development, a super hot audio and video advanced development and learning classic
conda常用命令汇总
Mish-撼动深度学习ReLU激活函数的新继任者
Post request body content cannot be retrieved repeatedly
Differences between nodes and sharding in ES cluster