当前位置:网站首页>Missing setjarbyclass() when running MapReduce task. No class found
Missing setjarbyclass() when running MapReduce task. No class found
2022-06-10 15:59:00 【QYHuiiQ】
The error message indicates that the class cannot be found , But intuitively , My customization Map Class is in , But it's still wrong :
[[email protected] word_count_jar]# hadoop jar test_word_count-1.0-SNAPSHOT.jar wyh.test.mapreduce.WordCountMain
22/05/27 07:34:08 INFO client.RMProxy: Connecting to ResourceManager at hadoop01/192.168.126.132:8032
22/05/27 07:34:09 WARN mapreduce.JobResourceUploader: No job jar file set. User classes may not be found. See Job or Job#setJar(String).
22/05/27 07:34:09 INFO input.FileInputFormat: Total input paths to process : 1
22/05/27 07:34:10 INFO mapreduce.JobSubmitter: number of splits:1
22/05/27 07:34:10 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1653650542989_0001
22/05/27 07:34:10 INFO mapred.YARNRunner: Job jar is not present. Not adding any jar to the list of resources.
22/05/27 07:34:11 INFO impl.YarnClientImpl: Submitted application application_1653650542989_0001
22/05/27 07:34:11 INFO mapreduce.Job: The url to track the job: http://hadoop01:8088/proxy/application_1653650542989_0001/
22/05/27 07:34:11 INFO mapreduce.Job: Running job: job_1653650542989_0001
22/05/27 07:34:24 INFO mapreduce.Job: Job job_1653650542989_0001 running in uber mode : false
22/05/27 07:34:24 INFO mapreduce.Job: map 0% reduce 0%
22/05/27 07:34:30 INFO mapreduce.Job: Task Id : attempt_1653650542989_0001_m_000000_0, Status : FAILED
Error: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class wyh.test.mapreduce.WordCountMapper not found
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2267)
at org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContextImpl.java:187)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:747)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1754)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Caused by: java.lang.ClassNotFoundException: Class wyh.test.mapreduce.WordCountMapper not found
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2171)
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2265)
... 8 more
The reason is my hadoop It's a cluster environment , And in the job I have not set the class to run in the main class , Add the following configuration :
job.setJarByClass(WordCountMain.class);
Run again , The report goes wrong .
边栏推荐
- 安霸CV2FS/CV22FS获得ASIL C芯片功能安全认证,超越市场同类芯片水平
- 2290. Minimum Obstacle Removal to Reach Corner
- [object].
- 广和通携手中国移动、惠普、联发科、英特尔合作打造5G全互联PC泛终端系列产品
- 探索数据可视化开发平台FlyFish开源背后的秘密!
- 【第14节 STL容器二】
- json.load(s)与json.dump(s)
- 百度开源ICE-BA安装运行总结
- Application scenario introduction of nixie tube driver chip + voice chip, wt588e02b-24ss
- Fast detection of short text repetition rate
猜你喜欢

SVM and ANN of OpenCV neural network library_ Use of MLP

硬件仪器的使用

Vins Theory and Code detail 4 - Initialization
![[untitled] audio Bluetooth voice chip, wt2605c-32n real-time recording upload technical scheme introduction](/img/13/9674d685dfa0b62d1d1fa5362a4c7e.png)
[untitled] audio Bluetooth voice chip, wt2605c-32n real-time recording upload technical scheme introduction

Distribution aware coordinate representation for human pose estimation
![2D human pose estimation with residual log likelihood estimation (RLE) [link only]](/img/c7/9c25da07236ef0bd241b6023e82306.gif)
2D human pose estimation with residual log likelihood estimation (RLE) [link only]

2290. Minimum Obstacle Removal to Reach Corner

ORB_ Slam2 visual inertial tight coupling positioning technology route and code explanation 2 - IMU initialization

点击解锁广和通5G模组“关键词”

MapReduce之Map阶段的join操作案例
随机推荐
数字化管理中台+低代码,JNPF开启企业数字化转型的新引擎
opencv神经网络库之SVM和ANN_MLP的使用
Aperçu en direct | déconstruire OLAP! Le nouveau paradigme de l'architecture d'analyse multidimensionnelle est entièrement ouvert! Apache Doris va apporter cinq gros problèmes!
2D human pose estimation with residual log likelihood estimation (RLE) [link only]
2D human posture estimation for posture estimation - numerical coordinate progression with revolutionary neural networks (dsnt)
“绽放杯”5G应用奖项大满贯!广和通多个联合项目荣获通用产品专题赛一、二、三等奖
Common QR decomposition, SVD decomposition and other matrix decomposition methods of visual slam to solve full rank and deficient rank least squares problems (analysis and summary of the most complete
[MySQL basics]
2D pose estimation for pose estimation - (openpose) realtime multi person 2D pose estimation using part affinity fields
torch. nn. utils. rnn. pad_ Detailed explanation of sequence() [pytoch getting started manual]
[object].
剑指 Offer 06. 从尾到头打印链表
Hessian matrix of convex function and Gauss Newton descent method
MapReduce之排序及序列化案例的代码实现
MapReduce之Map阶段的join操作案例
QT 基于QScrollArea的界面嵌套移动
The ultimate buff of smart grid - guanghetong module runs through the whole process of "generation, transmission, transformation, distribution and utilization"
排名前十、手续费低的期货公司有哪些?安全吗
Query-Convert QuickView是灰掉的解决办法(转)_SAP刘梦
Fast detection of short text repetition rate