cdh的hue上oozie启动报错,Cannot allocate containers as requested resource is greater than maximum allowed

Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.yarn.exceptions.InvalidResourceRequestException): Invalid resource request! Cannot allocate containers as requested resource is greater than maximum allowed allocation. Requested resource type=[memory-mb], Requested resource=<memory:2048, vCores:1>, maximum allowed allocation=<memory:1213, vCores:4>, please note that maximum allowed allocation is calculated by scheduler based on maximum resource of registered NodeManagers, which might be less than configured maximum allocation=<memory:1213, vCores:4>

原因是，oozie启动资源默认，需要2GB

有2种方法

1.修改yarn资源调度的内存

2.修改oozie的默认值

这里我们修改oozie的默认值，将原来的2G改成了500MB

 成功，没有报那个错误了

No Notification URL is defined. Therefore nothing to notify

 我感觉很狗屁，于是我加大oozie的资源为2G，然后把yarn容器资源调成2.5G(在oozie和yarn的配置中）

oozie:

Default Launcher Memory

2G

yarn:

yarn.nodemanager.resource.memory-mb

2G

yarn.scheduler.maximum-allocation-mb

2.5G

网上说是正常的，在hue中是看不到原因。需要获取他的外部地址，去oozie页面看

http://hadoop1:11000/oozie/

跳转进hadoop，看日志

 

No child hadoop job is executed.

这是一个日志，相当于没有日志，只要是出错了，都会导致这种情况。

但是，上面的strErr说

 

Error: Error while compiling statement: FAILED: ParseException line 1:62 mismatched input '-' expecting ) near '2022' in add partition statement (state=42000,code=40000)

发现了问题，是我的sql问题，我分区的sql是yyyyMMdd，但是我传过去的动态时间是，用的oozie自带的

所以就没有办法格式化，于是我改成了他 

 成功了

 

参考这篇：oozie调度sqoop踩坑之路（hue配置）_深寒色的猫丶的博客-CSDN博客_oozie调度sqoop