报错解决：org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.yarn.exceptions.InvalidResourceRequestE
发布时间：2022-11-08 14:31:52 563 相关标签： # less# yarn# webkit# apache
Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.yarn.exceptions.InvalidResourceRequestException): Invalid resource request! Cannot allocate containers as requested resource is greater than maximum allowed allocation. Requested resource type=[memory-mb], Requested resource=<memory:1536, vCores:1>, maximum allowed allocation=<memory:1024, vCores:2>, please note that maximum allowed allocation is calculated by scheduler based on maximum resource of registered NodeManagers, which might be less than configured maximum allocation=<memory:8192, vCores:4>
给NodeManager配置的内存是1024MB，而默认MapReduce作业所需的最小内存是1536，所以会报出“Invalid resource request! Cannot allocate containers as requested resource is greater than maximum allowed allocation.”的错误！
解决：设置任务的MapReduce作业所需的最小内存设置为1024M。
在 mapred-site.xml 配置文件中添加配置即可：
<property>
<name>yarn.app.mapreduce.am.resource.mb</name>
<value>1024</value>
</property>
<property>
<name>yarn.app.mapreduce.am.resource.cpu-vcores</name>
<value>1</value>
</property>
文章来源： https://blog.51cto.com/u_12564104/5825746
特别声明：以上内容（图片及文字）均为互联网收集或者用户上传发布，本站仅提供信息存储服务！如有侵权或有涉及法律问题请联系我们。
举报
