ClouderaManager啟動NodeManager失敗!報錯Failed to initialize container executor


報錯信息:

2016-07-27 10:53:14,102 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container exec

utor initialization is : 24

ExitCodeException exitCode=24: Invalid configuration provided in /etc/hadoop/conf.cloudera.yarn/container-executor.cfg

 

        at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)

        at org.apache.hadoop.util.Shell.run(Shell.java:455)

        at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)

        at org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor.init(LinuxContainerExecutor.java:181)

        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:209)

        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)

        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:462)

        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:509)

2016-07-27 10:53:14,111 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor:

2016-07-27 10:53:14,111 INFO org.apache.hadoop.service.AbstractService: Service NodeManager failed in state INITED; cause: o

rg.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to initialize container executor

org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to initialize container executor

        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:211)

        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)

        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:462)

        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:509)

Caused by: java.io.IOException: Linux container executor not configured properly (error=24)

        at org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor.init(LinuxContainerExecutor.java:187)

        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:209)

        ... 3 more

Caused by: ExitCodeException exitCode=24: Invalid configuration provided in /etc/hadoop/conf.cloudera.yarn/container-executo

r.cfg

 

解決辦法:

  看到ClouderaManager啟動NodeManager失敗,讀取的配置文件是/etc/hadoop/conf.cloudera.yarn/container-executor.cfg,這個文件為空。

參考/module/cloudera/parcels/CDH-5.4.0-1.cdh5.4.0.p0.27/etc/hadoop/conf.empty/container-executor.cfg配置文件,將對應信息寫入到/etc/hadoop/conf.cloudera.yarn/container-executor.cfg文件中,問題解決。

echo "yarn.nodemanager.linux-container-executor.group=yarn" > /etc/hadoop/conf.cloudera.yarn/container-executor.cfg

 

還沒有發現副作用,發現再更新。

 

【參考】http://blog.csdn.net/yangzongzhao/article/details/41867793


免責聲明!

本站轉載的文章為個人學習借鑒使用,本站對版權不負任何法律責任。如果侵犯了您的隱私權益,請聯系本站郵箱yoyou2525@163.com刪除。



 
粵ICP備18138465號   © 2018-2025 CODEPRJ.COM