Oozie調度hive報錯application application failed 2 times due to applicationmaster for attempt appattempt_ timed out. failing the application.

    <action name="xxx">
        <hive xmlns="uri:oozie:hive-action:0.5">
            <job-xml>${nameNode}/xxx/hive-site.xml</job-xml>
            <configuration>
                <property>
                    <name>oozie.launcher.mapreduce.map.java.opts</name>
                    <value>-XX:PermSize=512m -XX:MaxPermSize=512m</value>
                </property>
            </configuration>
            <script>xxxx.sql</script>
            <param>gn=${gn}</param>
            <param>dt=${dt}</param>
         </hive>
         <ok to="end"/>
         <error to="fail"/>
  </action>

 

    <action name="xxx">
        <hive xmlns="uri:oozie:hive-action:0.5">
            <job-xml>${nameNode}/xxxx/hive-site.xml</job-xml>

            <configuration>
            <property>
            <name>oozie.launcher.mapreduce.map.java.opts</name>
            <value>-XX:PermSize=512m -XX:MaxPermSize=512m</value>
            </property>
            <property>
            <name>oozie.launcher.mapreduce.map.memory.mb</name>
            <value>512</value>
            </property>
            <property>
            <name>oozie.launcher.mapreduce.reduce.memory.mb</name>
            <value>512</value>
            </property>
            </configuration>
            
            <script>${baseUri}/xxx.sql</script>

            <param>dt=${dt}</param>

         </hive>
         <ok to="xxx"/>
         <error to="failed-email"/>
    </action>

 

 

設置配置。

workflow編寫

    在workflow中配置以下兩個參數，用來降低Oozie launcher內存占用

1.  
   oozie.launcher.mapreduce.map.memory.mb 512 --減少給“hive2等”oozie.launcher作業分配的資源
2.  
    
3.  
   oozie.launcher.yarn.app.mapreduce.am.resource.mb 512 --減少oozie.launcher使用AppMaster資源的總內存大小。

 

報錯如下截圖 ：

 

 

Oozie調度優化與原理參考：

https://blog.csdn.net/godlovedaniel/article/details/106094675