有個算法如下:
SELECT MEMBERNUMBER, ROUND(SUM(SumPointAmount)) AS VALUE FROM BSUM_CRMPOINT WHERE UPPER(POINTCATEGORY)='REWARD' GROUP BY MEMBERNUMBER
使用round()函數來規范Sum()后的值..
算法並不復雜..但一直報錯..
MapReduce Total cumulative CPU time: 1 minutes 16 seconds 968 msec Ended Job = job_1483628918349_2920 with errors Error during job, obtaining debugging information... Examining task ID: task_1483628918349_2920_m_000002 (and more) from job job_1483628918349_2920 Task with the most failures(4): ----- Task ID: task_1483628918349_2920_m_000000 URL: http://headnodehost:9014/taskdetails.jsp?jobid=job_1483628918349_2920&tipid=task_1483628918349_2920_m_000000 ----- Diagnostic Messages for this Task: Error: GC overhead limit exceeded Container killed by the ApplicationMaster. Container killed on request. Exit code is 137 Container exited with a non-zero exit code 137 FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask MapReduce Jobs Launched: Stage-Stage-1: Map: 3 Reduce: 8 Cumulative CPU: 76.968 sec HDFS Read: 1547020 HDFS Write: 0 FAIL Total MapReduce CPU Time Spent: 1 minutes 16 seconds 968 msec
並沒有具體錯誤的報文.. ExitValue 為 2
后來偶然把Round去掉..跑通了..返回碼0
百思不得其解..
有路過大神希望能解釋下..
有同樣算法的童鞋請嘗試去除round再試..找到原因請分享..
