Topo check failed. Mapred tasks exceed 1000000000

Problem Description:
java.sql.SQLException: EXECUTION FAILED: Task MAPRED-SPARK error SparkException: [Error 1] Topo check failed. Mapred tasks exceed 1000000000

Root Cause:
數據量太大導致,需要設小reduce個數

Solution:
通過設置參數set mapred.reduce.tasks=xx;