報錯：Sqoop Failing this attempt. Failing the application.

報錯背景

sqoop將HBase的數據導入到HDFS

報錯現象

 

20/10/29 17:17:48 INFO mapreduce.Job: Running job: job_1603962187772_0001
20/10/29 17:17:53 INFO mapreduce.Job: Job job_1603962187772_0001 running in uber mode : false
20/10/29 17:17:53 INFO mapreduce.Job:  map 0% reduce 0%
20/10/29 17:17:53 INFO mapreduce.Job: Job job_1603962187772_0001 failed with state FAILED due to: Application application_1603962187772_0001 failed 2 times due to AM Container for appattempt_1603962187772_0001_000002 exited with  exitCode: 1
For more detailed output, check application tracking page:http://basecoalmine:8088/cluster/app/application_1603962187772_0001Then, click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_e08_1603962187772_0001_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1: 
    at org.apache.hadoop.util.Shell.runCommand(Shell.java:585)
    at org.apache.hadoop.util.Shell.run(Shell.java:482)
    at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:776)
    at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
    at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
    at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)


Container exited with a non-zero exit code 1
Failing this attempt. Failing the application.
20/10/29 17:17:53 INFO mapreduce.Job: Counters: 0
20/10/29 17:17:53 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
20/10/29 17:17:53 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 19.4517 seconds (0 bytes/sec)
20/10/29 17:17:53 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
20/10/29 17:17:53 INFO mapreduce.ImportJobBase: Retrieved 0 records.
20/10/29 17:17:53 ERROR tool.ImportTool: Error during import: Import job failed!

報錯原因

不知

報錯解決

修改 mapred-site.xml

  <property>
    <name>vix.mapreduce.framework.name</name>
    <value>yarn</value>
  </property>

修改 yarn-site.xml

    <property>
        <name>vix.yarn.resourcemanager.address</name>
        <value>basecoalmine:18040</value>
    </property>
    <property>
        <name>vix.yarn.resourcemanager.scheduler.address</name>
        <value>basecoalmine:1800</value>
    </property>