spark Error while running command to get file permissions

環境:win10 +hadoop2.7.1，服務器hadoop2.6.0+spark2.2.1+hive1.1.0

代碼：

import org.apache.spark.sql.Dataset;
import org.apache.spark.sql.Row;
import org.apache.spark.sql.SparkSession;
import org.apache.spark.sql.hive.HiveContext;

public class Dwd_rec_kqmj {


    public static void main(String[] args) {
      SparkSession spark = SparkSession
          .builder()
          .master("local[*]")
          .appName("Dwd_rec_kqmj")
          .enableHiveSupport()
          .config("spark.some.config.option", "some-value")
          .config("spark.serializer", "org.apache.spark.serializer.KryoSerializer")
          .getOrCreate();

      spark.sql("show tables").show();
        spark.stop();
}

 

問題：

 

Error while running command to get file permissions : 
java.io.IOException: (null) entry in command string: null ls -F E:\tmp\hive

 

 

看問題描述應該是文件權限問題

 

解決辦法：

    1.將winutils.exe和hadoop.dll放到C:\Windows\System32和本地$HADOOP_HOME/bin下

    2.創建c:\tmp\hive目錄

    3.在$HADOOP_HOME/bin執行winutils.exe chmod -R 777c:\tmp\hive