pyhive 連接 Hive 時錯誤

一、User: xx is not allowed to impersonate xxx'

解決辦法：修改 core-site.xml 文件，加入下面的內容后重啟 hadoop。

<property>
    <name>hadoop.proxyuser.xx.hosts</name>
    <value>*</value>
</property>

<property>
    <name>hadoop.proxyuser.xx.groups</name>
    <value>*</value>
</property>

Tips：注意是 xx 不是 xxx

二、ACCEPTED: waiting for AM container to be allocated, launched and register with RM.

現象為：

1. 查看 node 的健康狀態：http://master:8088/cluster/cluster ，無活躍 node
2. pyhive 執行 insert 命令卡住，一直處於 accept 狀態。
3. YarnApplicationState 為：ACCEPTED: waiting for AM container to be allocated, launched and register with RM.
4. slave yarn 日志為：Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 0 time(s); retry policy is...

解決辦法：

切記啟動 hdfs 后，要配置啟動 yarn。配置如下：

 <configuration>
    <property>  
        <name>yarn.resourcemanager.address</name>  
        <value>master:8032</value>  
    </property>  
    <property>  
        <name>yarn.resourcemanager.scheduler.address</name>  
        <value>master:8030</value>  
    </property>  
    <property>  
        <name>yarn.resourcemanager.resource-tracker.address</name>  
        <value>master:8031</value>  
    </property>
    <property>
        <name>yarn.nodemanager.aux-services</name>
        <value>mapreduce_shuffle</value>
    </property>
</configuration>