Hive集成Tez


1.上傳tez.tar.gz至hdfs的/tez,隨后在本地目錄解壓

2.在hive的conf目錄下創建tez-site.xml

輸入:

<?xml version="1.0" encoding="UTF-8"?> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>tez.lib.uris</name>
<value>hdfs://ubuntu-00:9000/tez/apache-tez-0.9.1-bin.tar.gz</value>
</property>

<property>
<name>tez.use.cluster.hadoop-libs</name>
<value>true</value>
</property>

<property>
<name>tez.history.logging.service.class</name>
<value>org.apache.tez.dag.history.logging.impl.SimpleHistoryLoggingService</value>
</property>

</configuration>

 

3.vim hive-env.sh

#是你的 tez 的解壓目錄 
export TEZ_HOME=/opt/module/tez-0.9.1 
export TEZ_JARS=""
for jar in `ls $TEZ_HOME |grep jar`; 
do 
    export TEZ_JARS=$TEZ_JARS:$TEZ_HOME/$jar 
done 
for jar in `ls $TEZ_HOME/lib`;
do 
    export TEZ_JARS=$TEZ_JARS:$TEZ_HOME/lib/$jar 
done 
export HIVE_AUX_JARS_PATH=/your/hadoop/share/hadoop/common/hadoop-lzo.jar$TEZ_JARS

 

4.vim hive-site.xml

修改引擎

<property>
<name>hive.execution.engine</name>
<value>tez</value>
</property>

 

5. 測試

 

 完美


免責聲明!

本站轉載的文章為個人學習借鑒使用,本站對版權不負任何法律責任。如果侵犯了您的隱私權益,請聯系本站郵箱yoyou2525@163.com刪除。



 
粵ICP備18138465號   © 2018-2025 CODEPRJ.COM