hadoop3.1.1 完全分布式安裝 hive-3.1.1

1、環境介紹

涉及到軟件下載地址：https://pan.baidu.com/s/1hpcXUSJe85EsU9ara48MsQ

服務器：CentOS 6.8

JDK：jdk-8u191-linux-x64.tar.gz

hadoop：hadoop-3.1.1  

hadoop3.1.1 HA高可用分布式集群安裝部署：https://www.cnblogs.com/lufan2008/p/10312085.html

hbase：hbase-2.0.4

hbase-2.0.4 完全分布式安裝：https://www.cnblogs.com/lufan2008/p/10317322.html

hive：apache-hive-3.1.1-bin.tar.gz   其中：使用 mysql 作為 metastore

2、安裝hive

#解壓縮
tar -zxvf /usr/local/soft/apache-hive-3.1.1-bin.tar.gz -C /usr/local/

#修改目錄名稱
mv /usr/local/apache-hive-3.1.1-bin/ /usr/local/apache-hive-3.1.1

vim /etc/profile

#增加HIVE環境變量內容
export HIVE_HOME=/usr/local/apache-hive-3.1.1
export PATH=$PATH:$HIVE_HOME/bin
export CLASSPATH=$CLASSPATH:$HIVE_HOME/bin

使環境變量生效：source /etc/profile

vim /usr/local/apache-hive-3.1.1/conf/hive-env.sh

#增加內容
export HADOOP_HOME=/usr/local/hadoop-3.1.1
export HIVE_CONF_DIR=/usr/local/apache-hive-3.1.1/conf

vim /usr/local/apache-hive-3.1.1/conf/hive-site.xml

<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
    <property>
        <name>javax.jdo.option.ConnectionURL</name>
        <value>jdbc:mysql://192.168.67.1:3306/hadoop_hive_meta?allowMultiQueries=true&amp;useSSL=false&amp;verifyServerCertificate=false</value>
    </property>
    <property>
        <name>javax.jdo.option.ConnectionDriverName</name>
        <value>com.mysql.cj.jdbc.Driver</value>
    </property>
    <property>
        <name>javax.jdo.option.ConnectionUserName</name>
        <value>數據庫用戶名</value>
    </property>
    <property>
        <name>javax.jdo.option.ConnectionPassword</name>
        <value>數據庫密碼</value>
    </property>
    <property>
        <name>datanucleus.readOnlyDatastore</name>
        <value>false</value>
    </property>
    <property>
        <name>datanucleus.fixedDatastore</name>
        <value>false</value>
    </property>
    <property>
        <name>datanucleus.autoCreateSchema</name>
        <value>true</value>
    </property>
    <property>
        <name>datanucleus.autoCreateTables</name>
        <value>true</value>
    </property>
    <property>
        <name>datanucleus.autoCreateColumns</name>
        <value>true</value>
    </property>
</configuration>

#將下載好的 mysql 驅動拷貝到hive的lib目錄中
cp /usr/local/soft/mysql-connector-java-8.0.12.jar /usr/local/apache-hive-3.1.1/lib/

#在 mysql 服務器中新建空數據庫 hadoop_hive_meta，跟 hive-site.xml 中配置的數據庫名稱一致
#首次啟動初始化schema
schematool -dbType mysql -initSchema

3、驗證