10、linux上安裝hive


1.基本信息
版本 1.2.1
安裝機器 三台機器
賬號 hadoop
源路徑 /opt/software/apache-hive-1.2.1-bin.tar.gz
目標路徑 /opt/hive -> opt/apache-hive-1.2.1-bin/
依賴關系 mysql
2.安裝過程

1).登陸172.24.5.173,並登陸mysql,創建hive元數據庫及hive用戶,並設置字符集為latin1:

[root @bgs -5p173-wangwenting ~]#  mysql -u root -p
mysql>create database hive_metastore;
mysql>GRANT ALL PRIVILEGES ON hive_metastore.* TO  'hive' @ '%'  IDENTIFIED BY  'hive' ;
mysql>GRANT ALL PRIVILEGES ON hive_metastore.* TO  'hive' @bgs -5p173-wangwenting IDENTIFIED BY  'hive' ;
mysql>flush privileges;
mysql>alter database hive_metastore character set latin1;

2).創建hadoop目錄,並修改權限:

[root @bgs -5p173-wangwenting ~]# su - hadoop
[hadoop @bgs -5p173-wangwenting ~]$ hadoop fs -mkdir -p /user/hive/warehouse
[hadoop @bgs -5p173-wangwenting ~]$ hadoop fs -chmod  777  /tmp
[hadoop @bgs -5p173-wangwenting ~]$ hadoop fs -chmod  777  /user/hive/warehouse

3).將apache-hive-${version}-bin.tar.gz通過tar -zxvf命令解壓縮至目的安裝目錄,並設置軟連接:

[hadoop @bgs -5p173-wangwenting ~]$ cd /opt/software
[hadoop @bgs -5p173-wangwenting software]$ tar -zxvf apache-hive-${version}-bin.tar.gz -C /opt
[hadoop @bgs -5p173-wangwenting software]$ cd /opt
[hadoop @bgs -5p173-wangwenting opt]$ ln -s /opt/apache-hive-${version}-bin   /opt/hive

4).刪除hadoop目錄中的jline-0.9.94.jar,防止jar沖突(若存在):

[hadoop @bgs -5p173-wangwenting hive]$  rm -r /opt/hadoop/share/hadoop/yarn/lib/jline- 0.9 . 94 .jar
在/opt/hadoop/hive/conf目錄下添加hive-site.xml,並修改hive-site.xml配置文件:
[hadoop @bgs -5p173-wangwenting hive]$ cd /opt/hive/conf
[hadoop @bgs -5p173-wangwenting conf]$ cp hive- default .xml.template hive-site.xml
[hadoop @bgs -5p173-wangwenting conf]$ vim hive-site.xml
添加下面內容:(可以將里面的內容全部刪除只添加以下內容,我的是追加的形式,不過要修改里面的配置內容。${system-user.name}的值改為hive,${java.io.tmpdir }改為/tmp)
<configuration>
  <property>
  <name>javax.jdo.option.ConnectionURL</name>
  <value>jdbc:mysql: //bgs-5p173-wangwenting:3306/hive_metastore?createDatabaseIfNotExist=true</value>
  </property>
  <property>
  <name>javax.jdo.option.ConnectionDriverName</name>
  <value>com.mysql.jdbc.Driver</value>
  </property>
  <property>
  <name>javax.jdo.option.ConnectionUserName</name>
  <value>hive</value>
  </property>
  <property>
  <name>javax.jdo.option.ConnectionPassword</name>
  <value>hive</value>
  </property>
  <property>
  <name>hive.metastore.warehouse.dir</name>
  <value>/user/hive/warehouse</value>
  </property>
  <property>
  <name>hive.querylog.location</name>
  <value>/tmp/hive</value>
  </property>
  <property>
  <name>hive.server2.logging.operation.log.location</name>
  <value>/tmp/hive/operation_logs</value>
  </property>
  <property>
  <name>hive.exec.scratchdir</name>
  <value>/tmp/hive</value>
  </property>
</configuration>

6).確保啟動hadoop集群的情況下,切換到hadoop賬戶

[hadoop @bgs -5p173-wangwenting conf]$ nohup /opt/hive/bin/hive &

7).啟動hiveserver2:

[hadoop @bgs -5p173-wangwenting conf]$ nohup /opt/hive/bin/hive --service hiveserver2 &

使用beeline工具連接到thrift server

[hadoop @bgs -5p173-wangwenting conf]$ /opt/hive/bin/beeline -u jdbc:hive2: //bgs-5p173-wangwenting:10000

如果連接失敗需要拷貝一個jar包到lib目錄下mysql-connector-java-5.1.35-bin.jar

8).測試hive基本命令是否正常運行:

hive> create table test(a  int );
OK
Time taken:  0.55  seconds
hive> show tables;
OK
Test
Time taken:  0.031  seconds, Fetched:  1  row(s)
hive> desc test;
OK
a                        int                                        
Time taken:  0.157  seconds, Fetched:  1  row(s)
hive> select a from test;
OK
Time taken:  0.14  seconds
hive> drop table test;
OK
Time taken:  0.671  seconds
hive> show tables;
OK
Time taken:  0.032  seconds

 

如果測試同上,則說明hive安裝成功,能夠正常運行。

如果報錯,需要修改conf目錄下的hive-site.xml文件,將${system:user.name} 換成hive即可 

 


免責聲明!

本站轉載的文章為個人學習借鑒使用,本站對版權不負任何法律責任。如果侵犯了您的隱私權益,請聯系本站郵箱yoyou2525@163.com刪除。



 
粵ICP備18138465號   © 2018-2025 CODEPRJ.COM