hadoop、hbase、hive、zookeeper版本對應關系


本文引用自:http://www.aboutyun.com/blog-61-62.html

最新版本:

hadoop和hbase版本對應關系:

Hbase    Hadoop

0.92.0  1.0.0

0.92.1  1.0.0

0.92.2  1.0.0

0.94.0  1.0.2

0.94.1  1.0.3

0.94.2  1.0.3

0.94.3  1.0.4

0.94.4  1.0.4

0.94.5  1.0.4

0.94.9  1.2.0

0.95.0  1.2.0

Hadoop與hive版本對應關系

hive版本  1.1.0    支持hadoop版本

Hadoop 1.x.y 2.x.y

hive版本 1.0.0   支持hadoop版本

hadoop1.x.y,2.x.y

hive版本0.13.1    支持hadoop版本

hadoop0.20.x,0.23.x.y,1.x.y 2.x.y

hive版本0.13.0  支持hadoop版本

hadoop0.20.x,0.23.x.y,1.x.y,2.x.y

hive版本0.12.0      支持hadoop版本

hadoop0.20.x,0.23.x.y,1.x.y,2.x.y

hive版本0.11.0      支持hadoop版本

hadoop0.20.x,0.23.x.y,1.x.y,2.x.y

hive版本0.10.0  支持hadoop版本

hadoop 0.20.x,0.23.x.y,1.x.y,2.x.y

網址:http://hive.apache.org/downloads.html

補充一些內容:

hive、hbase、zookeeper的關系

 

分布式平台軟件選型(hadoop)
軟件名  最新版(高手) 穩定版三(推薦) 穩定版二(官方) 穩定版一(官方)
Hadoop  2.5.0 2.2.0 1.2.1 0.20.2
HBase 0.98.5  0.96.0 0.98.5 0.90.3
Zookeeper 3.4.6 3.4.5 3.4.6 3.3.3
Pig 0.13.0   0.13.0 0.9.0
Hive   0.13.1 0.12.0 0.13.1 0.7.1
sqoop 1.4.5 1.4.2    

                           說明:紅色為必選。建議采用最新版

hadoop1.2+hbase0.95.0+hive0.11.0會產生hbase+hive的不兼容,創建hive+hbase的關聯表就會報pair對異常。

hadoop1.2+hbase0.94.9+hive0.10.0沒問題,解決了上個版本的不兼容問題。

hadoop-1.0.3+hive-0.9.0+hive0.92.0兼容

hadoop2.2+hbase0.96+hive0.12兼容(有些小問題,可能需要一些補丁)

hadoop2.2+hbase0.96+hive0.13兼容(應該兼容)

 

Hadoop與hbase支持版本

 

S=支持並且測試

X=不支持

NT=應該可以,但是沒有測試

 


HBase-0.92.x
HBase-0.94.x HBase-0.96.x HBase-0.98.x[a] HBase-1.0.x[b]
Hadoop-0.20.205 S X X X X
Hadoop-0.22.x S X X X X
Hadoop-1.0.0-1.0.2[c] X X X X X
Hadoop-1.0.3+ S S S X X
Hadoop-1.1.x NT S S X X
Hadoop-0.23.x X S NT X X
Hadoop-2.0.x-alpha X NT X X X
Hadoop-2.1.0-beta X NT S X X
Hadoop-2.2.0 X NT [d] S S NT
Hadoop-2.3.x X NT S S NT
Hadoop-2.4.x X NT S S S
Hadoop-2.5.x X NT S S S

[a] Support for Hadoop 1.x is deprecated.

[b] Hadoop 1.x is NOT supported

[c] HBase requires hadoop 1.0.3 at a minimum; there is an issue where we cannot find KerberosUtil compiling against earlier versions of Hadoop.

[d] To get 0.94.x to run on hadoop 2.2.0, you need to change the hadoop 2 and protobuf versions in the pom.xml: Here is a diff with pom.xml changes:

$ svn diff pom.xml Index: pom.xml =================================================================== --- pom.xml (revision 1545157) +++ pom.xml (working copy) @@ -1034,7 +1034,7 @@ <slf4j.version>1.4.3</slf4j.version> <log4j.version>1.2.16</log4j.version> <mockito-all.version>1.8.5</mockito-all.version> - <protobuf.version>2.4.0a</protobuf.version> + <protobuf.version>2.5.0</protobuf.version> <stax-api.version>1.0.1</stax-api.version> <thrift.version>0.8.0</thrift.version> <zookeeper.version>3.4.5</zookeeper.version> @@ -2241,7 +2241,7 @@ </property> </activation> <properties> - <hadoop.version>2.0.0-alpha</hadoop.version> + <hadoop.version>2.2.0</hadoop.version> <slf4j.version>1.6.1</slf4j.version> </properties> <dependencies>

The next step is to regenerate Protobuf files and assuming that the Protobuf has been installed:

  • Go to the hbase root folder, using the command line;

  • Type the following commands:

    $ protoc -Isrc/main/protobuf --java_out=src/main/java src/main/protobuf/hbase.proto$ protoc -Isrc/main/protobuf --java_out=src/main/java src/main/protobuf/ErrorHandling.proto

Building against the hadoop 2 profile by running something like the following command:

$ mvn clean install assembly:single -Dhadoop.profile=2.0 -DskipTests
Replace the Hadoop Bundled With HBase!

Because HBase depends on Hadoop, it bundles an instance of the Hadoop jar under its lib directory. The bundled jar is ONLY for use in standalone mode. In distributed mode, it is critical that the version of Hadoop that is out on your cluster match what is under HBase. Replace the hadoop jar found in the HBase lib directory with the hadoop jar you are running on your cluster to avoid version mismatch issues. Make sure you replace the jar in HBase everywhere on your cluster. Hadoop version mismatch issues have various manifestations but often all looks like its hung up.

 

更新內容:

 

Hadoop version support matrix

·         "S" = supported

·         "X" = not supported

·         "NT" = Not tested

 

HBase-0.92.x

HBase-0.94.x

HBase-0.96.x

HBase-0.98.x (Support for Hadoop 1.1+ is deprecated.)

HBase-1.0.x (Hadoop 1.x is NOT supported)

Hadoop-0.20.205

S

X

X

X

X

Hadoop-0.22.x

S

X

X

X

X

Hadoop-1.0.x

X

X

X

X

X

Hadoop-1.1.x

NT

S

S

NT

X

Hadoop-0.23.x

X

S

NT

X

X

Hadoop-2.0.x-alpha

X

NT

X

X

X

Hadoop-2.1.0-beta

X

NT

S

X

X

Hadoop-2.2.0

X

NT

S

S

NT

Hadoop-2.3.x

X

NT

S

S

NT

Hadoop-2.4.x

X

NT

S

S

S

Hadoop-2.5.x

X

NT

S

S

S

 


免責聲明!

本站轉載的文章為個人學習借鑒使用,本站對版權不負任何法律責任。如果侵犯了您的隱私權益,請聯系本站郵箱yoyou2525@163.com刪除。



 
粵ICP備18138465號   © 2018-2025 CODEPRJ.COM