docker安裝hadoop


  

  docker為hadoop的雲化帶來了極大便利,安裝和應用也會更快更方便.進入正題:

docker search hadoop

  將會看到如下結果:

INDEX       NAME                                       DESCRIPTION                                     STARS     OFFICIAL   AUTOMATED
docker.io   docker.io/sequenceiq/hadoop-docker         An easy way to try Hadoop                       301                  [OK]
docker.io   docker.io/sequenceiq/hadoop-ubuntu         An easy way to try Hadoop on Ubuntu             31                   [OK]
docker.io   docker.io/ruo91/hadoop                     Apache hadoop 2.x - Pseudo-Distributed Mode     11                   [OK]
docker.io   docker.io/uhopper/hadoop                   Base Hadoop image with dynamic configurati...   6                    [OK]
docker.io   docker.io/gelog/hadoop                     WORK IN PROGRESS. NOT PRODUCTION READY          4                    [OK]
docker.io   docker.io/uhopper/hadoop-resourcemanager   Hadoop resourcemanager                          3                    [OK]
docker.io   docker.io/dockmob/hadoop                   Docker images for Apache Hadoop (YARN, HDF...   2                    [OK]
docker.io   docker.io/lewuathe/hadoop-master           Multiple node hadoop cluster on Docker.         2                    [OK]
docker.io   docker.io/uhopper/hadoop-datanode          Hadoop datanode                                 2                    [OK]
docker.io   docker.io/uhopper/hadoop-namenode          Hadoop namenode                                 2                    [OK]
docker.io   docker.io/uhopper/hadoop-nodemanager       Hadoop nodemanager                              2                    [OK]
docker.io   docker.io/falkonry/hadoop                  Docker config for hadoop image                  1                    [OK]
docker.io   docker.io/ading1977/hadoop                 Docker image for multi-node hadoop cluster.     0                    [OK]

我們當然選擇星最多的.選擇第一個:

docker pull sequenceiq/hadoop-docker

然后等待下載.

下載完畢之后啟動docker鏡像:

docker run -it --name hadoop sequenceiq/hadoop-docker /etc/bootstrap.sh -bash

測試運行:

cd $HADOOP_PREFIX
# run the mapreduce
bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.0.jar grep input output 'dfs[a-z.]+'

# check the output
bin/hdfs dfs -cat output/*

我下載的時候最新的還是這個2.7版本.后來的小伙伴也不一定是2.7呦.可以進入share目錄去看一下提供的測試jar包是什么版本然后運行,然后查看輸出結果

 


免責聲明!

本站轉載的文章為個人學習借鑒使用,本站對版權不負任何法律責任。如果侵犯了您的隱私權益,請聯系本站郵箱yoyou2525@163.com刪除。



 
粵ICP備18138465號   © 2018-2025 CODEPRJ.COM