docker安装hadoop


  

  docker为hadoop的云化带来了极大便利,安装和应用也会更快更方便.进入正题:

docker search hadoop

  将会看到如下结果:

INDEX       NAME                                       DESCRIPTION                                     STARS     OFFICIAL   AUTOMATED
docker.io   docker.io/sequenceiq/hadoop-docker         An easy way to try Hadoop                       301                  [OK]
docker.io   docker.io/sequenceiq/hadoop-ubuntu         An easy way to try Hadoop on Ubuntu             31                   [OK]
docker.io   docker.io/ruo91/hadoop                     Apache hadoop 2.x - Pseudo-Distributed Mode     11                   [OK]
docker.io   docker.io/uhopper/hadoop                   Base Hadoop image with dynamic configurati...   6                    [OK]
docker.io   docker.io/gelog/hadoop                     WORK IN PROGRESS. NOT PRODUCTION READY          4                    [OK]
docker.io   docker.io/uhopper/hadoop-resourcemanager   Hadoop resourcemanager                          3                    [OK]
docker.io   docker.io/dockmob/hadoop                   Docker images for Apache Hadoop (YARN, HDF...   2                    [OK]
docker.io   docker.io/lewuathe/hadoop-master           Multiple node hadoop cluster on Docker.         2                    [OK]
docker.io   docker.io/uhopper/hadoop-datanode          Hadoop datanode                                 2                    [OK]
docker.io   docker.io/uhopper/hadoop-namenode          Hadoop namenode                                 2                    [OK]
docker.io   docker.io/uhopper/hadoop-nodemanager       Hadoop nodemanager                              2                    [OK]
docker.io   docker.io/falkonry/hadoop                  Docker config for hadoop image                  1                    [OK]
docker.io   docker.io/ading1977/hadoop                 Docker image for multi-node hadoop cluster.     0                    [OK]

我们当然选择星最多的.选择第一个:

docker pull sequenceiq/hadoop-docker

然后等待下载.

下载完毕之后启动docker镜像:

docker run -it --name hadoop sequenceiq/hadoop-docker /etc/bootstrap.sh -bash

测试运行:

cd $HADOOP_PREFIX
# run the mapreduce
bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.0.jar grep input output 'dfs[a-z.]+'

# check the output
bin/hdfs dfs -cat output/*

我下载的时候最新的还是这个2.7版本.后来的小伙伴也不一定是2.7呦.可以进入share目录去看一下提供的测试jar包是什么版本然后运行,然后查看输出结果

 


免责声明!

本站转载的文章为个人学习借鉴使用,本站对版权不负任何法律责任。如果侵犯了您的隐私权益,请联系本站邮箱yoyou2525@163.com删除。



 
粤ICP备18138465号  © 2018-2025 CODEPRJ.COM