CentOS 7.0默認使用的是firewall作為防火牆
查看防火牆狀態
firewall-cmd --state
停止firewall
systemctl stop firewalld.service
禁止firewall開機啟動
systemctl disable firewalld.service
關閉selinux
進入到/etc/selinux/config文件
vi /etc/selinux/config
將SELINUX=enforcing改為SELINUX=disabled
配制免密登錄的命令
ssh-keygen -t rsa ssh-copy-id root@master
scp -P 22 /Users/che/Downloads/jdk-8u161-linux-x64.rpm root@192.168.1.100:/software/
安裝: yum install -y jdk-8u161-linux-x64.rpm
設置環境變量
cd /usr/java/
/usr/java/jdk1.8.0_161
vi /etc/profile
export JAVA_HOME=/usr/java/jdk1.8.0_161
export PATH=$JAVA_HOME/bin:$PATH
安裝hadoop
下載安裝包
hadoop-26.5.tar.gz
cd /usr/
mv /software/hadoop-2.6.5.tar.gz ./
解壓
tar -xzvf ./hadoop-2.6.5.tar.gz
創建目錄
namenode目錄:/data/hadoop/namenode
data目錄: /data/hadoop/data
tmp目錄: /data/hadoop/tmp
mkdir -p /data/hadoop/namenode
配制
core-site.xml
hdfs-site.xml
mapred-site.xml.template mapred-site.xml
cp mapred-site.xml.template mapred-site.xml
yarn-site.xml
slaves (slave1,slave2)
masters (master)
hadoop-env.sh
export JAVA_HOME=/usr/java/jdk1.8.0_161
將master的配制copy到slave1、slave2
scp -r ./* root@slave1:/software/hadoop-2.6.5/etc/hadoop/
格式化
cd hadoop-2.6.5/bin
./hdfs namenode -format
啟動
cd ../sbin/
./start-dfs.sh
ssh-copy-id root@master
jps(檢查一下)
./start-yarn.sh
cd ../bin
hadoop fs -ls /
hadoop fs -mkdir /user
/software/hadoop-2.6.5/bin
vi/etc/profile
export HADOOP_HOME=/software/hadoop-2.6.5
export PATH=$JAVA_HOME/bin:$HADOOP_HOME/bin:$PATH
source /etc/profile
hadoop fs -put /software/hadoop-2.6.5.tar.gz /user
測試2:
cd share/hadoop/mapreduce
hadoop jar ./hadoop-mapreduce-examples-2.6.5.jar pi 5 10
192.168.1.100:50070
192.168.1.100:8088
修改ssh端口
vim /etc/ssh/sshd_config
設置ntp時間同步服務
1、安裝ntp
yum install -y ntp
2、設置NTP服務開機啟動
chkconfig ntpd on
service nptd start
來源 https://blog.csdn.net/ytangdigl/article/details/79796961