centos上安裝Kubernetes和docker

整理資料時，無意發現早期安裝kubernetes和docker的記錄，常言說得好，好記性不如爛筆頭。

注：由於kubernetes一直更新，故我的筆記未必適用新版kubernetes

軟件組件的版本如下：

etcd : 2.3.7

flannel : 0.5.3
Kubernetes: 1.2.0
docker : 1.10.3

1. 安裝centos7操作系統（略，自行搜索），手工配置ip（vi /etc/sysconfig/network-scripts/ifcfg-ens33），保證聯網的情況下執行

   yum -y install net-tools
   
   

2.  環境配置 

              2.1  關閉防火牆

                    

# systemctl stop firewalld.service    #停止firewall
# systemctl disable firewalld.service #禁止firewall開機啟動

              2.2  安裝NTP並確保正常運行

                  

 # yum -y install ntp
  
 # systemctl start ntpd
 
 # systemctl enable ntpd

               2.3 安裝iptables（可選）

      

# yum install -y iptables-services     #安裝
# systemctl start iptables.service  #最后重啟防火牆使配置生效
# systemctl enable iptables.service #設置防火牆開機啟動 

 

           3.  master安裝配置（先安裝yum install libdevmapper* -y）

             

 root@localhost ~]# cd /usr/lib64/
[root@localhost lib64]# rm -rf libgudev-1.0.so.0
[root@localhost lib64]# rm -rf libgudev-1.0.so.0.2.0
[root@localhost lib64]# ln -s  libgudev-1.0.so.0.1.3(需要上傳) libgudev-1.0.so.0
[root@localhost lib64]# systemctl start NetworkManager.service

　　3.1  安裝並配置Kubernetes master(yum 方式)

             

# yum -y install etcd flannel kubernetes

　　

3.1.1 修改配置文件/etc/etcd/etcd.conf,確保etcd監聽所有地址
# vi /etc/etcd/etcd.conf
# [member]
ETCD_NAME=default
ETCD_DATA_DIR="/var/lib/etcd/default.etcd"
ETCD_LISTEN_CLIENT_URLS="http://0.0.0.0:2379"
#[cluster]
ETCD_ADVERTISE_CLIENT_URLS="http://localhost:2379"

3.1.2 修改配置文件/etc/kubernetes/apiserver
KUBE_API_ADDRESS="--address=0.0.0.0"

KUBE_API_PORT="--port=8080"

KUBELET_PORT="--kubelet_port=10250"

KUBE_ETCD_SERVERS="--etcd_servers=http://127.0.0.1:2379"

KUBE_SERVICE_ADDRESSES="--portal_net=10.254.0.0/16"

KUBE_ADMISSION_CONTROL="--admission-control=NamespaceLifecycle,NamespaceExists,LimitRanger,SecurityContextDeny,ServiceAccount（可選）,ResourceQuota"

#KUBE_ADMISSION_CONTROL="--admission_control=NamespaceAutoProvision,LimitRanger,ResourceQuota"

KUBE_API_ARGS=""
3.1.3 修改配置文件/etc/kubernetes/controller-manager，定義minions ip地址（可選）
KUBELET_ADDRESSES="--machines=172.16.200.130，172.16.200.131，172.16.200.132"

3.1.4 啟動服務

for SERVICES in etcd flanneld kube-apiserver kube-controller-manager kube-scheduler; do

systemctl restart $SERVICES

systemctl enable $SERVICES

systemctl status $SERVICES

done

3.1.5 定義flannel網絡配置到etcd,這個配置會推送到各個minions的flannel服務上

etcdctl mk /atomic.io/network/config '{"Network":"172.17.0.0/16"}'

 

3.2 安裝Kubernetes Minions (Nodes先安裝yum install libdevmapper* -y)
root@localhost ~]# cd /usr/lib64/
[root@localhost lib64]# rm -rf libgudev-1.0.so.0
[root@localhost lib64]# rm -rf libgudev-1.0.so.0.2.0
[root@localhost lib64]# ln -s libgudev-1.0.so.0.1.3(需要上傳) libgudev-1.0.so.0
[root@localhost lib64]# systemctl start NetworkManager.service

vi /etc/selinux/config
#SELINUX=enforcing
SELINUX=disabled

3.2.1 安裝flannel和kubernetes
yum -y install flannel kubernetes

3.2.2 為etcd服務配置flannel，修改配置文件 /etc/sysconfig/flanneld

FLANNEL_ETCD="http://172.16.200.129:2379"（172.16.200.129為master ip）

3.2.3 修改kubernetes配置文件，指定master /etc/kubernetes/config

KUBE_MASTER="--master=http://172.16.200.129:8080" （172.16.200.129為master ip）

3.2.4 配置kubelet服務。/etc/kubernetes/kubelet

minions1:

###
KUBELET_ADDRESS="--address=0.0.0.0"
KUBELET_PORT="--port=10250"
KUBELET_HOSTNAME="--hostname_override=172.16.200.130"（minion ip）
KUBELET_API_SERVER="--api_servers=http://172.16.200.129:8080" （172.16.200.129為master ip）
KUBELET_ARGS=""

3.2.5 啟動kube-proxy, kubelet, docker 和 flanneld services服務，並設置開機自啟
# for SERVICES in kube-proxy kubelet docker flanneld; do
systemctl restart $SERVICES
systemctl enable $SERVICES
systemctl status $SERVICES
done

4.  測試，執行部分命令

      kubectl -s 172.16.200.129:8080 version
      kubectl -s 172.16.200.129:8080 create -f tomcat.yaml
      kubectl -s 172.16.200.129:8080 describe rc  tomcat
      kubectl -s 172.16.200.129:8080 describe pod tomcat
      kubectl -s 172.16.200.129:8080 get nodes
      kubectl -s 172.16.200.129:8080 get namespace
      kubectl -s 172.16.200.129:8080 get pod -o wide
      kubectl -s 172.16.200.129:8080 get rc -o wide
      kubectl -s 172.16.200.129:8080 get svc -o wide
      kubectl -s 172.16.200.129:8080 get ep -o wide
      
      kubectl -s 172.16.200.129:8080 describe rc dongguangming  --namespace=kube-system
      kubectl -s 172.16.200.129:8080 describe pod  dongguangming  --namespace=kube-system

      POD_IP=`kubectl -s 172.16.200.129:8080 get ep tomcat -o jsonpath={.subsets[*].addresses[*].ip}`
      echo $POD_IP
      curl $POD_IP:8080
      
      kubectl -s http://172.16.200.129:8080 describe pod nginx-rc 2>/dev/null | grep Node
      kubectl -s http://172.16.200.129:8080 describe service nginx-rc 2>/dev/null | grep NodePort

 

 

5.  參考文獻：

http://www.cnblogs.com/ilinuxer/p/5866915.html
http://www.ailab.cn/article/2015082028904.html（*******）
http://www.open-open.com/lib/view/open1417658852542.html
非常好：http://www.sunmite.com/linux/installing-kubernetes-cluster-on-centos7-to-manage-pods-and-services/（******************）
http://www.bubuko.com/infodetail-1305310.html（******）
http://blog.csdn.net/felix_yujing/article/details/51621866
http://netmark.jp/2014/12/kubernetes-flannel-centos7-4.html
http://severalnines.com/blog/installing-kubernetes-cluster-minions-centos7-manage-pods-services
http://containertutorials.com/get_started_kubernetes/k8s_example.html
http://www.yesodweb.com/blog/2015/12/yesod-hosting-docker-kubernetes
https://coreos.com/kubernetes/docs/latest/deploy-workers.html
http://www.dasblinkenlichten.com/kubernetes-101-networking/
http://www.yongbok.net/blog/google-kubernetes-container-cluster-manager/
http://zh.hortonworks.com/blog/docker-kubernetes-apache-hadoop-yarn/
http://www.csdn.net/article/2015-06-12/2824937(Kubernetes應用部署模型解析（部署篇）)
http://blog.coocla.org/kubernetes-container-monitor.html(Kubernetes技術研究容器監控監測)
http://tonybai.com/2016/11/17/nginx-config-hot-reloading-approach-for-kubernetes-cluster/ (Kubernetes集群中的Nginx配置熱更新方案)
https://segmentfault.com/a/1190000002886795(gcr.io/google_containers/pause問題)
http://blog.csdn.net/horsefoot/article/details/52221154(Kubernetes1.3新特性：POD中的初始化容器)
http://news.tuxi.com.cn/news/119999990123105/31054202.html
https://severalnines.com/blog/installing-kubernetes-cluster-minions-centos7-manage-pods-services
https://keithtenzer.com/2015/04/15/containers-at-scale-with-kubernetes-on-openstack/
http://blog.csdn.net/xinghun_4/article/details/50492041(kubernetes中port、target port、node port的對比分析，以及kube-proxy代理)