Ubuntu環境搭建Kubernetes集群

目錄

• 一 基於kubeadm搭建Kubernetes集群
  • 1 所有節點需要配置的操作
    • 1.1 關閉防火牆
    • 1.2 關閉selinux
    • 1.3 禁用swap
    • 1.4 修改主機名和/etc/hosts文件
    • 1.5 重啟主機
    • 1.6 開啟路由轉發
    • 1.7 設置倉庫為阿里雲倉庫
    • 1.8 配置Docker的阿里雲apt安裝源，並安裝
    • 1.9 在每個節點上安裝docker-ce-18.06.0並設置開機自啟動
    • 1.10 啟用bridge-nf-call-iptables和bridge-nf-call-ip6tables
    • 1.11 配置kubernetes的阿里雲apt安裝源
    • 1.12 在每個節點上安裝kubeadm，kubelet，kubectl並設置kubelet開機自啟動
  • 2 Master節點：
    • 2.1 導入kube-apiserver,kube-proxy等kubernetes1.12.1版本的docker鏡像
    • 2.2 初始化master
    • 2.3 Master節點配置root用戶管理集群
      • 2.3.1 使用root用戶運行kubernetes
      • 2.3.2 安裝flannel
      • 2.3.3 查看集群狀態
  • 3 Node節點：
    • 3.1 導入kube-proxy,pause和flannel，kubernetes1.12.1版本的docker鏡像
    • 3.2 加入master節點：
    • 3.3 在Master上查看集群狀態
  • 4 基於kubeadm搭建Kubernetes集群支持Swap分區

一 基於kubeadm搭建Kubernetes集群

1 所有節點需要配置的操作

1.1 關閉防火牆

# ufw disable

1.2 關閉selinux

## 某些ubuntu版本，沒有安裝selinux，則可以不用配置
# sed -i 's/enforcing/disabled/' /etc/selinux/config

1.3 禁用swap

# swapoff -a
# vim /etc/fstab
		# 將與swap有關的配置注釋，重啟系統即可

1.4 修改主機名和/etc/hosts文件

# hostnamectl set-hostname {k8s-m|k8s-node1|k8s-node2}
# vim /etc/hosts
10.120.10.190   k8s-m
10.120.10.191   k8s-node1
10.120.10.192   k8s-node2

1.5 重啟主機

# reboot

1.6 開啟路由轉發

# echo "net.ipv4.ip_forward = 1">>/etc/sysctl.conf
# sysctl -p

1.7 設置倉庫為阿里雲倉庫

# vim /etc/apt/sources.list
--------------------------------------------
# deb cdrom:[Ubuntu 16.04 LTS _Xenial Xerus_ - Release amd64 (20160420.1)]/ xenial main restricted
deb-src http://archive.ubuntu.com/ubuntu xenial main restricted 
#Added by software-properties
deb http://mirrors.aliyun.com/ubuntu/ xenial main restricted
deb-src http://mirrors.aliyun.com/ubuntu/ xenial main restricted multiverse universe 
#Added by software-properties
deb http://mirrors.aliyun.com/ubuntu/ xenial-updates main restricted
deb-src http://mirrors.aliyun.com/ubuntu/ xenial-updates main restricted multiverse universe 
#Added by software-properties
deb http://mirrors.aliyun.com/ubuntu/ xenial universe
deb http://mirrors.aliyun.com/ubuntu/ xenial-updates universe
deb http://mirrors.aliyun.com/ubuntu/ xenial multiverse
deb http://mirrors.aliyun.com/ubuntu/ xenial-updates multiverse
deb http://mirrors.aliyun.com/ubuntu/ xenial-backports main restricted universe multiverse
deb-src http://mirrors.aliyun.com/ubuntu/ xenial-backports main restricted universe multiverse 
#Added by software-properties
deb http://archive.canonical.com/ubuntu xenial partner
deb-src http://archive.canonical.com/ubuntu xenial partner
deb http://mirrors.aliyun.com/ubuntu/ xenial-security main restricted
deb-src http://mirrors.aliyun.com/ubuntu/ xenial-security main restricted multiverse universe 
#Added by software-properties
deb http://mirrors.aliyun.com/ubuntu/ xenial-security universe
deb http://mirrors.aliyun.com/ubuntu/ xenial-security multiverse

# apt update

1.8 配置Docker的阿里雲apt安裝源，並安裝

# apt-get -y install apt-transport-https ca-certificates curl software-properties-common
# curl -fsSL http://mirrors.aliyun.com/docker-ce/linux/ubuntu/gpg | sudo apt-key add -
# add-apt-repository "deb [arch=amd64] http://mirrors.aliyun.com/docker-ce/linux/ubuntu $(lsb_release -cs) stable"
# apt update

1.9 在每個節點上安裝docker-ce-18.06.0並設置開機自啟動

# apt-get install docker-ce=18.06.0~ce~3-0~ubuntu
# docker -v
# systemctl start docker
# systemctl enable docker
# systemctl status docker

1.10 啟用bridge-nf-call-iptables和bridge-nf-call-ip6tables

# echo 'net.bridge.bridge-nf-call-iptables = 1'>>/etc/sysctl.conf
# echo 'net.bridge.bridge-nf-call-ip6tables = 1'>>/etc/sysctl.conf
# sysctl -p

1.11 配置kubernetes的阿里雲apt安裝源

# curl https://mirrors.aliyun.com/kubernetes/apt/doc/apt-key.gpg | apt-key add -
# vim /etc/apt/sources.list.d/kubernetes.list
deb https://mirrors.aliyun.com/kubernetes/apt/ kubernetes-xenial main
# apt update

1.12 在每個節點上安裝kubeadm，kubelet，kubectl並設置kubelet開機自啟動

# apt install kubelet=1.12.1-00 kubeadm=1.12.1-00 kubectl=1.12.1-00
# kubeadm version
# systemctl enable kubelet

2 Master節點：

2.1 導入kube-apiserver,kube-proxy等kubernetes1.12.1版本的docker鏡像

## 鏡像請從共享服務器下載：(\\10.120.1.100\安裝軟件\Kubernetes-1.12.1\kubernetes-1.12.1鏡像\ "安裝集群所需鏡像")
# docker load < coredns.tar
# docker tag be0e8485fd78 k8s.gcr.io/coredns:1.2.2
# docker load < etcd-amd64.tar
# docker tag dcf9f4b0065d k8s.gcr.io/etcd:3.2.24
# docker load < pause.tar
# docker tag 97bc1dcec76a k8s.gcr.io/pause:3.1
# docker load < kube-apiserver-amd64.tar
# docker tag dcb029b5e3ad k8s.gcr.io/kube-apiserver:v1.12.1
# docker load < kube-controller-manager-amd64.tar
# docker tag aa2dd57c7329 k8s.gcr.io/kube-controller-manager:v1.12.1
# docker load < kube-proxy-amd64.tar
# docker tag 68987659c19a k8s.gcr.io/kube-proxy:v1.12.1
# docker load < kube-scheduler-amd64.tar
# docker tag af194c06e677 k8s.gcr.io/kube-scheduler:v1.12.1
# docker load < flannel.tar
# docker tag f0fad859c909 quay.io/coreos/flannel:v0.10.0-amd64

2.2 初始化master

# kubeadm init --kubernetes-version=1.12.1 --pod-network-cidr=10.244.0.0/16 --apiserver-advertise-address=10.120.10.190
## 上述步驟運行成功后，會輸出以下內容：

Your Kubernetes master has initialized successfully!

To start using your cluster, you need to run the following as a regular user:

  mkdir -p $HOME/.kube
  sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
  sudo chown $(id -u):$(id -g) $HOME/.kube/config

You should now deploy a pod network to the cluster.
Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
  https://kubernetes.io/docs/concepts/cluster-administration/addons/

You can now join any number of machines by running the following on each node
as root:

  kubeadm join 10.120.10.190:6443 --token d4557c.fh4vjxkiyoj2zt5y --discovery-token-ca-cert-hash sha256:b17d4618ab1149934f69582c727f58e53cd51f89dd9844fd3f7b776a0e3d389a

2.3 Master節點配置root用戶管理集群

2.3.1 使用root用戶運行kubernetes

# mkdir -p $HOME/.kube
# sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

2.3.2 安裝flannel

# kubectl apply -f https://raw.githubusercontent.com/coreos/flannel/master/Documentation/kube-flannel.yml

2.3.3 查看集群狀態

# kubectl get nodes

3 Node節點：

3.1 導入kube-proxy,pause和flannel，kubernetes1.12.1版本的docker鏡像

## 鏡像請從共享服務器下載：(\\10.120.1.100\安裝軟件\Kubernetes-1.12.1\kubernetes-1.12.1鏡像\ "安裝集群所需鏡像")
# docker load < kube-proxy-amd64.tar
# docker tag 68987659c19a k8s.gcr.io/kube-proxy:v1.12.1
# docker load < pause.tar
# docker tag 97bc1dcec76a k8s.gcr.io/pause:3.1
# docker load < flannel.tar
# docker tag f0fad859c909 quay.io/coreos/flannel:v0.10.0-amd64

3.2 加入master節點：

kubeadm join 10.120.10.190:6443 --token s5gi75.o950l49ripas5e0y --discovery-token-ca-cert-hash sha256:b17d4618ab1149934f69582c727f58e53cd51f89dd9844fd3f7b776a0e3d389a

3.3 在Master上查看集群狀態

# kubectl get nodes

4 基於kubeadm搭建Kubernetes集群支持Swap分區

• 其余安裝參照上面流程

特別注意流程，請參照下面介紹

• Master節點（新增/修改）：

# vim /etc/default/kubelet
KUBELET_EXTRA_ARGS="--fail-swap-on=false"
# kubeadm init --kubernetes-version=1.12.1 --pod-network-cidr=10.244.0.0/16 --apiserver-advertise-address=10.120.10.190 --ignore-preflight-errors=Swap

• Node節點（新增/修改）：

# vim /etc/default/kubelet
KUBELET_EXTRA_ARGS="--fail-swap-on=false"
# kubeadm join 10.120.10.190:6443 --token s5gi75.o950l49ripas5e0y --discovery-token-ca-cert-hash sha256:b17d4618ab1149934f69582c727f58e53cd51f89dd9844fd3f7b776a0e3d389a --ignore-preflight-errors=Swap