Kubernetes 1.6.1 Kargo

參考文檔

Stone
Oo3p
老呂子

導入鏡像

因為使用的是容器啟動集群方式所以會拉取鏡像，這里准備了百度雲盤提供鏡像下載：百度雲

可以先在一台機器上導入所有鏡像，然后克隆即可。
導入鏡像到每台機器后，卸載docker：yum remove -y docker*

kargo會自動安裝docker-1.13.1。否則會出現很多問題。

主機准備

IP	HOSTNAME	NOTE
10.0.0.3	node1	python3 docker
10.0.0.4	node2	python3 docker
10.0.0.5	node3	python3 docker
10.0.0.6	node4	python3 docker
10.0.0.7	node5	python3 docker
10.0.0.8	ansible	python3 ansible

鏡像

REPOSITORY	TAG	IMAGE ID	CREATED	SIZE
busybox	latest	c75bebcdd211	5 days ago	1.11 MB
calico/cni	v1.7.0	61bd0f1d1acf	3 weeks ago	67 MB
calico/node	v1.1.3	573ddcad1ff5	3 weeks ago	217 MB
calico/ctl	v1.1.3	4cb99a60e023	3 weeks ago	44 MB
quay.io/coreos/hyperkube	v1.6.1_coreos.0	37378e671bfc	6 weeks ago	665 MB
quay.io/coreos/etcd	v3.0.17	169a91823cad	7 weeks ago	33.6 MB
gcr.io/google_containers/kubernetes-dashboard-amd64	v1.6.0	416701f962f2	2 months ago	109 MB
gcr.io/google_containers/nginx-ingress-controller	0.9.0-beta.3	383e5ec1f5f9	2 months ago	121 MB
gcr.io/google_containers/cluster-proportional-autoscaler-amd64	1.1.1	ff1e9c00bb46	2 months ago	48.2 MB
gcr.io/google_containers/heapster-grafana-amd64	v4.0.2	a1956d2a1a16	4 months ago	131 MB
gcr.io/google_containers/heapster-influxdb-amd64	v1.1.1	d3fccbedd180	4 months ago	11.6 MB
gcr.io/google_containers/heapster-amd64	v1.3.0-beta.1	4ff6ad0ca64c	4 months ago	101 MB
gcr.io/google_containers/fluentd-elasticsearch	1.22	7896bdf952bf	4 months ago	266 MB
gcr.io/google_containers/elasticsearch	v2.4.1	358e3f7fd81e	5 months ago	412 MB
gcr.io/google_containers/kubedns-amd64	1.7	26cf1ed9b144	6 months ago	47 MB
gcr.io/google_containers/kibana	v4.6.1	b65f0ed31993	6 months ago	237 MB
nginx	1.11.4-alpine	00bc1e841a8f	7 months ago	54.2 MB
gcr.io/google_containers/exechealthz-amd64	1.1	c3a89c92ef5b	9 months ago	8.33 MB
gcr.io/google_containers/kube-dnsmasq-amd64	1.3	9a15e39d0db8	11 months ago	5.13 MB
gcr.io/google_containers/pause-amd64	3.0	99e59f495ffa	12 months ago	747 kB
andyshinn/dnsmasq	2.72	37aabe06468e	18 months ago	6.27 MB
gcr.io/google_containers/defaultbackend	1.0	137a07dfd084	19 months ago	7.51 MB

環境准備

系統版本

1. [root@node1 ~]# cat /etc/redhat-release
2. CentOSLinux release 7.3.1611(Core)
3. [root@node1 ~]# uname -a
4. Linux node1 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
5. [root@ansible kargo]# cat /etc/resolv.conf // nameserver 不要超過2個，不然會報錯！
6. ; generated by/sbin/dhclient-script
7. search localdomain
8. nameserver 114.114.114.114
9. nameserver 223.5.5.5

軟件版本

SERVICE	VERSION
jinja2	2.9.6
docker	1.13.1
ansible	2.3.0.0
python	2.7.5

關閉防火牆

1. systemctl stop firewalld
2. systemctl disable firewalld
3. systemctl stop NetworkManager
4. systemctl disable NetworkManager
5. sed -i 's#^SELINUX\=enforcing#SELINUX\=disabled#g'/etc/selinux/config
6. setenforce 0

安裝python3

1. yum install -y epel-release
2. yum install -y python-pip python34 python-netaddr python34-pip python-devel git wget zip lrzsz net-tools cracklib-dicts-2.9.0-11.el7 libselinux-python device-mapper-libs python-httplib2 openssl rsync bash-completion socat unzip
3. pip3 install netaddr jinja2
4. pip3 install --upgrade Jinja2

安裝ansible

1. yum install -y python3-pip python-devel pcre pcre-devel gcc gcc-c++ openssl openssl-devel
2. pip install ansible==2.3.0

配置ssl

1. ssh-keygen -t rsa -N ""
2. ssh-copy-id -i <IP>

kargo配置

1. git clone https://github.com/wtli/kargo.git

准備playbooks配置

1. [root@ansible kargo]# cat inventory/group_vars/all.yml
2. # Valid bootstrap options (required): ubuntu, coreos, centos, none
3. bootstrap_os: centos
5. #Directory where etcd data stored
6. etcd_data_dir:/var/lib/etcd
8. # Directory where the binaries will be installed
9. bin_dir:/usr/local/bin

inventory.cfg 節點信息

1. [root@ansible kargo]# cat inventory/inventory.cfg
2. [all]
3. node1 ansible_user=root ansible_host=10.0.0.3 ip=10.0.0.3
4. node2 ansible_user=root ansible_host=10.0.0.4 ip=10.0.0.4
5. node3 ansible_user=root ansible_host=10.0.0.5 ip=10.0.0.5
6. node4 ansible_user=root ansible_host=10.0.0.6 ip=10.0.0.6
7. node5 ansible_user=root ansible_host=10.0.0.7 ip=10.0.0.7
9. [kube-master]
10. node1
11. node2
13. [kube-node]
14. node1
15. node2
16. node3
17. node4
18. node5
20. [etcd]
21. node1
22. node2
23. node3
25. [k8s-cluster:children]
26. kube-node
27. kube-master
29. [calico-rr]

執行安裝

1. cd kargo
2. CONFIG_FILE=inventory/inventory.cfg python3 contrib/inventory_builder/inventory.py 10.0.0.310.0.0.410.0.0.510.0.0.610.0.0.7
3. ansible-playbook -i inventory/inventory.cfg cluster.yml -b -v --private-key=~/.ssh/id_rsa

添加代理訪問kibana

1. kubectl proxy --address='10.0.0.3'--port=8086--accept-hosts='^*$'
2. 瀏覽器輸入：
3. http://10.0.0.3:8086/api/v1/proxy/namespaces/kube-system/services/kibana-logging