在CentOS7環境下,kubernetes單機版環境,成功部署一個服務,在虛擬機中訪問服務沒問題,下面這樣:
curl http://172.27.73.26:8888/eureka-server/default/master {"name":"eureka-server","profiles":["default"],"label":"master","version":null,"state":null,"propertySources":[{"name":"eureka-server-default","source":{"server.port":"${SERVER_PORT:8761}","eureka.instance.preferIpAddress":"true","eureka.instance.lease-renewal-interval-in-seconds":"10","eureka.server.renewal-percent-threshold":"0.85","eureka.instance.lease-expiration-duration-in-seconds":"30","eureka.client.registerWithEureka":"true","eureka.client.fetchRegistry":"true","eureka.client.serviceUrl.defaultZone":"http://${EUREKA_SERVER_HOST}:${EUREKA_SERVER_PORT}/eureka/","eureka.server.waitTimeInMsWhenSyncEmpty":"0","eureka.server.enableSelfPreservation":"false","eureka.server.eviction-interval-timer-in-ms":"10000"}}]}
但是在虛擬機外訪問不是超時就是連接不上:
查找原因,防火牆在安裝kubernetes時已經關閉,於是:
1. 重新打開防火牆:
systemctl start firewalld
2. 添加8888端口的訪問權限,這里會永久生效
firewall-cmd --zone=public --add-port=8888/tcp --permanent
3. 重新載入防火牆,添加的端口才能生效
firewall-cmd --reload
4. 循環2-3步,添加想要的端口,然后關閉防火牆
systemctl stop firewalld
5. 查詢防火牆開放端口
sudo iptables-save
這時,我們發現在虛擬機外訪問,就沒有問題了。
似乎這個問題解決了,但當我們關閉虛擬機,再次打開虛擬機,啟動kubernetes時,再次訪問訪問,還是不能訪問。這就奇怪了,為什么呢?
1. 使用命令查詢虛擬機監聽的端口
[root@localhost ~]# netstat -tlunp Active Internet connections (only servers) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 127.0.0.1:10248 0.0.0.0:* LISTEN 1562/kubelet tcp 0 0 127.0.0.1:10249 0.0.0.0:* LISTEN 1571/kube-proxy tcp 0 0 127.0.0.1:10250 0.0.0.0:* LISTEN 1562/kubelet tcp 0 0 127.0.0.1:2379 0.0.0.0:* LISTEN 1247/etcd tcp 0 0 127.0.0.1:2380 0.0.0.0:* LISTEN 1247/etcd tcp 0 0 127.0.0.1:10255 0.0.0.0:* LISTEN 1562/kubelet tcp 0 0 127.0.0.1:8080 0.0.0.0:* LISTEN 1534/kube-apiserver tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN 890/sshd tcp 0 0 172.27.73.26:8888 0.0.0.0:* LISTEN 1571/kube-proxy tcp 0 0 127.0.0.1:25 0.0.0.0:* LISTEN 1025/master tcp6 0 0 :::4194 :::* LISTEN 1562/kubelet tcp6 0 0 :::2375 :::* LISTEN 1322/dockerd-curren tcp6 0 0 :::5000 :::* LISTEN 1473/docker-proxy-c tcp6 0 0 :::10251 :::* LISTEN 1551/kube-scheduler tcp6 0 0 :::6443 :::* LISTEN 1534/kube-apiserver tcp6 0 0 :::10252 :::* LISTEN 1544/kube-controlle tcp6 0 0 :::22 :::* LISTEN 890/sshd tcp6 0 0 ::1:25 :::* LISTEN 1025/master udp 0 0 127.0.0.1:323 0.0.0.0:* 646/chronyd udp 0 0 0.0.0.0:68 0.0.0.0:* 1211/dhclient udp6 0 0 ::1:323 :::* 646/chronyd
發現8888端口確實是被監聽的,這里為什么不能訪問我也沒找到原因。
但是發現一個特點,在tcp6下監聽的端口,就可以訪問,tcp下的不可以,你要說22端口不也是tcp下的么?可是你沒注意到在tcp6下也有監聽。
如果我關閉tcp6是不是可以訪問服務呢?
這里普及下,tcp就是ipv4;tcp6就是ipv6,所以我們要關閉ipv6。
關閉ipv6,注意我們在虛擬機安裝的是CentOS7系統。
修改/etc/default/grub文件,在引導時就不加載IPV6模塊。
編輯/etc/default/grub,在GRUB_CMDLINE_LINUX加上的后面句首加上ipv6.disable=1。
修改前:
[root@localhost Desktop]# cat /etc/default/grub GRUB_TIMEOUT=5 GRUB_DISTRIBUTOR="$(sed 's, release .*$,,g' /etc/system-release)" GRUB_DEFAULT=saved GRUB_DISABLE_SUBMENU=true GRUB_TERMINAL_OUTPUT="console" GRUB_CMDLINE_LINUX="rd.lvm.lv=centos/root rd.lvm.lv=centos/swap rhgb quiet" GRUB_DISABLE_RECOVERY="true"
修改后:
[root@localhost Desktop]# cat /etc/default/grub GRUB_TIMEOUT=5 GRUB_DISTRIBUTOR="$(sed 's, release .*$,,g' /etc/system-release)" GRUB_DEFAULT=saved GRUB_DISABLE_SUBMENU=true GRUB_TERMINAL_OUTPUT="console" GRUB_CMDLINE_LINUX="ipv6.disable=1 rd.lvm.lv=centos/root rd.lvm.lv=centos/swap rhgb quiet" GRUB_DISABLE_RECOVERY="true"
修改完畢后保存,運行grub2-mkconfig -o /boot/grub2/grub.cfg重新生成grub.cfg文件。
[root@localhost ~]# grub2-mkconfig -o /boot/grub2/grub.cfg Generating grub configuration file ... Found linux image: /boot/vmlinuz-3.10.0-957.12.2.el7.x86_64 Found initrd image: /boot/initramfs-3.10.0-957.12.2.el7.x86_64.img Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img Found linux image: /boot/vmlinuz-0-rescue-9cebd9e98d7e482499f2d4215498df5b Found initrd image: /boot/initramfs-0-rescue-9cebd9e98d7e482499f2d4215498df5b.img done
重啟系統,運行lsmod|grep ipv6,可以看到ipv6已經關閉
驗證IPV6是否關閉
[root@localhost ~]# cat /proc/sys/net/ipv6/conf/all/disable_ipv6 1
If the output is 0, IPv6 is enabled.
If the output is 1, IPv6 is already disabled.
重新使用命令查詢虛擬機監聽的端口:
[root@localhost ~]# netstat -tlunp Active Internet connections (only servers) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:2375 0.0.0.0:* LISTEN 4991/dockerd-curren tcp 0 0 127.0.0.1:10248 0.0.0.0:* LISTEN 5215/kubelet tcp 0 0 127.0.0.1:10249 0.0.0.0:* LISTEN 5222/kube-proxy tcp 0 0 127.0.0.1:10250 0.0.0.0:* LISTEN 5215/kubelet tcp 0 0 0.0.0.0:10251 0.0.0.0:* LISTEN 5194/kube-scheduler tcp 0 0 0.0.0.0:6443 0.0.0.0:* LISTEN 5173/kube-apiserver tcp 0 0 127.0.0.1:2379 0.0.0.0:* LISTEN 4906/etcd tcp 0 0 0.0.0.0:10252 0.0.0.0:* LISTEN 5187/kube-controlle tcp 0 0 127.0.0.1:2380 0.0.0.0:* LISTEN 4906/etcd tcp 0 0 127.0.0.1:10255 0.0.0.0:* LISTEN 5215/kubelet tcp 0 0 127.0.0.1:8080 0.0.0.0:* LISTEN 5173/kube-apiserver tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN 3912/sshd tcp 0 0 172.27.73.28:8888 0.0.0.0:* LISTEN 5222/kube-proxy tcp 0 0 127.0.0.1:25 0.0.0.0:* LISTEN 4371/master tcp 0 0 0.0.0.0:4194 0.0.0.0:* LISTEN 5215/kubelet udp 0 0 0.0.0.0:68 0.0.0.0:* 4869/dhclient udp 0 0 127.0.0.1:323 0.0.0.0:* 3196/chronyd
已經沒有tcp6了,表明ipv6已經關閉。
從外部訪問部署好的訪問,ok,即使重啟CentOS7系統或者虛擬機,都沒問題。