kubernetes排錯系列:(二)、運行很久的kubernetes集群,創建出來的pod都是pending狀態


1.查看pod信息

# 查看pod 報錯信息
kubectl get pods
發現pod的ip沒有 生成,也沒有分配到某個node節點

# 查看pod詳細時間
kubectl describe pods
發現pod事件為空

 

 

2.查看集群信息

kubectl get nodes

發現集群狀態正常

kubectl cluster-info

Kubernetes master is running at https://xx.xx.55.113
KubeDNS is running at https://xx.xx.55.113:6443/api

 

3. 查看kubelet日志發現

journalctl -xefu kubelet
Sep 17 14:38:34 cbov10-sso55-113 kubelet[9892]: E0917 14:38:34.750672    9892 kuberuntime_manager.go:917] getPodContainerStatuses for pod "kube-scheduler-k8s-master_kube-system(a29556bf1d34f898bf5d0ce3c15a5948)" failed: rpc error: code = Unknown desc = Error response from daemon: readlink /var/lib/docker/overlay2/s=13b9f39777ba4419b309b8b3ae11760e;i=121b8;b=37ab1d18c20d41b2a88be512b10aba22;m=559ecd: no such file or directory
Sep 17 14:38:35 cbov10-sso55-113 kubelet[9892]: E0917 14:38:35.260404    9892 remote_runtime.go:321] ContainerStatus "fad2baa3755429e94c4b79549ce2a2d2a2b018e1c55bf282d1b5b0be0b4022fe" from runtime service failed: rpc error: code = Unknown desc = Error response from daemon: readlink /var/lib/docker/overlay2/s=13b9f39777ba4419b309b8b3ae11760e;i=121b8;b=37ab1d18c20d41b2a88be512b10aba22;m=559ecd: no such file or directory
Sep 17 14:38:35 cbov10-sso55-113 kubelet[9892]: E0917 14:38:35.260498    9892 kuberuntime_gc.go:142] Failed to remove container "fad2baa3755429e94c4b79549ce2a2d2a2b018e1c55bf282d1b5b0be0b4022fe": failed to get container status "fad2baa3755429e94c4b79549ce2a2d2a2b018e1c55bf282d1b5b0be0b4022fe": rpc error: code = Unknown desc = Error response from daemon: readlink /var/lib/docker/overlay2/s=13b9f39777ba4419b309b8b3ae11760e;i=121b8;b=37ab1d18c20d41b2a88be512b10aba22;m=559ecd: no such file or directory
Sep 17 14:38:44 cbov10-sso55-113 kubelet[9892]: E0917 14:38:44.674953    9892 pod_workers.go:190] Error syncing pod a29556bf1d34f898bf5d0ce3c15a5948 ("kube-scheduler-cbov10-sso55-113_kube-system(a29556bf1d34f898bf5d0ce3c15a5948)"), skipping: rpc error: code = Unknown desc = Error response from daemon: readlink /var/lib/docker/overlay2/s=13b9f39777ba4419b309b8b3ae11760e;i=121b8;b=37ab1d18c20d41b2a88be512b10aba22;m=559ecd: no such file or directory

 

 

4.清理docker占用的磁盤空間

#可以用於清理磁盤,刪除關閉的容器、無用的數據卷和網絡
docker system prune -a

 

5.之后再次部署,發現pod能正常啟動。

 


免責聲明!

本站轉載的文章為個人學習借鑒使用,本站對版權不負任何法律責任。如果侵犯了您的隱私權益,請聯系本站郵箱yoyou2525@163.com刪除。



 
粵ICP備18138465號   © 2018-2025 CODEPRJ.COM