ceph 問題總結已解決

1. waiting for a volume to be created, either by external provisioner "ceph.com/rbd" or manually create

修改kube-apiserver 配置 添加  --feature-gates=VolumeSnapshotDataSource=true,RemoveSelfLink=false 
重啟一下kube-apiserver就可以了

2. clock skew detected on mon.b

查看是不是時間錯誤沒有同步時間  時間同步一下等待幾分鍾就可以了​

3. ceph 報warning

進入ceph tool容器后查看ceph狀態，會發現狀態是HEALTH_WARN，下面有一行提示：mons are allowing insecure global_id reclaim
解決辦法：禁用不安全模式
     ceph config set mon auth_allow_insecure_global_id_reclaim false
稍后再次查看，ceph status就變成HEALTH_OK了

4. Module 'restful' has failed dependency: No module named 'pecan'

   pip3 install pecan werkzeug #沒生效記得重啟服務器

5. Error ERANGE: pg_num 128 size 3 would mean 1635 total pgs, which exceeds max 1500 (mon_max_pg_per_osd 250 * num_in_osds 6)

修改ceph配置文件

vim /etc/ceph/ceph.conf

[global]
mon_max_pg_per_osd =2000

6. 2 daemons have recently crashed

[root@estarhaohao-centos7-master01 ~]# ceph crash ls-new
ID                                                                ENTITY  NEW
2022-03-07T13:48:31.173385Z_f64ec72f-c8d6-4bde-b20f-f20e32dae433  mon.b    *
2022-03-07T13:48:31.355612Z_6a6eb87c-4fba-4fce-85fe-d08097c64817  mon.b    *
[root@estarhaohao-centos7-master01 ~]# ceph crash archive-all
[root@estarhaohao-centos7-master01 ~]# ceph crash ls-new
[root@estarhaohao-centos7-master01 ~]# ceph -s
  cluster:
    id:     2fb51620-1a29-4d64-9ad9-616e6435924a
    health: HEALTH_OK