Ceph Cluster report Monitor clock skew detected error troubleshooting, resolving
The alarm information is as follows:
[Email protected] ceph]# ceph-w
Cluster ddc1b10b-6d1a-4ef9-8a01-d561512f3c1d
Health Health_warn
Clock skew detected on mon.ceph-100-81, mon.ceph-100-82
Monitor Clock Skew detected
Monmap E1:3 Mons at {ceph-100-80=172.16.100.80:6789/0,ceph-100-81=172.16.100.81:6789/0,ceph-100-82= 172.16.100.82:6789/0}
Election epoch, quorum 0,1,2 ceph-100-80,ceph-100-81,ceph-100-82
Mdsmap e21:1/1/1 up {0=ceph-100-80=up:active}, 2 Up:standby
Osdmap E116:6 osds:6 up, 6 in
Pgmap v205:576 pgs, 3 pools, 1962 bytes data, objects
234 MB used, 269 gb/269 GB Avail
576 Active+clean
1: Add configuration parameters:
Vim/etc/ceph/ceph.conf
[MON.CEPH-100-80]
Host = ceph-100-80
Mon_data =/var/lib/ceph/mon/ceph-ceph-100-80/
MON_ADDR = 172.16.100.80:6789
# Add content as follows:
Mon clock Drift allowed = 2
Mon clock drift warn Backoff = 30
2: Synchronizing the configuration file
Ceph-deploy--overwrite-conf Admin ceph-100-{80..82}
3: Restart Mon service
/etc/init.d/ceph Restart Mon
4: Verify:
[Email protected] ceph]# ceph-w
Cluster ddc1b10b-6d1a-4ef9-8a01-d561512f3c1d
Health HEALTH_OK
Monmap E1:3 Mons at {ceph-100-80=172.16.100.80:6789/0,ceph-100-81=172.16.100.81:6789/0,ceph-100-82= 172.16.100.82:6789/0}
Election epoch, quorum 0,1,2 ceph-100-80,ceph-100-81,ceph-100-82
Mdsmap e21:1/1/1 up {0=ceph-100-80=up:active}, 2 Up:standby
Osdmap E116:6 osds:6 up, 6 in
Pgmap v205:576 pgs, 3 pools, 1962 bytes data, objects
234 MB used, 269 gb/269 GB Avail
576 Active+clean
Check again, the alarm content disappears.
Summary of issues:
This problem is mainly Mon node server, the time deviation is relatively large, this time encountered a problem for the test environment, by modifying ceph to time deviation threshold, evade alarm information, online business environment, attention to troubleshoot the server time synchronization problem.
This article from "Kang Jianhua" blog, reproduced please contact the author!
Ceph Cluster report Monitor clock skew detected error troubleshooting, resolving