Similar issue reproduced on 2020-08-26_00-00-00
Steps: lock controller-0 remove sriov vf interface on host controller-0 remove sriov data network unlock controller-0
+--------------------------------------+----------+-----------------------------------------------------------------------------------------------------------------------+----------------------------------------------+----------+----------------------------+ | UUID | Alarm ID | Reason Text | Entity ID | Severity | Time Stamp | +--------------------------------------+----------+-----------------------------------------------------------------------------------------------------------------------+----------------------------------------------+----------+----------------------------+ | 5e1a71f2-e4b1-41b6-8641-6223a406ec73 | 800.001 | Storage Alarm Condition: HEALTH_WARN [PGs are degraded/stuck or undersized]. Please check 'ceph -s' for more details. | cluster=4750164e-1cbe-4e56-ba82-e56389f3918b | warning | 2020-08-27T07:07:36.319531 | +--------------------------------------+----------+-----------------------------------------------------------------------------------------------------------------------+----------------------------------------------+----------+----------------------------+
[2020-08-27 07:09:14,677] 314 DEBUG MainThread ssh.send :: Send 'sudo ntpq -pn' remote refid st t when poll reach delay offset jitter ============================================================================== abcd:204::3 .XFAC. 16 u - 64 0 0.000 0.000 0.000 64:ff9b::c11d:3f96 142.66.101.13 2 u 51 64 7 16.788 0.022 0.354 64:ff9b::2d4c:f4c1 216.239.35.8 2 u 49 64 7 63.436 -2.186 1.248 64:ff9b::4a06:a848 208.71.46.33 2 u 46 64 7 64.818 0.403 3.358
[2020-08-27 07:08:53,582] 314 DEBUG MainThread ssh.send :: Send 'ceph -s' cluster: id: 4750164e-1cbe-4e56-ba82-e56389f3918b health: HEALTH_WARN Reduced data availability: 64 pgs inactive
services: mon: 1 daemons, quorum controller-0 mgr: controller-0(active) osd: 1 osds: 1 up, 1 in
data: pools: 1 pools, 64 pgs objects: 0 objects, 0 B usage: 107 MiB used, 930 GiB / 930 GiB avail pgs: 100.000% pgs unknown 64 unknown
Similar issue reproduced on 2020-08-26_00-00-00
Steps:
lock controller-0
remove sriov vf interface on host controller-0
remove sriov data network
unlock controller-0
+------ ------- ------- ------- ------- ----+-- ------- -+----- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- --+---- ------- ------- ------- ------- ------- ------- +------ ----+-- ------- ------- ------- -----+ ------- ------- ------- ------- ----+-- ------- -+----- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- --+---- ------- ------- ------- ------- ------- ------- +------ ----+-- ------- ------- ------- -----+ e4b1-41b6- 8641-6223a406ec 73 | 800.001 | Storage Alarm Condition: HEALTH_WARN [PGs are degraded/stuck or undersized]. Please check 'ceph -s' for more details. | cluster= 4750164e- 1cbe-4e56- ba82-e56389f391 8b | warning | 2020-08- 27T07:07: 36.319531 | ------- ------- ------- ------- ----+-- ------- -+----- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- --+---- ------- ------- ------- ------- ------- ------- +------ ----+-- ------- ------- ------- -----+
| UUID | Alarm ID | Reason Text | Entity ID | Severity | Time Stamp |
+------
| 5e1a71f2-
+------
[2020-08-27 07:09:14,677] 314 DEBUG MainThread ssh.send :: Send 'sudo ntpq -pn' ======= ======= ======= ======= ======= ======= ======= ======= ======= ======= =
.XFAC. 16 u - 64 0 0.000 0.000 0.000
142. 66.101. 13 2 u 51 64 7 16.788 0.022 0.354
216. 239.35. 8 2 u 49 64 7 63.436 -2.186 1.248
208. 71.46.33 2 u 46 64 7 64.818 0.403 3.358
remote refid st t when poll reach delay offset jitter
=======
abcd:204::3
64:ff9b::c11d:3f96
64:ff9b::2d4c:f4c1
64:ff9b::4a06:a848
[2020-08-27 07:08:53,582] 314 DEBUG MainThread ssh.send :: Send 'ceph -s' 1cbe-4e56- ba82-e56389f391 8b
cluster:
id: 4750164e-
health: HEALTH_WARN
Reduced data availability: 64 pgs inactive
services: 0(active)
mon: 1 daemons, quorum controller-0
mgr: controller-
osd: 1 osds: 1 up, 1 in
data:
pools: 1 pools, 64 pgs
objects: 0 objects, 0 B
usage: 107 MiB used, 930 GiB / 930 GiB avail
pgs: 100.000% pgs unknown
64 unknown