Comment 8 for bug 1830736

Revision history for this message
Yang Liu (yliu12) wrote :

No it is not recoverable, system needs to be reinstalled after that. And is 100% reproducible in WR environment.
I'm not sure if the journal device was purged successfully, but ceph was healthy on that storage node before lock/unlock. Any commands we can run to check?

Below is the configs of that node.
[sysadmin@controller-0 ~(keystone_admin)]$ system host-stor-list storage-0
+--------------------------------------+----------+-------+------------+--------------------------------------+-----------------------------------------------+----------------+------------------+-----------+
| uuid | function | osdid | state | idisk_uuid | journal_path | journal_node | journal_size_gib | tier_name |
+--------------------------------------+----------+-------+------------+--------------------------------------+-----------------------------------------------+----------------+------------------+-----------+
| 618b6370-792a-49e2-951a-ab9418179904 | journal | None | configured | d3a6d5a7-06db-47d0-a7b1-c24b19f6d584 | None | None | None | None |
| 73e40f40-d400-484c-858d-f53db7755ad9 | osd | 1 | configured | 29dce56f-dfbe-4127-a89c-5803fe5b18c8 | /dev/disk/by-path/pci-0000:84:00. | /dev/nvme1n1p2 | 1 | storage |
| | | | | | 0-nvme-1-part2 | | | |
| | | | | | | | | |
| d824517a-6d37-41a9-9c6d-750af02a510c | osd | 0 | configured | dbf30bdc-d25f-4f33-92be-c639b4a82b82 | /dev/disk/by-path/pci-0000:84:00. | /dev/nvme1n1p1 | 1 | storage |
| | | | | | 0-nvme-1-part1 | | | |
| | | | | | | | | |
+--------------------------------------+----------+-------+------------+--------------------------------------+-----------------------------------------------+----------------+------------------+-----------+

[sysadmin@controller-0 ~(keystone_admin)]$ system host-disk-list storage-0
ssh +--------------------------------------+--------------+---------+---------+-------+------------+-----+--------------+-------------------------------------------+
| uuid | device_node | device_ | device_ | size_ | available_ | rpm | serial_id | device_path |
| | | num | type | gib | gib | | | |
+--------------------------------------+--------------+---------+---------+-------+------------+-----+--------------+-------------------------------------------+
| ca69b91a-7a38-4592-927b-be497f65c20d | /dev/nvme0n1 | 66305 | NVME | 372. | 0.0 | N/A | CVFT64740025 | /dev/disk/by-path/pci-0000:83:00.0-nvme-1 |
| | | | | 611 | | | 400GGN | |
| | | | | | | | | |
| d3a6d5a7-06db-47d0-a7b1-c24b19f6d584 | /dev/nvme1n1 | 66304 | NVME | 372. | 370.609 | N/A | CVFT64740069 | /dev/disk/by-path/pci-0000:84:00.0-nvme-1 |
| | | | | 611 | | | 400GGN | |
| | | | | | | | | |
| dbf30bdc-d25f-4f33-92be-c639b4a82b82 | /dev/nvme2n1 | 66310 | NVME | 745. | 0.0 | N/A | CVFT65130043 | /dev/disk/by-path/pci-0000:85:00.0-nvme-1 |
| | | | | 211 | | | 800HGN | |
| | | | | | | | | |
| 29dce56f-dfbe-4127-a89c-5803fe5b18c8 | /dev/nvme3n1 | 66311 | NVME | 745. | 0.0 | N/A | CVFT65130048 | /dev/disk/by-path/pci-0000:86:00.0-nvme-1 |
| | | | | 211 | | | 800HGN | |
| | | | | | | | | |
+--------------------------------------+--------------+---------+---------+-------+------------+-----+--------------+-------------------------------------------+