Horizon got crashed after few hours of ideal installation
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
StarlingX |
Invalid
|
Low
|
Austin Sun |
Bug Description
Brief Description
-----------------
Horizon goes down after few hours of new starlingx AIO Duplex installation.
Details:
Severity
--------
Provide the severity of the defect.
Critical: System/Feature is not usable due to the defect
Steps to Reproduce
------------------
reinstall the setup with AIO Duplex setup.
https:/
after the installation do not anything and keep the setup idle for couple of days, it goes down saying errors as mentioned above.
Expected Behavior
------------------
xfs file system gives error as reported in kern.log
XFS (dm-3): Unmount and run xfs_repair │
9] XFS (dm-3): First 128 bytes of corrupted metadata buffer: │
2] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ │
5] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ │
6] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ │
5] 00000030: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ │
6] 00000040: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ │
2] 00000050: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ │
5] 00000060: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ │
3] 00000070: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ │
0] XFS (dm-3): metadata I/O error in "xfs_trans_
7] XFS (dm-3): xfs_dabuf_map: bno 8388608 dir: inode 122425344 │
3] XFS (dm-3): [00] br_startoff 8388608 br_startblock -2 br_blockcount 1 br_state 0 │
8] XFS (dm-3): Internal error xfs_da_do_buf(1) at line 2558 of file fs/xfs/
671] CPU: 1 PID: 83210 Comm: heat-manage Kdump: loaded Tainted: G O --------- -t - 4.18.0-
672] Hardware name: HPE ProLiant DL360 Gen10/ProLiant DL360 Gen10, BIOS U32 04/18/2019
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
Actual Behavior
----------------
Reproducibility
---------------
<Reproducible>
have tried two times and issue was seen again.
Timestamp/Logs
--------------
System Configuration
-------
<Two node system>
Timestamp/Logs
--------------
openstack horizon pod logs:
openstack_
--
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
2020-11-
Further debuging the collect log.
Kern.log
XFS (dm-3): Unmount and run xfs_repair │
9] XFS (dm-3): First 128 bytes of corrupted metadata buffer: │
2] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ │
5] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ │
6] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ │
5] 00000030: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ │
6] 00000040: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ │
2] 00000050: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ │
5] 00000060: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ │
3] 00000070: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ │
0] XFS (dm-3): metadata I/O error in "xfs_trans_
7] XFS (dm-3): xfs_dabuf_map: bno 8388608 dir: inode 122425344 │
3] XFS (dm-3): [00] br_startoff 8388608 br_startblock -2 br_blockcount 1 br_state 0 │
8] XFS (dm-3): Internal error xfs_da_do_buf(1) at line 2558 of file fs/xfs/
671] CPU: 1 PID: 83210 Comm: heat-manage Kdump: loaded Tainted: G O --------- -t - 4.18.0-
672] Hardware name: HPE ProLiant DL360 Gen10/ProLiant DL360 Gen10, BIOS U32 04/18/2019
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
│2020-11-
tags: | added: stx.distro.openstack |
Changed in starlingx: | |
status: | New → Incomplete |
Hi,
From you current log, it seems that the filesystem become corrupted and repair failed
The root cause might not relate to horizon
Could you retry it on other set up as well.
Thanks!
Zhipeng