test_resize_volume_backed_server_confirm which fails randomly with Kernel panic
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
OpenStack Compute (nova) |
New
|
Undecided
|
Unassigned | ||
neutron |
Confirmed
|
Medium
|
Unassigned | ||
tempest |
New
|
Undecided
|
Unassigned |
Bug Description
tempest.
Traceback (most recent call last):
File "/opt/stack/
ssh.
File "/opt/stack/
sock.
TimeoutError: timed out
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/stack/
raise exc
File "/opt/stack/
return f(*func_args, **func_kwargs)
File "/opt/stack/
return f(*func_args, **func_kwargs)
File "/opt/stack/
linux_
File "/opt/stack/
return function(self, *args, **kwargs)
File "/opt/stack/
self.
File "/opt/stack/
connection = self._get_
File "/opt/stack/
raise exceptions.
tempest.
User: cirros, Password: None
Guest console log says it's kernel panic:-
info: initramfs: up at 7.36
[ 8.403290] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)
[ 8.440219] GPT:Primary header thinks Alt. header is not at the end of the disk.
[ 8.440726] GPT:229375 != 2097151
[ 8.440967] GPT:Alternate GPT header not at the end of the disk.
[ 8.441252] GPT:229375 != 2097151
[ 8.441503] GPT: Use GNU Parted to correct GPT errors.
[ 8.974064] virtio_gpu virtio0: [drm] drm_plane_
[ 9.068224] random: crng init done
currently loaded modules: 8021q 8139cp 8390 9pnet 9pnet_virtio ahci cec drm drm_kms_helper e1000 e1000e failover fb_sys_fops garp hid hid_generic ip6_udp_tunnel ip_tables isofs libahci libcrc32c llc mii mrp ne2k_pci net_failover nls_ascii nls_iso8859_1 nls_utf8 pcnet32 qemu_fw_cfg rc_core sctp stp syscopyarea sysfillrect sysimgblt udp_tunnel usbhid virtio_blk virtio_dma_buf virtio_gpu virtio_input virtio_net virtio_rng virtio_scsi x_tables
info: initramfs loading root from /dev/vda1
/sbin/init: can't load library 'libtirpc.so.3'
[ 11.288963] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00001000
[ 11.290203] CPU: 0 PID: 1 Comm: init Not tainted 5.15.0-71-generic #78-Ubuntu
[ 11.290952] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.15.0-1 04/01/2014
[ 11.291870] Call Trace:
[ 11.292973] <TASK>
[ 11.293458] show_stack+
[ 11.294280] dump_stack_
[ 11.294720] dump_stack+
[ 11.295179] panic+0x15c/0x334
[ 11.295587] ? exit_to_
[ 11.296118] do_exit.
[ 11.296460] __x64_sys_
[ 11.296880] do_syscall_
[ 11.297283] ? ksys_write+
[ 11.297672] ? exit_to_
[ 11.298172] ? syscall_
[ 11.298683] ? __x64_sys_
[ 11.299151] ? do_syscall_
[ 11.299644] entry_SYSCALL_
[ 11.300611] RIP: 0033:0x7f147a37555e
[ 11.301938] Code: 05 d7 2a 00 00 4c 89 f9 bf 02 00 00 00 48 8d 35 fb 0d 00 00 48 8b 10 31 c0 e8 50 d2 ff ff bf 10 00 00 00 b8 3c 00 00 00 0f 05 <48> 8d 15 f3 2a 00 00 f7 d8 89 02 48 83 ec 20 49 8b 8c 24 b8 00 00
[ 11.312012] RSP: 002b:00007fff85
[ 11.318360] RAX: ffffffffffffffda RBX: 00007fff854897b0 RCX: 00007f147a37555e
[ 11.324215] RDX: 0000000000000002 RSI: 0000000000001000 RDI: 0000000000000010
[ 11.331344] RBP: 00007fff85489790 R08: 00007f147a36e000 R09: 00007f147a36e01a
[ 11.338406] R10: 0000000000000001 R11: 0000000000000207 R12: 00007f147a36f040
[ 11.347090] R13: 00000000004bae50 R14: 0000000000000000 R15: 0000000000403d66
[ 11.354220] </TASK>
[ 11.362227] Kernel Offset: 0x36400000 from 0xffffffff81000000 (relocation range: 0xffffffff80000
[ 11.369248] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x00001000 ]---
As per opensearch[1] there are 16 hits in last 12 days across multiple jobs in master/stable2023.2 branch.
Jobs:-
tempest-
cinder-
cinder-
tempest-
nova-ceph-
Branches:-
master 93.8%
stable/2023.2 6.3%
Found an old issue in different test https:/
Example builds:-
- http://
- https:/
The last comment from the related bug is:
"It looks like rootfs image is corrupted."
Not sure there's anything neutron can do here.