Comment 6 for bug 1901783

Revision history for this message
Lee Yarwood (lyarwood) wrote :

https://zuul.opendev.org/t/openstack/build/db6362e6c2c34d8f9f06e543430d7beb/log/controller/logs/syslog.txt

Feb 18 07:54:14 ubuntu-focal-rax-iad-0023075527 kernel: sda: sda1 sda15
Feb 18 07:54:14 ubuntu-focal-rax-iad-0023075527 kernel: blk_update_request: I/O error, dev sda, sector 18552 op 0x0:(READ) flags 0x80700 phys_seg 1 prio class 0
Feb 18 07:54:14 ubuntu-focal-rax-iad-0023075527 kernel: blk_update_request: I/O error, dev sda, sector 18552 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 0
Feb 18 07:54:14 ubuntu-focal-rax-iad-0023075527 kernel: Buffer I/O error on dev sda1, logical block 120, async page read
Feb 18 07:54:14 ubuntu-focal-rax-iad-0023075527 kernel: blk_update_request: I/O error, dev sda, sector 18553 op 0x0:(READ) flags 0x0 phys_seg 7 prio class 0
Feb 18 07:54:14 ubuntu-focal-rax-iad-0023075527 kernel: Buffer I/O error on dev sda1, logical block 121, async page read
Feb 18 07:54:14 ubuntu-focal-rax-iad-0023075527 kernel: Buffer I/O error on dev sda1, logical block 122, async page read
Feb 18 07:54:14 ubuntu-focal-rax-iad-0023075527 kernel: Buffer I/O error on dev sda1, logical block 123, async page read
Feb 18 07:54:14 ubuntu-focal-rax-iad-0023075527 kernel: Buffer I/O error on dev sda1, logical block 124, async page read
Feb 18 07:54:14 ubuntu-focal-rax-iad-0023075527 kernel: Buffer I/O error on dev sda1, logical block 125, async page read
Feb 18 07:54:14 ubuntu-focal-rax-iad-0023075527 kernel: Buffer I/O error on dev sda1, logical block 126, async page read
Feb 18 07:54:14 ubuntu-focal-rax-iad-0023075527 kernel: Buffer I/O error on dev sda1, logical block 127, async page read
Feb 18 07:54:14 ubuntu-focal-rax-iad-0023075527 kernel: sd 2:0:0:1: [sda] Synchronizing SCSI cache
Feb 18 07:54:14 ubuntu-focal-rax-iad-0023075527 kernel: lvs[130388]: segfault at 800 ip 00007f01a0fa2555 sp 00007ffcf4d396b8 error 4 in libc-2.31.so[7f01a0f0d000+178000]

https://zuul.opendev.org/t/openstack/build/db6362e6c2c34d8f9f06e543430d7beb/log/controller/logs/screen-c-vol.txt

Feb 18 07:54:14.597590 ubuntu-focal-rax-iad-0023075527 cinder-volume[85652]: ERROR cinder.volume.manager Traceback (most recent call last):
Feb 18 07:54:14.597590 ubuntu-focal-rax-iad-0023075527 cinder-volume[85652]: ERROR cinder.volume.manager File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task
Feb 18 07:54:14.597590 ubuntu-focal-rax-iad-0023075527 cinder-volume[85652]: ERROR cinder.volume.manager result = task.execute(**arguments)
Feb 18 07:54:14.597590 ubuntu-focal-rax-iad-0023075527 cinder-volume[85652]: ERROR cinder.volume.manager File "/opt/stack/cinder/cinder/volume/flows/manager/manage_existing_snapshot.py", line 118, in execute
Feb 18 07:54:14.597590 ubuntu-focal-rax-iad-0023075527 cinder-volume[85652]: ERROR cinder.volume.manager size = self.driver.manage_existing_snapshot_get_size(
Feb 18 07:54:14.597590 ubuntu-focal-rax-iad-0023075527 cinder-volume[85652]: ERROR cinder.volume.manager File "/opt/stack/cinder/cinder/volume/drivers/lvm.py", line 662, in manage_existing_snapshot_get_size
Feb 18 07:54:14.597590 ubuntu-focal-rax-iad-0023075527 cinder-volume[85652]: ERROR cinder.volume.manager return self.manage_existing_object_get_size(snapshot, existing_ref,
Feb 18 07:54:14.597590 ubuntu-focal-rax-iad-0023075527 cinder-volume[85652]: ERROR cinder.volume.manager File "/opt/stack/cinder/cinder/volume/drivers/lvm.py", line 632, in manage_existing_object_get_size
Feb 18 07:54:14.597590 ubuntu-focal-rax-iad-0023075527 cinder-volume[85652]: ERROR cinder.volume.manager lv = self.vg.get_volume(lv_name)
Feb 18 07:54:14.597590 ubuntu-focal-rax-iad-0023075527 cinder-volume[85652]: ERROR cinder.volume.manager File "/opt/stack/cinder/cinder/brick/local_dev/lvm.py", line 345, in get_volume
Feb 18 07:54:14.597590 ubuntu-focal-rax-iad-0023075527 cinder-volume[85652]: ERROR cinder.volume.manager ref_list = self.get_volumes(name)
Feb 18 07:54:14.597590 ubuntu-focal-rax-iad-0023075527 cinder-volume[85652]: ERROR cinder.volume.manager File "/opt/stack/cinder/cinder/brick/local_dev/lvm.py", line 335, in get_volumes
Feb 18 07:54:14.597590 ubuntu-focal-rax-iad-0023075527 cinder-volume[85652]: ERROR cinder.volume.manager return self.get_lv_info(self._root_helper,
Feb 18 07:54:14.597590 ubuntu-focal-rax-iad-0023075527 cinder-volume[85652]: ERROR cinder.volume.manager File "/opt/stack/cinder/cinder/brick/local_dev/lvm.py", line 318, in get_lv_info
Feb 18 07:54:14.597590 ubuntu-focal-rax-iad-0023075527 cinder-volume[85652]: ERROR cinder.volume.manager out = None
Feb 18 07:54:14.597590 ubuntu-focal-rax-iad-0023075527 cinder-volume[85652]: ERROR cinder.volume.manager File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Feb 18 07:54:14.597590 ubuntu-focal-rax-iad-0023075527 cinder-volume[85652]: ERROR cinder.volume.manager self.force_reraise()
Feb 18 07:54:14.597590 ubuntu-focal-rax-iad-0023075527 cinder-volume[85652]: ERROR cinder.volume.manager File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Feb 18 07:54:14.597590 ubuntu-focal-rax-iad-0023075527 cinder-volume[85652]: ERROR cinder.volume.manager raise self.value
Feb 18 07:54:14.597590 ubuntu-focal-rax-iad-0023075527 cinder-volume[85652]: ERROR cinder.volume.manager File "/opt/stack/cinder/cinder/brick/local_dev/lvm.py", line 308, in get_lv_info
Feb 18 07:54:14.597590 ubuntu-focal-rax-iad-0023075527 cinder-volume[85652]: ERROR cinder.volume.manager (out, _err) = putils.execute(*cmd,
Feb 18 07:54:14.597590 ubuntu-focal-rax-iad-0023075527 cinder-volume[85652]: ERROR cinder.volume.manager File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Feb 18 07:54:14.597590 ubuntu-focal-rax-iad-0023075527 cinder-volume[85652]: ERROR cinder.volume.manager raise ProcessExecutionError(exit_code=_returncode,
Feb 18 07:54:14.601372 ubuntu-focal-rax-iad-0023075527 cinder-volume[85652]: ERROR cinder.volume.manager oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Feb 18 07:54:14.601372 ubuntu-focal-rax-iad-0023075527 cinder-volume[85652]: ERROR cinder.volume.manager Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-0ecba2cd-217b-4753-94a9-357264acbe04
Feb 18 07:54:14.601372 ubuntu-focal-rax-iad-0023075527 cinder-volume[85652]: ERROR cinder.volume.manager Exit code: 139