I don't know if this is the same thing, but we've seen CI failures with a luks encrypted volume with a similar error: https://storage.gra1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_998/679640/32/gate/nova-multi-cell/998bcd6/testr_results.html.gz https://zuul.opendev.org/t/openstack/build/998bcd66b810467fae1664aaf280d53d/log/controller/logs/screen-n-cpu.txt.gz?severity=4#25797 Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [None req-02bd4ed8-e521-4317-b434-b768168d28ec tempest-TestVolumeBootPattern-1345811753 tempest-TestVolumeBootPattern-1345811753] [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] Instance failed to spawn: os_brick.exception.VolumeDeviceNotFound: Volume device not found at /dev/disk/by-id. Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] Traceback (most recent call last): Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] File "/opt/stack/nova/nova/compute/manager.py", line 2478, in _build_resources Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] yield resources Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] File "/opt/stack/nova/nova/compute/manager.py", line 2254, in _build_and_run_instance Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] block_device_info=block_device_info) Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3467, in spawn Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] mdevs=mdevs) Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 6027, in _get_guest_xml Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] context, mdevs) Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 5690, in _get_guest_config Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] flavor, guest.os_type) Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4465, in _get_guest_storage_config Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] self._connect_volume(context, connection_info, instance) Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 1577, in _connect_volume Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] vol_driver.connect_volume(connection_info, instance) Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] File "/opt/stack/nova/nova/virt/libvirt/volume/iscsi.py", line 64, in connect_volume Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] device_info = self.connector.connect_volume(connection_info['data']) Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] File "/usr/local/lib/python3.6/dist-packages/os_brick/utils.py", line 150, in trace_logging_wrapper Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] result = f(*args, **kwargs) Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] File "/usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py", line 328, in inner Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] return f(*args, **kwargs) Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] File "/usr/local/lib/python3.6/dist-packages/os_brick/initiator/connectors/iscsi.py", line 519, in connect_volume Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] self._cleanup_connection(connection_properties, force=True) Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] File "/usr/local/lib/python3.6/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] self.force_reraise() Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] File "/usr/local/lib/python3.6/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] six.reraise(self.type_, self.value, self.tb) Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] File "/usr/local/lib/python3.6/dist-packages/six.py", line 693, in reraise Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] raise value Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] File "/usr/local/lib/python3.6/dist-packages/os_brick/initiator/connectors/iscsi.py", line 513, in connect_volume Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] return self._connect_single_volume(connection_properties) Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] File "/usr/local/lib/python3.6/dist-packages/os_brick/utils.py", line 61, in _wrapper Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] return r.call(f, *args, **kwargs) Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] File "/usr/local/lib/python3.6/dist-packages/retrying.py", line 212, in call Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] raise attempt.get() Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] File "/usr/local/lib/python3.6/dist-packages/retrying.py", line 247, in get Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] six.reraise(self.value[0], self.value[1], self.value[2]) Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] File "/usr/local/lib/python3.6/dist-packages/six.py", line 693, in reraise Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] raise value Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] File "/usr/local/lib/python3.6/dist-packages/retrying.py", line 200, in call Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] attempt = Attempt(fn(*args, **kwargs), attempt_number, False) Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] File "/usr/local/lib/python3.6/dist-packages/os_brick/initiator/connectors/iscsi.py", line 579, in _connect_single_volume Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] wwn, found_devs) Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] File "/usr/local/lib/python3.6/dist-packages/os_brick/initiator/connectors/iscsi.py", line 553, in _get_connect_result Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] device = self._get_device_link(wwn, device, mpath) Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] File "/usr/local/lib/python3.6/dist-packages/os_brick/initiator/connectors/iscsi.py", line 539, in _get_device_link Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] raise exception.VolumeDeviceNotFound(device='/dev/disk/by-id') Sep 19 08:33:40.910370 ubuntu-bionic-ovh-bhs1-0011487265 nova-compute[27425]: ERROR nova.compute.manager [instance: e7adf892-6c49-44b7-bbeb-cf7c846cf8bf] os_brick.exception.VolumeDeviceNotFound: Volume device not found at /dev/disk/by-id.