There is a current issue where we are no longer able to mount Synology Volumes in Openstack. We can create volumes, but when attempting to attach to an instance we receive an error from Nova Compute. This feature was working, but has stopped working even though no apparent configuration hanges that would affect this have been made.
1) Ubunutu Release: 22.04.3 LTS
2) Openstack 6.0.0
3) We expected our synology volumes to mount correctly
4) We receive an error from Nova Compute
Traceback from where we believe the issue is (format pulled from splunk logging):
023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] Traceback (most recent call last):
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] File "/usr/lib/python3/dist-packages/os_brick/initiator/connectors/iscsi.py", line 206, in _get_ips_iqns_luns
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] ips_iqns_luns = method(connection_properties)
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] File "/usr/lib/python3/dist-packages/os_brick/initiator/connectors/iscsi.py", line 455, in _discover_iscsi_portals
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] luns = self._get_luns(connection_properties, iqns)
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] File "/usr/lib/python3/dist-packages/os_brick/initiator/connectors/base_iscsi.py", line 41, in _get_luns
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] return luns or [con_props['target_lun']] * num_luns
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] KeyError: 'target_lun'
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf]
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] During handling of the above exception, another exception occurred:
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf]
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] Traceback (most recent call last):
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 2517, in _build_and_run_instance
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] self.driver.spawn(context, instance, image_meta,
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 4365, in spawn
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] xml = self._get_guest_xml(context, instance, network_info,
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 7505, in _get_guest_xml
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] conf = self._get_guest_config(instance, network_info, image_meta,
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 7020, in _get_guest_config
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] storage_configs = self._get_guest_storage_config(context,
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 5588, in _get_guest_storage_config
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] self._connect_volume(context, connection_info, instance)
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 1909, in _connect_volume
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] vol_driver.connect_volume(connection_info, instance)
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] File "/usr/lib/python3/dist-packages/nova/virt/libvirt/volume/iscsi.py", line 64, in connect_volume
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] device_info = self.connector.connect_volume(connection_info['data'])
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] File "/usr/lib/python3/dist-packages/os_brick/utils.py", line 171, in trace_logging_wrapper
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] return f(*args, **kwargs)
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] File "/usr/lib/python3/dist-packages/os_brick/utils.py", line 300, in change_encrypted
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] res = func(self, connection_properties)
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] File "/usr/lib/python3/dist-packages/os_brick/initiator/connectors/base.py", line 78, in inner
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] return f(*args, **kwargs)
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] File "/usr/lib/python3/dist-packages/os_brick/initiator/connectors/iscsi.py", line 529, in connect_volume
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] with excutils.save_and_reraise_exception():
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] self.force_reraise()
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] raise self.value
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] File "/usr/lib/python3/dist-packages/os_brick/initiator/connectors/iscsi.py", line 523, in connect_volume
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] return self._connect_multipath_volume(connection_properties)
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] File "/usr/lib/python3/dist-packages/os_brick/utils.py", line 95, in _wrapper
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] return r(f, *args, **kwargs)
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] File "/usr/lib/python3/dist-packages/tenacity/__init__.py", line 423, in __call__
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] do = self.iter(retry_state=retry_state)
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] File "/usr/lib/python3/dist-packages/tenacity/__init__.py", line 360, in iter
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] return fut.result()
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] return self.__get_result()
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] raise self._exception
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] File "/usr/lib/python3/dist-packages/tenacity/__init__.py", line 426, in __call__
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] result = fn(*args, **kwargs)
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] File "/usr/lib/python3/dist-packages/os_brick/initiator/connectors/iscsi.py", line 706, in _connect_multipath_volume
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] ips_iqns_luns = self._get_ips_iqns_luns(connection_properties)
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] File "/usr/lib/python3/dist-packages/os_brick/initiator/connectors/iscsi.py", line 220, in _get_ips_iqns_luns
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] raise exception.TargetPortalNotFound(
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf] os_brick.exception.TargetPortalNotFound: Unable to find target portal 192.168.3.14:3260.
2023-08-22 09:52:50.767 5032 ERROR nova.compute.manager [instance: 1f1c4b6b-d539-4752-b96c-b58d7ff02dcf]
