We are now using 2 Unity Box and trying to create image volume from unity.
Unity-1 is operating normally but if we create image volume using Unity-2 error occur as below.
The volume is created normally in Unity-2, but cannot attach to the controller node.
Can I get some advice?
Openstack Version : Zed(kolla ansible)
Unity Cinder
cat /var/lib/docker/overlay2/7663952c08a841bc713f7439515009a7c10b0bc92410124d50de5a39b432ae7c/diff/cinder-base-source/cinder-21.1.1.dev2/cinder/volume/drivers/dell_emc/unity/driver.py | grep VERSION
VERSION = '07.02.00'
stats['driver_version'] = self.VERSION.
2023-05-08 08:52:12.043 121 ERROR cinder.volume.driver [None req-53dbc5dc-3b4e-481a-8b55-85cb882d53e6 6bbc0a2aa3c04b39ae780c19e9308e44 c2f467630b56446a98b5741bd8d4c43c - - - -] Unable to fetch connection information from backend: multiple UnityHost with name ay-openstackctrl-02 found.: storops.exception.UnityNameNotUniqueError: multiple UnityHost with name ay-openstackctrl-02 found.
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils [None req-53dbc5dc-3b4e-481a-8b55-85cb882d53e6 6bbc0a2aa3c04b39ae780c19e9308e44 c2f467630b56446a98b5741bd8d4c43c - - - -] Failed to copy image 935b4940-87f0-442f-bba7-f9d5034b061c to volume: 35a74276-2f64-45d1-b1be-348993d32f5d: cinder.exception.VolumeBackendAPIException: Bad or unexpected response from the storage volume backend API: Unable to fetch connection information from backend: multiple UnityHost with name ay-openstackctrl-02 found.
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils Traceback (most recent call last):
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils File "/var/lib/kolla/venv/lib/python3.9/site-packages/cinder/volume/driver.py", line 1046, in _attach_volume
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils conn = self.initialize_connection(volume, properties)
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils File "/var/lib/kolla/venv/lib/python3.9/site-packages/cinder/volume/drivers/dell_emc/unity/driver.py", line 219, in initialize_connection
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils conn_info = self.adapter.initialize_connection(volume, connector)
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils File "/var/lib/kolla/venv/lib/python3.9/site-packages/cinder/volume/volume_utils.py", line 1487, in trace_logging_wrapper
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils return f(*args, **kwargs)
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils File "/var/lib/kolla/venv/lib/python3.9/site-packages/cinder/volume/drivers/dell_emc/unity/adapter.py", line 537, in initialize_connection
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils return self._initialize_connection(lun, connector, volume.id [volume.id])
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils File "/var/lib/kolla/venv/lib/python3.9/site-packages/cinder/volume/drivers/dell_emc/unity/adapter.py", line 520, in _initialize_connection
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils host, hlu = self._create_host_and_attach(connector['host'],
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils File "/var/lib/kolla/venv/lib/python3.9/site-packages/cinder/volume/drivers/dell_emc/unity/adapter.py", line 516, in _create_host_and_attach
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils return _lock_helper('{unity}-{host}'.format(unity=self.client.host,
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils File "/var/lib/kolla/venv/lib/python3.9/site-packages/cinder/volume/drivers/dell_emc/unity/adapter.py", line 509, in _lock_helper
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils host = self.client.create_host(host_name)
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils File "/var/lib/kolla/venv/lib/python3.9/site-packages/decorator.py", line 232, in fun
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils return caller(func, *(extras + args), **kw)
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils File "/var/lib/kolla/venv/lib/python3.9/site-packages/cinder/coordination.py", line 200, in _synchronized
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils return f(*a, **k)
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils File "/var/lib/kolla/venv/lib/python3.9/site-packages/cinder/volume/drivers/dell_emc/unity/client.py", line 258, in create_host
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils return self.create_host_wo_lock(name)
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils File "/var/lib/kolla/venv/lib/python3.9/site-packages/cinder/volume/drivers/dell_emc/unity/client.py", line 264, in create_host_wo_lock
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils host = self.system.get_host(name=name)
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils File "/var/lib/cinder/.local/lib/python3.9/site-packages/storops/unity/resource/system.py", line 343, in get_host
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils ret = self._get_unity_rsc(UnityHostList, _id=_id, name=name,
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils File "/var/lib/cinder/.local/lib/python3.9/site-packages/storops/unity/resource/__init__.py", line 200, in _get_unity_rsc
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils raise UnityNameNotUniqueError(
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils storops.exception.UnityNameNotUniqueError: multiple UnityHost with name ay-openstackctrl-02 found.
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils During handling of the above exception, another exception occurred:
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils Traceback (most recent call last):
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils File "/var/lib/kolla/venv/lib/python3.9/site-packages/cinder/volume/volume_utils.py", line 1209, in copy_image_to_volume
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils driver.copy_image_to_volume(
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils File "/var/lib/kolla/venv/lib/python3.9/site-packages/cinder/volume/driver.py", line 855, in copy_image_to_volume
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils self._copy_image_data_to_volume(
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils File "/var/lib/kolla/venv/lib/python3.9/site-packages/cinder/volume/driver.py", line 877, in _copy_image_data_to_volume
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils attach_info, volume = self._attach_volume(context, volume, properties)
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils File "/var/lib/kolla/venv/lib/python3.9/site-packages/cinder/volume/driver.py", line 1059, in _attach_volume
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils raise exception.VolumeBackendAPIException(data=err_msg)
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils cinder.exception.VolumeBackendAPIException: Bad or unexpected response from the storage volume backend API: Unable to fetch connection information from backend: multiple UnityHost with name ay-openstackctrl-02 found.
2023-05-08 08:52:12.044 121 ERROR cinder.volume.volume_utils
[root@ay-openstackdeploy-01 ~]# cinder service-list
+------------------+-----------------------------+------+---------+-------+----------------------------+---------+-----------------+---------------+
| Binary | Host | Zone | Status | State | Updated_at | Cluster | Disabled Reason | Backend State |
+------------------+-----------------------------+------+---------+-------+----------------------------+---------+-----------------+---------------+
| cinder-backup | ay-openstackctrl-01 | nova | enabled | up | 2023-05-10T04:03:26.000000 | - | - | |
| cinder-backup | ay-openstackctrl-02 | nova | enabled | up | 2023-05-10T04:03:26.000000 | - | - | |
| cinder-backup | ay-openstackctrl-03 | nova | enabled | up | 2023-05-10T04:03:29.000000 | - | - | |
| cinder-scheduler | ay-openstackctrl-01 | nova | enabled | up | 2023-05-10T04:03:32.000000 | - | - | |
| cinder-scheduler | ay-openstackctrl-02 | nova | enabled | up | 2023-05-10T04:03:23.000000 | - | - | |
| cinder-scheduler | ay-openstackctrl-03 | nova | enabled | up | 2023-05-10T04:03:26.000000 | - | - | |
| cinder-volume | ay-openstackctrl-01@rbd-1 | nova | enabled | up | 2023-05-10T04:03:24.000000 | - | - | up |
| cinder-volume | ay-openstackctrl-01@unity-1 | nova | enabled | up | 2023-05-10T04:03:30.000000 | - | - | up |
| cinder-volume | ay-openstackctrl-01@unity-2 | nova | enabled | up | 2023-05-10T04:03:31.000000 | - | - | up |
| cinder-volume | ay-openstackctrl-02@rbd-1 | nova | enabled | up | 2023-05-10T04:03:27.000000 | - | - | up |
| cinder-volume | ay-openstackctrl-02@unity-1 | nova | enabled | up | 2023-05-10T04:03:25.000000 | - | - | up |
| cinder-volume | ay-openstackctrl-02@unity-2 | nova | enabled | up | 2023-05-10T04:03:25.000000 | - | - | up |
| cinder-volume | ay-openstackctrl-03@rbd-1 | nova | enabled | up | 2023-05-10T04:03:29.000000 | - | - | up |
| cinder-volume | ay-openstackctrl-03@unity-1 | nova | enabled | up | 2023-05-10T04:03:27.000000 | - | - | up |
| cinder-volume | ay-openstackctrl-03@unity-2 | nova | enabled | up | 2023-05-10T04:03:27.000000 | - | - | up |
+------------------+-----------------------------+------+---------+-------+----------------------------+---------+-----------------+---------------+
Hello Jaeshik Ko,
I'll bring up this bug in today's cinder bug meeting. I suspect the issue might be related to having duplicate ay-openstackctrl-02 with different Unity versions, and you'll need to define both separately. Could you please provide the cinder.conf file?
Thanks