Comment 0 for bug 1922013

Revision history for this message
katari manoj kumar (katarimanojkumar) wrote : IBM SVF driver: Add vols to a group (consitent_group_replication enabled) fails at time if rccg and rcrel are in different states.

There is SVF storage limiation while adding volumes to a replicated group , relation and rccg should be in same state.

If there are in different state, operation fails for GM, GMCV, MM types

stack@ubuntu18:~/cinder$ cinder group-update mnaoj_gm_grp --add-volumes 76ebda4c-256e-4721-8791-04f64b434e85
Request to update group 'mnaoj_gm_grp' has been accepted.
stack@ubuntu18:~/cinder$ cinder group-list | grep m
| ID | Status | Name |
| 23dbfc05-b4c7-4f1e-970c-21a4788144d2 | error | mnaoj_gm_grp |
| 744a4b0c-85d1-4a25-8292-a2a7201fc5a5 | available | manoj_mm_grp |
| 9b2bbfde-0a1d-4d56-9963-0ea915501d29 | available | manoj_gmcv_group |
stack@ubuntu18:~/cinder$

Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR cinder.volume.drivers.ibm.storwize_svc.storwize_svc_common [req-00bd535e-e19b-41d9-a9f2-bab2631c62b6 req-7040d857-b27a-4c62-983b-19d46b680dbd admin None] Failed to update rccg rccg-23db-144d2: remote copy type of 76ebda4c-256e-4721-8791-04f64b434e85 is global, the rccg type is global. rcrel state is consistent_stopped, rccg state is consistent_synchronized. rcrel primary is master, rccg primary is master. rcrel cycling mode is none, rccg cycling mode is none. rcrel cycling period is 300, rccg cycling period is 300.
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR cinder.volume.manager [req-00bd535e-e19b-41d9-a9f2-bab2631c62b6 req-7040d857-b27a-4c62-983b-19d46b680dbd admin None] Error occurred when updating group 23dbfc05-b4c7-4f1e-970c-21a4788144d2.
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR cinder.volume.manager [req-00bd535e-e19b-41d9-a9f2-bab2631c62b6 req-7040d857-b27a-4c62-983b-19d46b680dbd admin None] Error occurred in the volume driver when updating group 23dbfc05-b4c7-4f1e-970c-21a4788144d2.: cinder.exception.VolumeDriverException: Volume driver reported an error: Error occurred when updating group 23dbfc05-b4c7-4f1e-970c-21a4788144d2.
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server [req-00bd535e-e19b-41d9-a9f2-bab2631c62b6 req-7040d857-b27a-4c62-983b-19d46b680dbd admin None] Exception during message handling: cinder.exception.VolumeDriverException: Volume driver reported an error: Error occurred when updating group 23dbfc05-b4c7-4f1e-970c-21a4788144d2.
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.6/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message)
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.6/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args)
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.6/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args)
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 3927, in update_group
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server rem_vol.save()
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.6/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server self.force_reraise()
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.6/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb)
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.6/dist-packages/six.py", line 703, in reraise
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server raise value
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 3904, in update_group
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server raise exception.VolumeDriverException(message=msg)
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server cinder.exception.VolumeDriverException: Volume driver reported an error: Error occurred when updating group 23dbfc05-b4c7-4f1e-970c-21a4788144d2.
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server

IBM_Storwize:os2076:superuser>lsrcrelationship | grep 76ebda4c-256e-4721-8791-04f64b434e85
1981 rcrel259 00000200A04307F2 os2076 1981 volume-76ebda4c-256e-4721-8791-04f64b434e85 00000200A0406F0A os2076b 1586 aux_volume-76ebda4c-256e-4721-8791-04f64b434e85 master consistent_stopped 50 100 global none
IBM_Storwize:os2076:superuser>lsrcconsistgrp rccg-23db-144d2
id 48
name rccg-23db-144d2
master_cluster_id 00000200A04307F2
master_cluster_name os2076
aux_cluster_id 00000200A0406F0A
aux_cluster_name os2076b
primary master
state consistent_synchronized
relationship_count 1
freeze_time
status
sync
copy_type global
cycling_mode none
cycle_period_seconds 300
RC_rel_id 1972
RC_rel_name rcrel252
IBM_Storwize:os2076:superuser>chrcrelationship -consistgrp rccg-23db-144d2 rcrel259
CMMVC5968E The relationship cannot be added because the states of the relationship and the consistency group do not match.
IBM_Storwize:os2076:superuser>