There is SVF storage limiation while adding volumes to a replicated group , relation and rccg should be in same state.
If there are in different state, operation fails for GM, GMCV, MM types
stack@ubuntu18:~/cinder$ cinder group-update mnaoj_gm_grp --add-volumes 76ebda4c-256e-4721-8791-04f64b434e85
Request to update group 'mnaoj_gm_grp' has been accepted.
stack@ubuntu18:~/cinder$ cinder group-list | grep m
| ID | Status | Name |
| 23dbfc05-b4c7-4f1e-970c-21a4788144d2 | error | mnaoj_gm_grp |
| 744a4b0c-85d1-4a25-8292-a2a7201fc5a5 | available | manoj_mm_grp |
| 9b2bbfde-0a1d-4d56-9963-0ea915501d29 | available | manoj_gmcv_group |
stack@ubuntu18:~/cinder$
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR cinder.volume.drivers.ibm.storwize_svc.storwize_svc_common [req-00bd535e-e19b-41d9-a9f2-bab2631c62b6 req-7040d857-b27a-4c62-983b-19d46b680dbd admin None] Failed to update rccg rccg-23db-144d2: remote copy type of 76ebda4c-256e-4721-8791-04f64b434e85 is global, the rccg type is global. rcrel state is consistent_stopped, rccg state is consistent_synchronized. rcrel primary is master, rccg primary is master. rcrel cycling mode is none, rccg cycling mode is none. rcrel cycling period is 300, rccg cycling period is 300.
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR cinder.volume.manager [req-00bd535e-e19b-41d9-a9f2-bab2631c62b6 req-7040d857-b27a-4c62-983b-19d46b680dbd admin None] Error occurred when updating group 23dbfc05-b4c7-4f1e-970c-21a4788144d2.
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR cinder.volume.manager [req-00bd535e-e19b-41d9-a9f2-bab2631c62b6 req-7040d857-b27a-4c62-983b-19d46b680dbd admin None] Error occurred in the volume driver when updating group 23dbfc05-b4c7-4f1e-970c-21a4788144d2.: cinder.exception.VolumeDriverException: Volume driver reported an error: Error occurred when updating group 23dbfc05-b4c7-4f1e-970c-21a4788144d2.
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server [req-00bd535e-e19b-41d9-a9f2-bab2631c62b6 req-7040d857-b27a-4c62-983b-19d46b680dbd admin None] Exception during message handling: cinder.exception.VolumeDriverException: Volume driver reported an error: Error occurred when updating group 23dbfc05-b4c7-4f1e-970c-21a4788144d2.
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.6/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message)
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.6/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args)
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.6/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args)
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 3927, in update_group
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server rem_vol.save()
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.6/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server self.force_reraise()
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.6/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb)
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.6/dist-packages/six.py", line 703, in reraise
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server raise value
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 3904, in update_group
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server raise exception.VolumeDriverException(message=msg)
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server cinder.exception.VolumeDriverException: Volume driver reported an error: Error occurred when updating group 23dbfc05-b4c7-4f1e-970c-21a4788144d2.
Mar 26 08:12:33 ubuntu18 cinder-volume[21632]: ERROR oslo_messaging.rpc.server
IBM_Storwize:os2076:superuser>lsrcrelationship | grep 76ebda4c-256e-4721-8791-04f64b434e85
1981 rcrel259 00000200A04307F2 os2076 1981 volume-76ebda4c-256e-4721-8791-04f64b434e85 00000200A0406F0A os2076b 1586 aux_volume-76ebda4c-256e-4721-8791-04f64b434e85 master consistent_stopped 50 100 global none
IBM_Storwize:os2076:superuser>lsrcconsistgrp rccg-23db-144d2
id 48
name rccg-23db-144d2
master_cluster_id 00000200A04307F2
master_cluster_name os2076
aux_cluster_id 00000200A0406F0A
aux_cluster_name os2076b
primary master
state consistent_synchronized
relationship_count 1
freeze_time
status
sync
copy_type global
cycling_mode none
cycle_period_seconds 300
RC_rel_id 1972
RC_rel_name rcrel252
IBM_Storwize:os2076:superuser>chrcrelationship -consistgrp rccg-23db-144d2 rcrel259
CMMVC5968E The relationship cannot be added because the states of the relationship and the consistency group do not match.
IBM_Storwize:os2076:superuser>
There is SVF storage limiation while adding volumes to a replicated group , relation and rccg should be in same state.
If there are in different state, operation fails for GM, GMCV, MM types
stack@ubuntu18: ~/cinder$ cinder group-update mnaoj_gm_grp --add-volumes 76ebda4c- 256e-4721- 8791-04f64b434e 85 ~/cinder$ cinder group-list | grep m b4c7-4f1e- 970c-21a4788144 d2 | error | mnaoj_gm_grp | 85d1-4a25- 8292-a2a7201fc5 a5 | available | manoj_mm_grp | 0a1d-4d56- 9963-0ea915501d 29 | available | manoj_gmcv_group | ~/cinder$
Request to update group 'mnaoj_gm_grp' has been accepted.
stack@ubuntu18:
| ID | Status | Name |
| 23dbfc05-
| 744a4b0c-
| 9b2bbfde-
stack@ubuntu18:
Mar 26 08:12:33 ubuntu18 cinder- volume[ 21632]: ERROR cinder. volume. drivers. ibm.storwize_ svc.storwize_ svc_common [req-00bd535e- e19b-41d9- a9f2-bab2631c62 b6 req-7040d857- b27a-4c62- 983b-19d46b680d bd admin None] Failed to update rccg rccg-23db-144d2: remote copy type of 76ebda4c- 256e-4721- 8791-04f64b434e 85 is global, the rccg type is global. rcrel state is consistent_stopped, rccg state is consistent_ synchronized. rcrel primary is master, rccg primary is master. rcrel cycling mode is none, rccg cycling mode is none. rcrel cycling period is 300, rccg cycling period is 300. volume[ 21632]: ERROR cinder. volume. manager [req-00bd535e- e19b-41d9- a9f2-bab2631c62 b6 req-7040d857- b27a-4c62- 983b-19d46b680d bd admin None] Error occurred when updating group 23dbfc05- b4c7-4f1e- 970c-21a4788144 d2. volume[ 21632]: ERROR cinder. volume. manager [req-00bd535e- e19b-41d9- a9f2-bab2631c62 b6 req-7040d857- b27a-4c62- 983b-19d46b680d bd admin None] Error occurred in the volume driver when updating group 23dbfc05- b4c7-4f1e- 970c-21a4788144 d2.: cinder. exception. VolumeDriverExc eption: Volume driver reported an error: Error occurred when updating group 23dbfc05- b4c7-4f1e- 970c-21a4788144 d2. volume[ 21632]: ERROR oslo_messaging. rpc.server [req-00bd535e- e19b-41d9- a9f2-bab2631c62 b6 req-7040d857- b27a-4c62- 983b-19d46b680d bd admin None] Exception during message handling: cinder. exception. VolumeDriverExc eption: Volume driver reported an error: Error occurred when updating group 23dbfc05- b4c7-4f1e- 970c-21a4788144 d2. volume[ 21632]: ERROR oslo_messaging. rpc.server Traceback (most recent call last): volume[ 21632]: ERROR oslo_messaging. rpc.server File "/usr/local/ lib/python3. 6/dist- packages/ oslo_messaging/ rpc/server. py", line 165, in _process_incoming volume[ 21632]: ERROR oslo_messaging. rpc.server res = self.dispatcher .dispatch( message) volume[ 21632]: ERROR oslo_messaging. rpc.server File "/usr/local/ lib/python3. 6/dist- packages/ oslo_messaging/ rpc/dispatcher. py", line 309, in dispatch volume[ 21632]: ERROR oslo_messaging. rpc.server return self._do_ dispatch( endpoint, method, ctxt, args) volume[ 21632]: ERROR oslo_messaging. rpc.server File "/usr/local/ lib/python3. 6/dist- packages/ oslo_messaging/ rpc/dispatcher. py", line 229, in _do_dispatch volume[ 21632]: ERROR oslo_messaging. rpc.server result = func(ctxt, **new_args) volume[ 21632]: ERROR oslo_messaging. rpc.server File "/opt/stack/ cinder/ cinder/ volume/ manager. py", line 3927, in update_group volume[ 21632]: ERROR oslo_messaging. rpc.server rem_vol.save() volume[ 21632]: ERROR oslo_messaging. rpc.server File "/usr/local/ lib/python3. 6/dist- packages/ oslo_utils/ excutils. py", line 220, in __exit__ volume[ 21632]: ERROR oslo_messaging. rpc.server self.force_ reraise( ) volume[ 21632]: ERROR oslo_messaging. rpc.server File "/usr/local/ lib/python3. 6/dist- packages/ oslo_utils/ excutils. py", line 196, in force_reraise volume[ 21632]: ERROR oslo_messaging. rpc.server six.reraise( self.type_ , self.value, self.tb) volume[ 21632]: ERROR oslo_messaging. rpc.server File "/usr/local/ lib/python3. 6/dist- packages/ six.py" , line 703, in reraise volume[ 21632]: ERROR oslo_messaging. rpc.server raise value volume[ 21632]: ERROR oslo_messaging. rpc.server File "/opt/stack/ cinder/ cinder/ volume/ manager. py", line 3904, in update_group volume[ 21632]: ERROR oslo_messaging. rpc.server raise exception. VolumeDriverExc eption( message= msg) volume[ 21632]: ERROR oslo_messaging. rpc.server cinder. exception. VolumeDriverExc eption: Volume driver reported an error: Error occurred when updating group 23dbfc05- b4c7-4f1e- 970c-21a4788144 d2. volume[ 21632]: ERROR oslo_messaging. rpc.server
Mar 26 08:12:33 ubuntu18 cinder-
Mar 26 08:12:33 ubuntu18 cinder-
Mar 26 08:12:33 ubuntu18 cinder-
Mar 26 08:12:33 ubuntu18 cinder-
Mar 26 08:12:33 ubuntu18 cinder-
Mar 26 08:12:33 ubuntu18 cinder-
Mar 26 08:12:33 ubuntu18 cinder-
Mar 26 08:12:33 ubuntu18 cinder-
Mar 26 08:12:33 ubuntu18 cinder-
Mar 26 08:12:33 ubuntu18 cinder-
Mar 26 08:12:33 ubuntu18 cinder-
Mar 26 08:12:33 ubuntu18 cinder-
Mar 26 08:12:33 ubuntu18 cinder-
Mar 26 08:12:33 ubuntu18 cinder-
Mar 26 08:12:33 ubuntu18 cinder-
Mar 26 08:12:33 ubuntu18 cinder-
Mar 26 08:12:33 ubuntu18 cinder-
Mar 26 08:12:33 ubuntu18 cinder-
Mar 26 08:12:33 ubuntu18 cinder-
Mar 26 08:12:33 ubuntu18 cinder-
Mar 26 08:12:33 ubuntu18 cinder-
Mar 26 08:12:33 ubuntu18 cinder-
IBM_Storwize: os2076: superuser> lsrcrelationshi p | grep 76ebda4c- 256e-4721- 8791-04f64b434e 85 76ebda4c- 256e-4721- 8791-04f64b434e 85 00000200A0406F0A os2076b 1586 aux_volume- 76ebda4c- 256e-4721- 8791-04f64b434e 85 master consistent_stopped 50 100 global none os2076: superuser> lsrcconsistgrp rccg-23db-144d2 synchronized seconds 300 os2076: superuser> chrcrelationshi p -consistgrp rccg-23db-144d2 rcrel259 os2076: superuser>
1981 rcrel259 00000200A04307F2 os2076 1981 volume-
IBM_Storwize:
id 48
name rccg-23db-144d2
master_cluster_id 00000200A04307F2
master_cluster_name os2076
aux_cluster_id 00000200A0406F0A
aux_cluster_name os2076b
primary master
state consistent_
relationship_count 1
freeze_time
status
sync
copy_type global
cycling_mode none
cycle_period_
RC_rel_id 1972
RC_rel_name rcrel252
IBM_Storwize:
CMMVC5968E The relationship cannot be added because the states of the relationship and the consistency group do not match.
IBM_Storwize: