This looks pretty bad in the c-vol logs on the new side around the time that we're trying to delete the cinder server:
http://logs.openstack.org/40/402140/7/check/gate-grenade-dsvm-neutron-multinode-ubuntu-xenial/ad0cf41/logs/new/screen-c-vol.txt.gz?level=TRACE
2016-12-05 09:05:33.071 ERROR oslo_service.service [req-24b2e43c-5d5e-4d60-823c-7c7f73060e7c None] Error starting thread. 2016-12-05 09:05:33.071 10423 ERROR oslo_service.service Traceback (most recent call last): 2016-12-05 09:05:33.071 10423 ERROR oslo_service.service File "/usr/local/lib/python2.7/dist-packages/oslo_service/service.py", line 722, in run_service 2016-12-05 09:05:33.071 10423 ERROR oslo_service.service service.start() 2016-12-05 09:05:33.071 10423 ERROR oslo_service.service File "/opt/stack/new/cinder/cinder/service.py", line 239, in start 2016-12-05 09:05:33.071 10423 ERROR oslo_service.service service_id=Service.service_id) 2016-12-05 09:05:33.071 10423 ERROR oslo_service.service File "/opt/stack/new/cinder/cinder/volume/manager.py", line 461, in init_host 2016-12-05 09:05:33.071 10423 ERROR oslo_service.service self.publish_service_capabilities(ctxt) 2016-12-05 09:05:33.071 10423 ERROR oslo_service.service File "/opt/stack/new/cinder/cinder/volume/manager.py", line 2018, in publish_service_capabilities 2016-12-05 09:05:33.071 10423 ERROR oslo_service.service self._publish_service_capabilities(context) 2016-12-05 09:05:33.071 10423 ERROR oslo_service.service File "/opt/stack/new/cinder/cinder/manager.py", line 181, in _publish_service_capabilities 2016-12-05 09:05:33.071 10423 ERROR oslo_service.service self.last_capabilities) 2016-12-05 09:05:33.071 10423 ERROR oslo_service.service File "/opt/stack/new/cinder/cinder/scheduler/rpcapi.py", line 149, in notify_service_capabilities 2016-12-05 09:05:33.071 10423 ERROR oslo_service.service capabilities=capabilities) 2016-12-05 09:05:33.071 10423 ERROR oslo_service.service File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 144, in cast 2016-12-05 09:05:33.071 10423 ERROR oslo_service.service self._check_version_cap(msg.get('version')) 2016-12-05 09:05:33.071 10423 ERROR oslo_service.service File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 121, in _check_version_cap 2016-12-05 09:05:33.071 10423 ERROR oslo_service.service version_cap=self.version_cap) 2016-12-05 09:05:33.071 10423 ERROR oslo_service.service RPCVersionCapError: Requested message version, 3.1 is incompatible. It needs to be equal in major version and less than or equal in minor version as the specified version cap 3.0. 2016-12-05 09:05:33.071 10423 ERROR oslo_service.service
This looks pretty bad in the c-vol logs on the new side around the time that we're trying to delete the cinder server:
http:// logs.openstack. org/40/ 402140/ 7/check/ gate-grenade- dsvm-neutron- multinode- ubuntu- xenial/ ad0cf41/ logs/new/ screen- c-vol.txt. gz?level= TRACE
2016-12-05 09:05:33.071 ERROR oslo_service. service [req-24b2e43c- 5d5e-4d60- 823c-7c7f73060e 7c None] Error starting thread. service Traceback (most recent call last): service File "/usr/local/ lib/python2. 7/dist- packages/ oslo_service/ service. py", line 722, in run_service service service.start() service File "/opt/stack/ new/cinder/ cinder/ service. py", line 239, in start service service_ id=Service. service_ id) service File "/opt/stack/ new/cinder/ cinder/ volume/ manager. py", line 461, in init_host service self.publish_ service_ capabilities( ctxt) service File "/opt/stack/ new/cinder/ cinder/ volume/ manager. py", line 2018, in publish_ service_ capabilities service self._publish_ service_ capabilities( context) service File "/opt/stack/ new/cinder/ cinder/ manager. py", line 181, in _publish_ service_ capabilities service self.last_ capabilities) service File "/opt/stack/ new/cinder/ cinder/ scheduler/ rpcapi. py", line 149, in notify_ service_ capabilities service capabilities= capabilities) service File "/usr/local/ lib/python2. 7/dist- packages/ oslo_messaging/ rpc/client. py", line 144, in cast service self._check_ version_ cap(msg. get('version' )) service File "/usr/local/ lib/python2. 7/dist- packages/ oslo_messaging/ rpc/client. py", line 121, in _check_version_cap service version_ cap=self. version_ cap) service RPCVersionCapError: Requested message version, 3.1 is incompatible. It needs to be equal in major version and less than or equal in minor version as the specified version cap 3.0. service
2016-12-05 09:05:33.071 10423 ERROR oslo_service.
2016-12-05 09:05:33.071 10423 ERROR oslo_service.
2016-12-05 09:05:33.071 10423 ERROR oslo_service.
2016-12-05 09:05:33.071 10423 ERROR oslo_service.
2016-12-05 09:05:33.071 10423 ERROR oslo_service.
2016-12-05 09:05:33.071 10423 ERROR oslo_service.
2016-12-05 09:05:33.071 10423 ERROR oslo_service.
2016-12-05 09:05:33.071 10423 ERROR oslo_service.
2016-12-05 09:05:33.071 10423 ERROR oslo_service.
2016-12-05 09:05:33.071 10423 ERROR oslo_service.
2016-12-05 09:05:33.071 10423 ERROR oslo_service.
2016-12-05 09:05:33.071 10423 ERROR oslo_service.
2016-12-05 09:05:33.071 10423 ERROR oslo_service.
2016-12-05 09:05:33.071 10423 ERROR oslo_service.
2016-12-05 09:05:33.071 10423 ERROR oslo_service.
2016-12-05 09:05:33.071 10423 ERROR oslo_service.
2016-12-05 09:05:33.071 10423 ERROR oslo_service.
2016-12-05 09:05:33.071 10423 ERROR oslo_service.
2016-12-05 09:05:33.071 10423 ERROR oslo_service.