2014-10-01 22:50:22.612 24766 ERROR nova.compute.manager [req-c7c8f643-6b3a-4ca2-99c6-be252dc12b87 fba8a3983484473ebb5caf6af441c282 04d61c2227bc448397fcbf035dd76890] [instance: fbefc220-0ef0-4c4d-a06d-31709e022e25] Setting instance vm_state to ERROR 2014-10-01 22:50:22.612 24766 TRACE nova.compute.manager [instance: fbefc220-0ef0-4c4d-a06d-31709e022e25] Traceback (most recent call last): 2014-10-01 22:50:22.612 24766 TRACE nova.compute.manager [instance: fbefc220-0ef0-4c4d-a06d-31709e022e25] File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 5538, in _error_out_instance_on_exception 2014-10-01 22:50:22.612 24766 TRACE nova.compute.manager [instance: fbefc220-0ef0-4c4d-a06d-31709e022e25] yield 2014-10-01 22:50:22.612 24766 TRACE nova.compute.manager [instance: fbefc220-0ef0-4c4d-a06d-31709e022e25] File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3117, in _confirm_resize 2014-10-01 22:50:22.612 24766 TRACE nova.compute.manager [instance: fbefc220-0ef0-4c4d-a06d-31709e022e25] rt = self._get_resource_tracker(migration.source_node) 2014-10-01 22:50:22.612 24766 TRACE nova.compute.manager [instance: fbefc220-0ef0-4c4d-a06d-31709e022e25] File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 613, in _get_resource_tracker 2014-10-01 22:50:22.612 24766 TRACE nova.compute.manager [instance: fbefc220-0ef0-4c4d-a06d-31709e022e25] "compute host.") % nodename) 2014-10-01 22:50:22.612 24766 TRACE nova.compute.manager [instance: fbefc220-0ef0-4c4d-a06d-31709e022e25] NovaException: compute2 is not a valid node managed by this compute host. 2014-10-01 22:50:22.612 24766 TRACE nova.compute.manager [instance: fbefc220-0ef0-4c4d-a06d-31709e022e25] 2014-10-01 22:50:22.747 24766 ERROR oslo.messaging.rpc.dispatcher [-] Exception during message handling: compute2 is not a valid node managed by this compute host. 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last): 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher incoming.message)) 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher return self._do_dispatch(endpoint, method, ctxt, args) 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher result = getattr(endpoint, method)(ctxt, **new_args) 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 88, in wrapped 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher payload) 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__ 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb) 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 71, in wrapped 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher return f(self, context, *args, **kw) 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 333, in decorated_function 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher function(self, context, *args, **kwargs) 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 309, in decorated_function 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher e, sys.exc_info()) 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__ 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb) 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 296, in decorated_function 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher return function(self, context, *args, **kwargs) 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3088, in confirm_resize 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher do_confirm_resize(context, instance, migration.id) 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/openstack/common/lockutils.py", line 249, in inner 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher return f(*args, **kwargs) 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3086, in do_confirm_resize 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher migration=migration) 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3117, in _confirm_resize 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher rt = self._get_resource_tracker(migration.source_node) 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 613, in _get_resource_tracker 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher "compute host.") % nodename) 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher NovaException: compute2 is not a valid node managed by this compute host. 2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.rpc.dispatcher 2014-10-01 22:50:22.750 24766 ERROR oslo.messaging._drivers.common [-] Returning exception compute2 is not a valid node managed by this compute host. to caller 2014-10-01 22:50:22.751 24766 ERROR oslo.messaging._drivers.common [-] ['Traceback (most recent call last):\n', ' File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply\n incoming.message))\n', ' File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch\n return self._do_dispatch(endpoint, method, ctxt, args)\n', ' File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch\n result = getattr(endpoint, method)(ctxt, **new_args)\n', ' File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 88, in wrapped\n payload)\n', ' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__\n six.reraise(self.type_, self.value, self.tb)\n', ' File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 71, in wrapped\n return f(self, context, *args, **kw)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 333, in decorated_function\n function(self, context, *args, **kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 309, in decorated_function\n e, sys.exc_info())\n', ' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__\n six.reraise(self.type_, self.value, self.tb)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 296, in decorated_function\n return function(self, context, *args, **kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3088, in confirm_resize\n do_confirm_resize(context, instance, migration.id)\n', ' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/lockutils.py", line 249, in inner\n return f(*args, **kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3086, in do_confirm_resize\n migration=migration)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3117, in _confirm_resize\n rt = self._get_resource_tracker(migration.source_node)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 613, in _get_resource_tracker\n "compute host.") % nodename)\n', 'NovaException: compute2 is not a valid node managed by this compute host.\n']
2014-10-01 22:50:22.612 24766 ERROR nova.compute. manager [req-c7c8f643- 6b3a-4ca2- 99c6-be252dc12b 87 fba8a3983484473 ebb5caf6af441c2 82 04d61c2227bc448 397fcbf035dd768 90] [instance: fbefc220- 0ef0-4c4d- a06d-31709e022e 25] Setting instance vm_state to ERROR manager [instance: fbefc220- 0ef0-4c4d- a06d-31709e022e 25] Traceback (most recent call last): manager [instance: fbefc220- 0ef0-4c4d- a06d-31709e022e 25] File "/usr/lib/ python2. 7/dist- packages/ nova/compute/ manager. py", line 5538, in _error_ out_instance_ on_exception manager [instance: fbefc220- 0ef0-4c4d- a06d-31709e022e 25] yield manager [instance: fbefc220- 0ef0-4c4d- a06d-31709e022e 25] File "/usr/lib/ python2. 7/dist- packages/ nova/compute/ manager. py", line 3117, in _confirm_resize manager [instance: fbefc220- 0ef0-4c4d- a06d-31709e022e 25] rt = self._get_ resource_ tracker( migration. source_ node) manager [instance: fbefc220- 0ef0-4c4d- a06d-31709e022e 25] File "/usr/lib/ python2. 7/dist- packages/ nova/compute/ manager. py", line 613, in _get_resource_ tracker manager [instance: fbefc220- 0ef0-4c4d- a06d-31709e022e 25] "compute host.") % nodename) manager [instance: fbefc220- 0ef0-4c4d- a06d-31709e022e 25] NovaException: compute2 is not a valid node managed by this compute host. manager [instance: fbefc220- 0ef0-4c4d- a06d-31709e022e 25] rpc.dispatcher [-] Exception during message handling: compute2 is not a valid node managed by this compute host. rpc.dispatcher Traceback (most recent call last): rpc.dispatcher File "/usr/lib/ python2. 7/dist- packages/ oslo/messaging/ rpc/dispatcher. py", line 133, in _dispatch_and_reply rpc.dispatcher incoming.message)) rpc.dispatcher File "/usr/lib/ python2. 7/dist- packages/ oslo/messaging/ rpc/dispatcher. py", line 176, in _dispatch rpc.dispatcher return self._do_ dispatch( endpoint, method, ctxt, args) rpc.dispatcher File "/usr/lib/ python2. 7/dist- packages/ oslo/messaging/ rpc/dispatcher. py", line 122, in _do_dispatch rpc.dispatcher result = getattr(endpoint, method)(ctxt, **new_args) rpc.dispatcher File "/usr/lib/ python2. 7/dist- packages/ nova/exception. py", line 88, in wrapped rpc.dispatcher payload) rpc.dispatcher File "/usr/lib/ python2. 7/dist- packages/ nova/openstack/ common/ excutils. py", line 68, in __exit__ rpc.dispatcher six.reraise( self.type_ , self.value, self.tb) rpc.dispatcher File "/usr/lib/ python2. 7/dist- packages/ nova/exception. py", line 71, in wrapped rpc.dispatcher return f(self, context, *args, **kw) rpc.dispatcher File "/usr/lib/ python2. 7/dist- packages/ nova/compute/ manager. py", line 333, in decorated_function rpc.dispatcher function(self, context, *args, **kwargs) rpc.dispatcher File "/usr/lib/ python2. 7/dist- packages/ nova/compute/ manager. py", line 309, in decorated_function rpc.dispatcher e, sys.exc_info()) rpc.dispatcher File "/usr/lib/ python2. 7/dist- packages/ nova/openstack/ common/ excutils. py", line 68, in __exit__ rpc.dispatcher six.reraise( self.type_ , self.value, self.tb) rpc.dispatcher File "/usr/lib/ python2. 7/dist- packages/ nova/compute/ manager. py", line 296, in decorated_function rpc.dispatcher return function(self, context, *args, **kwargs) rpc.dispatcher File "/usr/lib/ python2. 7/dist- packages/ nova/compute/ manager. py", line 3088, in confirm_resize rpc.dispatcher do_confirm_ resize( context, instance, migration.id) rpc.dispatcher File "/usr/lib/ python2. 7/dist- packages/ nova/openstack/ common/ lockutils. py", line 249, in inner rpc.dispatcher return f(*args, **kwargs) rpc.dispatcher File "/usr/lib/ python2. 7/dist- packages/ nova/compute/ manager. py", line 3086, in do_confirm_resize rpc.dispatcher migration= migration) rpc.dispatcher File "/usr/lib/ python2. 7/dist- packages/ nova/compute/ manager. py", line 3117, in _confirm_resize rpc.dispatcher rt = self._get_ resource_ tracker( migration. source_ node) rpc.dispatcher File "/usr/lib/ python2. 7/dist- packages/ nova/compute/ manager. py", line 613, in _get_resource_ tracker rpc.dispatcher "compute host.") % nodename) rpc.dispatcher NovaException: compute2 is not a valid node managed by this compute host. rpc.dispatcher _drivers. common [-] Returning exception compute2 is not a valid node managed by this compute host. to caller _drivers. common [-] ['Traceback (most recent call last):\n', ' File "/usr/lib/ python2. 7/dist- packages/ oslo/messaging/ rpc/dispatcher. py", line 133, in _dispatch_ and_reply\ n incoming. message) )\n', ' File "/usr/lib/ python2. 7/dist- packages/ oslo/messaging/ rpc/dispatcher. py", line 176, in _dispatch\n return self._do_ dispatch( endpoint, method, ctxt, args)\n', ' File "/usr/lib/ python2. 7/dist- packages/ oslo/messaging/ rpc/dispatcher. py", line 122, in _do_dispatch\n result = getattr(endpoint, method)(ctxt, **new_args)\n', ' File "/usr/lib/ python2. 7/dist- packages/ nova/exception. py", line 88, in wrapped\n payload)\n', ' File "/usr/lib/ python2. 7/dist- packages/ nova/openstack/ common/ excutils. py", line 68, in __exit__\n six.reraise( self.type_ , self.value, self.tb)\n', ' File "/usr/lib/ python2. 7/dist- packages/ nova/exception. py", line 71, in wrapped\n return f(self, context, *args, **kw)\n', ' File "/usr/lib/ python2. 7/dist- packages/ nova/compute/ manager. py", line 333, in decorated_ function\ n function(self, context, *args, **kwargs)\n', ' File "/usr/lib/ python2. 7/dist- packages/ nova/compute/ manager. py", line 309, in decorated_ function\ n e, sys.exc_info())\n', ' File "/usr/lib/ python2. 7/dist- packages/ nova/openstack/ common/ excutils. py", line 68, in __exit__\n six.reraise( self.type_ , self.value, self.tb)\n', ' File "/usr/lib/ python2. 7/dist- packages/ nova/compute/ manager. py", line 296, in decorated_ function\ n return function(self, context, *args, **kwargs)\n', ' File "/usr/lib/ python2. 7/dist- packages/ nova/compute/ manager. py", line 3088, in confirm_resize\n do_confirm_ resize( context, instance, migration.id)\n', ' File "/usr/lib/ python2. 7/dist- packages/ nova/openstack/ common/ lockutils. py", line 249, in inner\n return f(*args, **kwargs)\n', ' File "/usr/lib/ python2. 7/dist- packages/ nova/compute/ manager. py", line 3086, in do_confirm_resize\n migration= migration) \n', ' File "/usr/lib/ python2. 7/dist- packages/ nova/compute/ manager. py", line 3117, in _confirm_resize\n rt = self._get_ resource_ tracker( migration. source_ node)\n' , ' File "/usr/lib/ python2. 7/dist- packages/ nova/compute/ manager. py", line 613, in _get_resource_ tracker\ n "compute host.") % nodename)\n', 'NovaException: compute2 is not a valid node managed by this compute host.\n']
2014-10-01 22:50:22.612 24766 TRACE nova.compute.
2014-10-01 22:50:22.612 24766 TRACE nova.compute.
2014-10-01 22:50:22.612 24766 TRACE nova.compute.
2014-10-01 22:50:22.612 24766 TRACE nova.compute.
2014-10-01 22:50:22.612 24766 TRACE nova.compute.
2014-10-01 22:50:22.612 24766 TRACE nova.compute.
2014-10-01 22:50:22.612 24766 TRACE nova.compute.
2014-10-01 22:50:22.612 24766 TRACE nova.compute.
2014-10-01 22:50:22.612 24766 TRACE nova.compute.
2014-10-01 22:50:22.747 24766 ERROR oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.747 24766 TRACE oslo.messaging.
2014-10-01 22:50:22.750 24766 ERROR oslo.messaging.
2014-10-01 22:50:22.751 24766 ERROR oslo.messaging.