Activity log for bug #1379581

Date Who What changed Old value New value Message
2014-10-10 00:46:45 Charlotte Han bug added bug
2014-10-13 01:38:26 Charlotte Han summary live migration (block migration) fails at post_live_migration_at_destination function, but the status of this instance is still "migrating", live migration (block migration) fails at post_live_migration_at_destination function, but the status of this instance is still "migrating".
2014-10-13 20:38:06 Joe Gordon nova: status New Incomplete
2014-10-16 00:33:09 Charlotte Han nova: status Incomplete New
2014-10-16 11:07:38 Charlotte Han description I have two compute node, host opencos114-93 and host opencos179-24. A migration failed at function of " post_live_migration_at_destination", but the status of this instance is still migrating. the log is as follow: 2014-10-09 19:25:00.678 32360 ERROR oslo.messaging.rpc.dispatcher [-] Exception during message handling: Unexpected vif_type=binding_failed 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last): 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher incoming.message)) 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher return self._do_dispatch(endpoint, method, ctxt, args) 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher result = getattr(endpoint, method)(ctxt, **new_args) 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 401, in decorated_function 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher return function(self, context, *args, **kwargs) 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/exception.py", line 88, in wrapped 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher payload) 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__ 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb) 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/exception.py", line 71, in wrapped 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher return f(self, context, *args, **kw) 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 311, in decorated_function 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher e, sys.exc_info()) 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__ 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb) 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 298, in decorated_function 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher return function(self, context, *args, **kwargs) 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 4740, in post_live_migration_at_destination 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher block_migration, block_device_info) 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4901, in post_live_migration_at_destination 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher write_to_disk=True) 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 3602, in to_xml 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher disk_info, rescue, block_device_info) 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 3400, in get_guest_config 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher flavor) 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/vif.py", line 481, in get_config 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher _("Unexpected vif_type=%s") % vif_type) 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher NovaException: Unexpected vif_type=binding_failed 2014-10-09 19:25:00.678 32360 TRACE oslo.messaging.rpc.dispatcher 2014-10-09 19:25:00.679 32360 ERROR oslo.messaging._drivers.common [-] Returning exception Unexpected vif_type=binding_failed to caller 2014-10-09 19:25:00.679 32360 ERROR oslo.messaging._drivers.common [-] ['Traceback (most recent call last):\n', ' File "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply\n incoming.message))\n', ' File "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch\n return self._do_dispatch(endpoint, method, ctxt, args)\n', ' File "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch\n result = getattr(endpoint, method)(ctxt, **new_args)\n', ' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 401, in decorated_function\n return function(self, context, *args, **kwargs)\n', ' File "/usr/lib/python2.7/site-packages/nova/exception.py", line 88, in wrapped\n payload)\n', ' File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__\n six.reraise(self.type_, self.value, self.tb)\n', ' File "/usr/lib/python2.7/site-packages/nova/exception.py", line 71, in wrapped\n return f(self, context, *args, **kw)\n', ' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 311, in decorated_function\n e, sys.exc_info())\n', ' File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__\n six.reraise(self.type_, self.value, self.tb)\n', ' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 298, in decorated_function\n return function(self, context, *args, **kwargs)\n', ' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 4740, in post_live_migration_at_destination\n block_migration, block_device_info)\n', ' File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4901, in post_live_migration_at_destination\n write_to_disk=True)\n', ' File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 3602, in to_xml\n disk_info, rescue, block_device_info)\n', ' File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 3400, in get_guest_config\n flavor)\n', ' File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/vif.py", line 481, in get_config\n _("Unexpected vif_type=%s") % vif_type)\n', 'NovaException: Unexpected vif_type=binding_failed\n'] 2014-10-09 19:25:39.596 32360 AUDIT nova.compute.resource_tracker [req-80344faa-4327-4a56-8bef-7af77e23cb32 None None] Auditing locally available compute resources 2014-10-09 19:25:39.811 32360 AUDIT nova.compute.resource_tracker [req-80344faa-4327-4a56-8bef-7af77e23cb32 None None] Free ram (MB): 1342 2014-10-09 19:25:39.811 32360 AUDIT nova.compute.resource_tracker [req-80344faa-4327-4a56-8bef-7af77e23cb32 None None] Free disk (GB): 47 2014-10-09 19:25:39.812 32360 AUDIT nova.compute.resource_tracker [req-80344faa-4327-4a56-8bef-7af77e23cb32 None None] Free VCPUS: 2 2014-10-09 19:25:39.855 32360 INFO nova.compute.resource_tracker [req-80344faa-4327-4a56-8bef-7af77e23cb32 None None] Compute_service record updated for opencos114-93:opencos114-93 2014-10-09 19:25:39.919 32360 WARNING nova.compute.manager [req-80344faa-4327-4a56-8bef-7af77e23cb32 None None] Found 0 in the database and 1 on the hypervisor. 2014-10-09 19:26:39.709 32360 AUDIT nova.compute.resource_tracker [req-80344faa-4327-4a56-8bef-7af77e23cb32 None None] Auditing locally available compute resources 2014-10-09 19:26:39.897 32360 AUDIT nova.compute.resource_tracker [req-80344faa-4327-4a56-8bef-7af77e23cb32 None None] Free ram (MB): 1342 2014-10-09 19:26:39.897 32360 AUDIT nova.compute.resource_tracker [req-80344faa-4327-4a56-8bef-7af77e23cb32 None None] Free disk (GB): 47 2014-10-09 19:26:39.897 32360 AUDIT nova.compute.resource_tracker [req-80344faa-4327-4a56-8bef-7af77e23cb32 None None] Free VCPUS: 2 2014-10-09 19:26:39.940 32360 INFO nova.compute.resource_tracker [req-80344faa-4327-4a56-8bef-7af77e23cb32 None None] Compute_service record updated for opencos114-93:opencos114-93 2014-10-09 19:26:40.001 32360 WARNING nova.compute.manager [req-80344faa-4327-4a56-8bef-7af77e23cb32 None None] Found 0 in the database and 1 on the hypervisor. I have two compute node, host opencos114-93 and host opencos179-24. A migration failed at function of " post_live_migration_at_destination", but the status of this instance is still migrating. Log is as follows: http://paste.openstack.org/show/121143/
2014-10-17 21:18:44 Joe Gordon tags network
2014-10-21 11:49:25 John Garbutt nova: importance Undecided High
2014-10-21 11:49:29 John Garbutt nova: status New In Progress
2014-10-21 11:49:31 John Garbutt nova: assignee John Garbutt (johngarbutt)
2014-10-21 11:50:33 John Garbutt tags network compute live-migrate network
2015-01-30 08:56:48 Pawel Koniszewski bug added subscriber Pawel Koniszewski
2015-05-17 10:33:51 Xav Paice bug added subscriber Xav Paice
2015-05-18 02:17:20 Charlotte Han nova: assignee John Garbutt (johngarbutt) Rong Han ZTE (hanrong)
2015-08-25 04:45:00 Tomoko Inoue bug added subscriber Tomoko Inoue
2015-10-13 13:33:29 Pawel Koniszewski nova: assignee Rong Han ZTE (hanrong) Pawel Koniszewski (pawel-koniszewski)
2015-11-06 16:49:56 Paul Murray tags compute live-migrate network compute live-migration network
2015-12-31 01:04:46 Eli Qiao bug added subscriber Eli Qiao
2016-02-18 15:01:54 OpenStack Infra nova: status In Progress Fix Released
2016-08-22 07:56:22 Pawel Koniszewski nominated for series nova/mitaka
2016-08-24 01:27:05 OpenStack Infra tags compute live-migration network compute in-stable-liberty live-migration network