Activity log for bug #1595962

Date Who What changed Old value New value Message
2016-06-24 14:05:23 Markus Zoeller (markus_z) bug added bug
2016-06-24 14:05:59 Markus Zoeller (markus_z) tags libvirt live-migration
2016-06-28 16:40:00 Markus Zoeller (markus_z) description Description =========== If the graphical consoles VNC and SPICE are disabled, the live-migration of an instance will result in an ERROR state. Steps to reproduce ================== A chronological list of steps which will bring off the issue you noticed: * disable VNC in the "nova.conf" [VNC] enabled=False * launch an instance * live migrate this instance to another compute node Expected result =============== The instance will be on the destination host. Actual result ============= The instance is still on the source host and has the status "ERROR" and task "MIGRATING". Environment =========== 1. Master (Newton cycle) - 2016-06-20 974b158 Merge "Tear down of os-disk-config part 2" 2. libvirt 1.3.3 + qemu 2.6.0 2. IBM Storewize V7K cinder.volume.drivers.ibm.storwize_svc.storwize_svc_fc.StorwizeSVCFCDriver 3. Neutron with OVS Logs & Configs ============== 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server [req-76217a6e-d28c-4487-b36d-6660fc0b4b21 admin demo] Exception during message handling 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server Traceback (most recent call last): 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 133, in _process_incoming 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 150, in dispatch 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 121, in _do_dispatch 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception.py", line 104, in wrapped 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server payload) 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 221, in __exit__ 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server self.force_reraise() 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 197, in force_reraise 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception.py", line 83, in wrapped 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw) 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 233, in decorated_function 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 211, in decorated_function 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server kwargs['instance'], e, sys.exc_info()) 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 221, in __exit__ 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server self.force_reraise() 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 197, in force_reraise 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 199, in decorated_function 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 5033, in check_can_live_migrate_source 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server block_device_info) 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 5442, in check_can_live_migrate_source 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server self._verify_serial_console_is_disabled() 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 5826, in _verify_serial_console_is_disabled 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server raise exception.MigrationError(reason=msg) 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server MigrationError: Migration error: Your libvirt version does not support the VIR_DOMAIN_XML_MIGRATABLE flag or your destination node does not support retrieving listen addresses. In order for live migration to work properly you must either disable serial console or upgrade your libvirt version. Description =========== If the graphical consoles VNC and SPICE are disabled, the live-migration of an instance will result in an ERROR state. Steps to reproduce ================== A chronological list of steps which will bring off the issue you noticed: * disable VNC in the "nova.conf"   [VNC]   enabled=False * enabled the serial console in "nova.conf" [serial_console] enabled=True * launch an instance * live migrate this instance to another compute node Expected result =============== The instance will be on the destination host. Actual result ============= The instance is still on the source host and has the status "ERROR" and task "MIGRATING". Environment =========== 1. Master (Newton cycle) - 2016-06-20    974b158 Merge "Tear down of os-disk-config part 2" 2. libvirt 1.3.3 + qemu 2.6.0 2. IBM Storewize V7K    cinder.volume.drivers.ibm.storwize_svc.storwize_svc_fc.StorwizeSVCFCDriver 3. Neutron with OVS Logs & Configs ============== 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server [req-76217a6e-d28c-4487-b36d-6660fc0b4b21 admin demo] Exception during message handling 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server Traceback (most recent call last): 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 133, in _process_incoming 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 150, in dispatch 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 121, in _do_dispatch 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception.py", line 104, in wrapped 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server payload) 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 221, in __exit__ 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server self.force_reraise() 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 197, in force_reraise 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception.py", line 83, in wrapped 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw) 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 233, in decorated_function 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 211, in decorated_function 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server kwargs['instance'], e, sys.exc_info()) 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 221, in __exit__ 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server self.force_reraise() 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 197, in force_reraise 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 199, in decorated_function 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 5033, in check_can_live_migrate_source 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server block_device_info) 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 5442, in check_can_live_migrate_source 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server self._verify_serial_console_is_disabled() 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 5826, in _verify_serial_console_is_disabled 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server raise exception.MigrationError(reason=msg) 2016-06-24 11:03:18.784 75155 ERROR oslo_messaging.rpc.server MigrationError: Migration error: Your libvirt version does not support the VIR_DOMAIN_XML_MIGRATABLE flag or your destination node does not support retrieving listen addresses. In order for live migration to work properly you must either disable serial console or upgrade your libvirt version.
2016-06-28 16:51:15 Markus Zoeller (markus_z) tags libvirt live-migration libvirt live-migration needs-functional-test
2016-06-28 17:03:44 OpenStack Infra nova: status New In Progress
2016-06-28 17:03:44 OpenStack Infra nova: assignee Markus Zoeller (markus_z) (mzoeller)
2016-09-02 13:39:15 Markus Zoeller (markus_z) tags libvirt live-migration needs-functional-test libvirt live-migration needs-functional-test newton-rc-potential
2016-09-05 09:00:19 Sylvain Bauza nova: importance Undecided Medium
2016-09-13 15:12:39 Matt Riedemann tags libvirt live-migration needs-functional-test newton-rc-potential libvirt live-migration needs-functional-test
2016-09-13 15:13:05 Matt Riedemann marked as duplicate 1615613