Activity log for bug #1709594

Date Who What changed Old value New value Message
2017-08-09 10:40:06 Jianghua Wang bug added bug
2017-08-09 10:52:37 Jianghua Wang description The test in on XenServer. nova live-migration <VM> If we run the live-migration without the option of "--block-migrate", it will failed with error as: RemoteError: Remote error: RemoteError Remote error: CantStartEngineError No sql_connection parameter is established" - The trace for nova-conductor: Aug 09 03:26:36 DevStackOSDomU nova-conductor[1753]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/tasks/base.py", line 42, in execute Aug 09 03:26:36 DevStackOSDomU nova-conductor[1753]: ERROR nova.conductor.manager return self._execute() Aug 09 03:26:36 DevStackOSDomU nova-conductor[1753]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/tasks/live_migrate.py", line 56, in _execute Aug 09 03:26:36 DevStackOSDomU nova-conductor[1753]: ERROR nova.conductor.manager self._check_requested_destination() Aug 09 03:26:36 DevStackOSDomU nova-conductor[1753]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/tasks/live_migrate.py", line 96, in _check_requested_destination Aug 09 03:26:36 DevStackOSDomU nova-conductor[1753]: ERROR nova.conductor.manager self._call_livem_checks_on_host(self.destination) Aug 09 03:26:36 DevStackOSDomU nova-conductor[1753]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/conductor/tasks/live_migrate.py", line 147, in _call_livem_checks_on_host Aug 09 03:26:36 DevStackOSDomU nova-conductor[1753]: ERROR nova.conductor.manager destination, self.block_migration, self.disk_over_commit) Aug 09 03:26:36 DevStackOSDomU nova-conductor[1753]: ERROR nova.conductor.manager File "/opt/stack/nova/nova/compute/rpcapi.py", line 479, in check_can_live_migrate_destination Aug 09 03:26:36 DevStackOSDomU nova-conductor[1753]: ERROR nova.conductor.manager disk_over_commit=disk_over_commit) Aug 09 03:26:36 DevStackOSDomU nova-conductor[1753]: ERROR nova.conductor.manager File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 169, in call Aug 09 03:26:36 DevStackOSDomU nova-conductor[1753]: ERROR nova.conductor.manager retry=self.retry) Aug 09 03:26:36 DevStackOSDomU nova-conductor[1753]: ERROR nova.conductor.manager File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 123, in _send Aug 09 03:26:36 DevStackOSDomU nova-conductor[1753]: ERROR nova.conductor.manager timeout=timeout, retry=retry) Aug 09 03:26:36 DevStackOSDomU nova-conductor[1753]: ERROR nova.conductor.manager File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 578, in send Aug 09 03:26:36 DevStackOSDomU nova-conductor[1753]: ERROR nova.conductor.manager retry=retry) Aug 09 03:26:36 DevStackOSDomU nova-conductor[1753]: ERROR nova.conductor.manager File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 569, in _send Aug 09 03:26:36 DevStackOSDomU nova-conductor[1753]: ERROR nova.conductor.manager raise result Aug 09 03:26:36 DevStackOSDomU nova-conductor[1753]: ERROR nova.conductor.manager RemoteError: Remote error: RemoteError Remote error: CantStartEngineError No sql_connection parameter is established - The trace from nova-compute: Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 211, in decorated_function Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server kwargs['instance'], e, sys.exc_info()) Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 199, in decorated_function Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 5253, in check_can_live_migrate_destination Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server disk_over_commit) Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 5264, in _do_check_can_live_migrate_destination Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server block_migration, disk_over_commit) Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/xenapi/driver.py", line 465, in check_can_live_migrate_destination Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server disk_over_commit) Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/xenapi/vmops.py", line 2281, in check_can_live_migrate_destination Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server self._ensure_host_in_aggregate(ctxt, src) Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/xenapi/vmops.py", line 2203, in _ensure_host_in_aggregate Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server self._get_host_uuid_from_aggregate(context, hostname) Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/xenapi/vmops.py", line 2189, in _get_host_uuid_from_aggregate Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server aggregate_list = objects.AggregateList.get_by_host(context, CONF.host) Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 177, in wrapper Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server args, kwargs) Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/rpcapi.py", line 240, in object_class_action_versions Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server args=args, kwargs=kwargs) Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 169, in call Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server retry=self.retry) Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 123, in _send Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server timeout=timeout, retry=retry) Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 578, in send Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server retry=retry) Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 569, in _send Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server raise result Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server RemoteError: Remote error: CantStartEngineError No sql_connection parameter is established The test in on XenServer. nova live-migration <VM> If we run the live-migration without the option of "--block-migrate", it will failed with error as:    RemoteError: Remote error: RemoteError Remote error: CantStartEngineError No sql_connection parameter is established" - The trace for nova-conductor: Aug 09 10:12:55 DevStackOSDomU nova-conductor[13365]: line 990, in wrapper\\n with self._transaction_scope(context):\\n\', u\' File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__\\n return self.gen.next()\\n\', u\' File "/usr/local/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1040, in _transaction_scope\\n context=context) as resource:\\n\', u\' File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__\\n return self.gen.next()\\n\', u\' File "/usr/local/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 645, in _session\\n bind=self.connection, mode=self.mode)\\n\', u\' File "/usr/local/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 402, in _create_session\\n self._start()\\n\', u\' File "/usr/local/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 496, in _start\\n engine_args, maker_args)\\n\', u\' File "/usr/local/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 518, in _setup_for_connection\\n "No sql_connection parameter is established")\\n\', u\'CantStartEngineError: No sql_connection parameter is established\\n\'].\n']. - The trace from nova-compute: Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 211, in decorated_function Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server kwargs['instance'], e, sys.exc_info()) Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 199, in decorated_function Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 5253, in check_can_live_migrate_destination Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server disk_over_commit) Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 5264, in _do_check_can_live_migrate_destination Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server block_migration, disk_over_commit) Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/xenapi/driver.py", line 465, in check_can_live_migrate_destination Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server disk_over_commit) Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/xenapi/vmops.py", line 2281, in check_can_live_migrate_destination Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server self._ensure_host_in_aggregate(ctxt, src) Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/xenapi/vmops.py", line 2203, in _ensure_host_in_aggregate Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server self._get_host_uuid_from_aggregate(context, hostname) Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/xenapi/vmops.py", line 2189, in _get_host_uuid_from_aggregate Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server aggregate_list = objects.AggregateList.get_by_host(context, CONF.host) Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 177, in wrapper Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server args, kwargs) Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/rpcapi.py", line 240, in object_class_action_versions Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server args=args, kwargs=kwargs) Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 169, in call Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server retry=self.retry) Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 123, in _send Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server timeout=timeout, retry=retry) Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 578, in send Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server retry=retry) Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 569, in _send Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server raise result Aug 09 03:26:17 DevStackOSDomU nova-compute[1762]: ERROR oslo_messaging.rpc.server RemoteError: Remote error: CantStartEngineError No sql_connection parameter is established
2017-08-10 02:10:25 Matt Riedemann tags openstack-version.pike
2017-08-10 11:06:42 Sean Dague tags openstack-version.pike cellsv2 openstack-version.pike xenserver
2017-08-10 11:09:30 Sean Dague nova: status New Confirmed
2017-08-10 11:09:33 Sean Dague nova: importance Undecided High
2017-08-10 14:13:55 Matt Riedemann tags cellsv2 openstack-version.pike xenserver cellsv2 openstack-version.pike pike-rc-potential xenserver
2017-08-10 15:26:52 Matt Riedemann nova: status Confirmed Triaged
2017-08-10 15:34:37 Matt Riedemann tags cellsv2 openstack-version.pike pike-rc-potential xenserver cellsv2 openstack-version.pike xenserver
2017-08-10 15:51:42 Matt Riedemann summary live-migration without '--block-migrate" failed with "No sql_connection parameter is established" live-migration without '--block-migrate" failed with "No sql_connection parameter is established" (cells v2 aggregate up-call in superconductor mode)
2017-08-10 15:52:02 Matt Riedemann summary live-migration without '--block-migrate" failed with "No sql_connection parameter is established" (cells v2 aggregate up-call in superconductor mode) xen: live-migration without '--block-migrate" failed with "No sql_connection parameter is established" (cells v2 aggregate up-call in superconductor mode)