| 2017-09-13 11:38:52 |
Yikun Jiang |
bug |
|
|
added bug |
| 2017-09-13 11:41:57 |
OpenStack Infra |
nova: status |
New |
In Progress |
|
| 2017-09-13 11:41:57 |
OpenStack Infra |
nova: assignee |
|
Yikun Jiang (yikunkero) |
|
| 2017-09-13 12:53:42 |
Yikun Jiang |
description |
Step 1 create instance in cell1
+--------------------------------------+--------+-----------+------------+-------------+---------------------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------+-----------+------------+-------------+---------------------------------+
| 84038890-8d70-45e1-8240-2303f4227e11 | yikun1 | MIGRATING | migrating | Running | public=2001:db8::a, 172.24.4.13 |
+--------------------------------------+--------+-----------+------------+-------------+---------------------------------+
Step 2 live migrate instance
nova live-migration 84038890-8d70-45e1-8240-2303f4227e11
Step 3
The instance will stuck in "MIGRATIING" state.
+--------------------------------------+--------+-----------+------------+-------------+---------------------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------+-----------+------------+-------------+---------------------------------+
| 84038890-8d70-45e1-8240-2303f4227e11 | yikun1 | MIGRATING | migrating | Running | public=2001:db8::a, 172.24.4.13 |
+--------------------------------------+--------+-----------+------------+-------------+---------------------------------+
It seems we need add @targets_cell decorator for **live_migrate_instance** methods in conductor:
https://github.com/openstack/nova/blob/master/nova/conductor/manager.py#L378
ERROR LOG:
Exception during message handling: InstanceActionNotFound: Action for request_id req-5aa03558-ae14-458e-9c35-c3d377c7ce45 on instance 84038890-8d70-45e1-8240-2303f4227e11 not found
Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 160, in _process_incoming
res = self.dispatcher.dispatch(message)
File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 213, in dispatch
return self._do_dispatch(endpoint, method, ctxt, args)
File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 183, in _do_dispatch
result = func(ctxt, **new_args)
File "/opt/stack/nova/nova/compute/utils.py", line 875, in decorated_function
with EventReporter(context, event_name, instance_uuid):
File "/opt/stack/nova/nova/compute/utils.py", line 846, in __enter__
self.context, uuid, self.event_name, want_result=False)
File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper
result = fn(cls, context, *args, **kwargs)
File "/opt/stack/nova/nova/objects/instance_action.py", line 169, in event_start
db_event = db.action_event_start(context, values)
File "/opt/stack/nova/nova/db/api.py", line 1957, in action_event_start
return IMPL.action_event_start(context, values)
File "/opt/stack/nova/nova/db/sqlalchemy/api.py", line 250, in wrapped
return f(context, *args, **kwargs)
File "/opt/stack/nova/nova/db/sqlalchemy/api.py", line 6155, in action_event_start
instance_uuid=values['instance_uuid'])
InstanceActionNotFound: Action for request_id req-5aa03558-ae14-458e-9c35-c3d377c7ce45 on instance 84038890-8d70-45e1-8240-2303f4227e11 not found |
Step 1 create instance in cell1
+--------------------------------------+--------+--------+------------+-------------+---------------------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------+--------+------------+-------------+---------------------------------+
| 84038890-8d70-45e1-8240-2303f4227e11 | yikun1 | ACTIVE | - | Running | public=2001:db8::a, 172.24.4.13 |
+--------------------------------------+--------+--------+------------+-------------+---------------------------------+
Step 2 live migrate instance
nova live-migration 84038890-8d70-45e1-8240-2303f4227e11
Step 3
The instance will stuck in "MIGRATIING" state.
+--------------------------------------+--------+-----------+------------+-------------+---------------------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------+-----------+------------+-------------+---------------------------------+
| 84038890-8d70-45e1-8240-2303f4227e11 | yikun1 | MIGRATING | migrating | Running | public=2001:db8::a, 172.24.4.13 |
+--------------------------------------+--------+-----------+------------+-------------+---------------------------------+
It seems we need add @targets_cell decorator for **live_migrate_instance** methods in conductor:
https://github.com/openstack/nova/blob/master/nova/conductor/manager.py#L378
ERROR LOG:
Exception during message handling: InstanceActionNotFound: Action for request_id req-5aa03558-ae14-458e-9c35-c3d377c7ce45 on instance 84038890-8d70-45e1-8240-2303f4227e11 not found
Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 160, in _process_incoming
res = self.dispatcher.dispatch(message)
File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 213, in dispatch
return self._do_dispatch(endpoint, method, ctxt, args)
File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 183, in _do_dispatch
result = func(ctxt, **new_args)
File "/opt/stack/nova/nova/compute/utils.py", line 875, in decorated_function
with EventReporter(context, event_name, instance_uuid):
File "/opt/stack/nova/nova/compute/utils.py", line 846, in __enter__
self.context, uuid, self.event_name, want_result=False)
File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper
result = fn(cls, context, *args, **kwargs)
File "/opt/stack/nova/nova/objects/instance_action.py", line 169, in event_start
db_event = db.action_event_start(context, values)
File "/opt/stack/nova/nova/db/api.py", line 1957, in action_event_start
return IMPL.action_event_start(context, values)
File "/opt/stack/nova/nova/db/sqlalchemy/api.py", line 250, in wrapped
return f(context, *args, **kwargs)
File "/opt/stack/nova/nova/db/sqlalchemy/api.py", line 6155, in action_event_start
instance_uuid=values['instance_uuid'])
InstanceActionNotFound: Action for request_id req-5aa03558-ae14-458e-9c35-c3d377c7ce45 on instance 84038890-8d70-45e1-8240-2303f4227e11 not found |
|
| 2017-09-13 15:16:49 |
Zhenyu Zheng |
summary |
Failed to live-migrate instance in cell1. |
Failed to live-migrate instance in cell. |
|
| 2017-09-13 19:05:21 |
Matt Riedemann |
nova: status |
In Progress |
Incomplete |
|
| 2017-09-14 08:57:00 |
OpenStack Infra |
nova: status |
Incomplete |
In Progress |
|
| 2017-09-14 09:36:51 |
Yikun Jiang |
description |
Step 1 create instance in cell1
+--------------------------------------+--------+--------+------------+-------------+---------------------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------+--------+------------+-------------+---------------------------------+
| 84038890-8d70-45e1-8240-2303f4227e11 | yikun1 | ACTIVE | - | Running | public=2001:db8::a, 172.24.4.13 |
+--------------------------------------+--------+--------+------------+-------------+---------------------------------+
Step 2 live migrate instance
nova live-migration 84038890-8d70-45e1-8240-2303f4227e11
Step 3
The instance will stuck in "MIGRATIING" state.
+--------------------------------------+--------+-----------+------------+-------------+---------------------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------+-----------+------------+-------------+---------------------------------+
| 84038890-8d70-45e1-8240-2303f4227e11 | yikun1 | MIGRATING | migrating | Running | public=2001:db8::a, 172.24.4.13 |
+--------------------------------------+--------+-----------+------------+-------------+---------------------------------+
It seems we need add @targets_cell decorator for **live_migrate_instance** methods in conductor:
https://github.com/openstack/nova/blob/master/nova/conductor/manager.py#L378
ERROR LOG:
Exception during message handling: InstanceActionNotFound: Action for request_id req-5aa03558-ae14-458e-9c35-c3d377c7ce45 on instance 84038890-8d70-45e1-8240-2303f4227e11 not found
Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 160, in _process_incoming
res = self.dispatcher.dispatch(message)
File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 213, in dispatch
return self._do_dispatch(endpoint, method, ctxt, args)
File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 183, in _do_dispatch
result = func(ctxt, **new_args)
File "/opt/stack/nova/nova/compute/utils.py", line 875, in decorated_function
with EventReporter(context, event_name, instance_uuid):
File "/opt/stack/nova/nova/compute/utils.py", line 846, in __enter__
self.context, uuid, self.event_name, want_result=False)
File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper
result = fn(cls, context, *args, **kwargs)
File "/opt/stack/nova/nova/objects/instance_action.py", line 169, in event_start
db_event = db.action_event_start(context, values)
File "/opt/stack/nova/nova/db/api.py", line 1957, in action_event_start
return IMPL.action_event_start(context, values)
File "/opt/stack/nova/nova/db/sqlalchemy/api.py", line 250, in wrapped
return f(context, *args, **kwargs)
File "/opt/stack/nova/nova/db/sqlalchemy/api.py", line 6155, in action_event_start
instance_uuid=values['instance_uuid'])
InstanceActionNotFound: Action for request_id req-5aa03558-ae14-458e-9c35-c3d377c7ce45 on instance 84038890-8d70-45e1-8240-2303f4227e11 not found |
Step 1 create instance in cell1
+--------------------------------------+--------+--------+------------+-------------+---------------------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------+--------+------------+-------------+---------------------------------+
| 84038890-8d70-45e1-8240-2303f4227e11 | yikun1 | ACTIVE | - | Running | public=2001:db8::a, 172.24.4.13 |
+--------------------------------------+--------+--------+------------+-------------+---------------------------------+
Step 2 live migrate instance
nova live-migration 84038890-8d70-45e1-8240-2303f4227e11
Step 3
The instance will stuck in "MIGRATIING" state.
+--------------------------------------+--------+-----------+------------+-------------+---------------------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------+-----------+------------+-------------+---------------------------------+
| 84038890-8d70-45e1-8240-2303f4227e11 | yikun1 | MIGRATING | migrating | Running | public=2001:db8::a, 172.24.4.13 |
+--------------------------------------+--------+-----------+------------+-------------+---------------------------------+
It seems we need add @targets_cell decorator for **live_migrate_instance** methods in conductor:
https://github.com/openstack/nova/blob/master/nova/conductor/manager.py#L378
ERROR LOG in super conductor:
Exception during message handling: InstanceActionNotFound: Action for request_id req-5aa03558-ae14-458e-9c35-c3d377c7ce45 on instance 84038890-8d70-45e1-8240-2303f4227e11 not found
Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 160, in _process_incoming
res = self.dispatcher.dispatch(message)
File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 213, in dispatch
return self._do_dispatch(endpoint, method, ctxt, args)
File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 183, in _do_dispatch
result = func(ctxt, **new_args)
File "/opt/stack/nova/nova/compute/utils.py", line 875, in decorated_function
with EventReporter(context, event_name, instance_uuid):
File "/opt/stack/nova/nova/compute/utils.py", line 846, in __enter__
self.context, uuid, self.event_name, want_result=False)
File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper
result = fn(cls, context, *args, **kwargs)
File "/opt/stack/nova/nova/objects/instance_action.py", line 169, in event_start
db_event = db.action_event_start(context, values)
File "/opt/stack/nova/nova/db/api.py", line 1957, in action_event_start
return IMPL.action_event_start(context, values)
File "/opt/stack/nova/nova/db/sqlalchemy/api.py", line 250, in wrapped
return f(context, *args, **kwargs)
File "/opt/stack/nova/nova/db/sqlalchemy/api.py", line 6155, in action_event_start
instance_uuid=values['instance_uuid'])
InstanceActionNotFound: Action for request_id req-5aa03558-ae14-458e-9c35-c3d377c7ce45 on instance 84038890-8d70-45e1-8240-2303f4227e11 not found |
|
| 2017-09-15 01:51:56 |
Yikun Jiang |
nova: status |
In Progress |
Incomplete |
|
| 2017-09-15 10:02:36 |
OpenStack Infra |
nova: status |
Incomplete |
In Progress |
|
| 2017-09-15 18:25:19 |
Matt Riedemann |
summary |
Failed to live-migrate instance in cell. |
Failed to live-migrate instance in cell with microversion >= 2.34 |
|
| 2017-09-15 18:25:23 |
Matt Riedemann |
nova: importance |
Undecided |
High |
|
| 2017-09-15 18:25:33 |
Matt Riedemann |
nominated for series |
|
nova/pike |
|
| 2017-09-15 18:25:33 |
Matt Riedemann |
bug task added |
|
nova/pike |
|
| 2017-09-15 18:25:39 |
Matt Riedemann |
nova/pike: status |
New |
Confirmed |
|
| 2017-09-15 18:25:42 |
Matt Riedemann |
nova/pike: importance |
Undecided |
High |
|
| 2017-09-15 18:25:50 |
Matt Riedemann |
tags |
|
cells live-migration |
|
| 2017-09-15 20:02:59 |
OpenStack Infra |
nova: assignee |
Yikun Jiang (yikunkero) |
Matt Riedemann (mriedem) |
|
| 2017-09-19 14:11:58 |
OpenStack Infra |
nova/pike: status |
Confirmed |
In Progress |
|
| 2017-09-19 14:11:58 |
OpenStack Infra |
nova/pike: assignee |
|
Matt Riedemann (mriedem) |
|
| 2017-09-20 15:03:57 |
OpenStack Infra |
nova: status |
In Progress |
Fix Released |
|
| 2017-09-20 17:19:03 |
OpenStack Infra |
nova/pike: status |
In Progress |
Fix Committed |
|
