Masakari fails to evacuate instance when nova-compute is not down already

Bug #1883465 reported by suzhengwei
36
This bug affects 7 people
Affects Status Importance Assigned to Milestone
masakari
In Progress
High
suzhengwei

Bug Description

2020-06-13 23:25:29.873 7 DEBUG novaclient.v2.client [req-68f856fe-ede6-4823-b9fd-72675827ac3b nova - - - -] REQ: curl -g -i -X POST http://192.32.9.100:8774/v2.1/f1074a8b69d6427292b751648be45db5/servers/68452838-d850-4c6f-b431-b8ddf7819a9a/action -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA1}d0ef8321fd907ee5fe9bdc6262dfff3fe6115d5c" -H "X-OpenStack-Nova-API-Version: 2.14" -H "X-OpenStack-Request-ID: req-3734ec04-4ff4-483b-bb2e-a06377a7623e" -d '{"evacuate": {}}' _http_log_request /var/lib/kolla/venv/lib/python2.7/site-packages/keystoneauth1/session.py:448

2020-06-13 23:25:30.097 7 DEBUG novaclient.v2.client [req-68f856fe-ede6-4823-b9fd-72675827ac3b nova - - - -] RESP BODY: {"badRequest": {"message": "Compute service of node105 is still in use.", "code": 400}} _http_log_response /var/lib/kolla/venv/lib/python2.7/site-packages/keystoneauth1/session.py:511
......

4 predecessors (most recent first):
  Flow 'post_tasks'
  |__Flow 'main_tasks'
     |__Flow 'pre_tasks'
        |__Flow 'instance_evacuate_engine': HostRecoveryFailureException: Failed to evacuate instances [u'68452838-d850-4c6f-b431-b8ddf7819a9a'] from host node105.
2020-06-13 23:25:30.618 7 ERROR masakari.engine.drivers.taskflow.driver Traceback (most recent call last):
2020-06-13 23:25:30.618 7 ERROR masakari.engine.drivers.taskflow.driver File "/var/lib/kolla/venv/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task
2020-06-13 23:25:30.618 7 ERROR masakari.engine.drivers.taskflow.driver result = task.execute(**arguments)
2020-06-13 23:25:30.618 7 ERROR masakari.engine.drivers.taskflow.driver File "/var/lib/kolla/venv/lib/python2.7/site-packages/masakari/engine/drivers/taskflow/host_failure.py", line 331, in execute
2020-06-13 23:25:30.618 7 ERROR masakari.engine.drivers.taskflow.driver _do_evacuate(context, host_name, instance_list)
2020-06-13 23:25:30.618 7 ERROR masakari.engine.drivers.taskflow.driver File "/var/lib/kolla/venv/lib/python2.7/site-packages/masakari/engine/drivers/taskflow/host_failure.py", line 315, in _do_evacuate
2020-06-13 23:25:30.618 7 ERROR masakari.engine.drivers.taskflow.driver raise exception.HostRecoveryFailureException(message=msg)
2020-06-13 23:25:30.618 7 ERROR masakari.engine.drivers.taskflow.driver HostRecoveryFailureException: Failed to evacuate instances [u'68452838-d850-4c6f-b431-b8ddf7819a9a'] from host node105.
2020-06-13 23:25:30.618 7 ERROR masakari.engine.drivers.taskflow.driver

suzhengwei (sue.sam)
Changed in masakari:
assignee: nobody → suzhengwei (sue.sam)
suzhengwei (sue.sam)
Changed in masakari:
status: New → In Progress
importance: Undecided → High
Revision history for this message
Radosław Piliszek (yoctozepto) wrote : Re: Masakari fails when nova-compute is not down already

Nova throws ComputeServiceInUse ("Compute service of %(host)s is still in use.") when the host's nova-compute service is not DOWN when trying to evacuate an instance on that host.

summary: - instance-evacuate-when-host-in-use
+ Masakari fails when nova-compute is not down already
summary: - Masakari fails when nova-compute is not down already
+ Masakari fails to evacuate instance when nova-compute is not down
+ already
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.