Deleted ironic node has an inventory in nova_api database
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
OpenStack Compute (nova) |
Fix Released
|
High
|
Chris Dent |
Bug Description
Running latest devstack, ironic and nova, I get the following error when I request an instance:
| fault | {"message": "Node 6cc8803d-
| | filter_properties) |
| | File \"/opt/
| | instance_
| | ", "created": "2017-02-
On ironic side, this node was indeed deleted, it is also deleted from nova.compute_nodes table:
| created_at | updated_at | deleted_at | id | service_id | vcpus | memory_mb | local_gb | vcpus_used | memory_mb_used | local_gb_used | hypervisor_type | hypervisor_version | cpu_info | disk_available_
.......
| 2017-02-02 12:20:27 | 2017-02-02 13:20:15 | 2017-02-02 13:21:15 | 2 | NULL | 1 | 1536 | 10 | 0 | 0 | 0 | ironic | 1 | | 10 | 1536 | 10 | 0 | 0 | 6cc8803d-
But in nova_api.
| created_at | updated_at | id | resource_
.......
| 2017-02-02 13:20:14 | NULL | 13 | 2 | 0 | 1 | 0 | 1 | 1 | 1 | 16 |
| 2017-02-02 13:20:14 | NULL | 14 | 2 | 1 | 1536 | 0 | 1 | 1536 | 1 | 1 |
| 2017-02-02 13:20:14 | NULL | 15 | 2 | 2 | 10 | 0 | 1 | 10 | 1 | 1 |
nova_api.
| created_at | updated_at | id | uuid | name | generation | can_host |
.......
| 2017-02-02 12:20:27 | 2017-02-02 13:20:14 | 2 | 035be695-
Waiting for resource tracker run did not help, node's been deleted for ~30 minutes already and the inventory is still there.
Code versions:
Devstack commit debc695ddfc8b7b
Nova commit 5dad7eaef7f8562
Ironic commit 5071b99835143eb
If it is anyhow relevant, I also run two nova-computes on the same host, I've set host=test for the second one, other than that all configs are the same. I was trying to reproduce another cell-related issue, and was creating/deleting ironic nodes, so that they map to the second nova-compute by the hash_ring.
tags: | added: ironic placement resource-tracker |
Changed in nova: | |
assignee: | nobody → Ed Leafe (ed-leafe) |
Changed in nova: | |
assignee: | Ed Leafe (ed-leafe) → Chris Dent (cdent) |
Changed in nova: | |
status: | In Progress → Fix Released |
@vdrok: Do me a favor and comment out the call to node_is_available() here:
https:/ /github. com/openstack/ nova/blob/ master/ nova/compute/ resource_ tracker. py#L414
and re-run.