Host is not mapped to any cell when booting instance
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
kolla-ansible |
Fix Released
|
High
|
Mark Goddard | ||
Pike |
New
|
High
|
Unassigned | ||
Queens |
Fix Committed
|
High
|
Mark Goddard | ||
Rocky |
Fix Committed
|
High
|
Mark Goddard | ||
Stein |
Fix Released
|
High
|
Radosław Piliszek | ||
Train |
Fix Released
|
High
|
Mark Goddard |
Bug Description
Error when booting instance: Host 'xyz' is not mapped to any cell
Example log with failure: http://
Affected branches: all supported (incl. master)
Problem analysis:
Nova deployment does not wait for computes to be up before discovery.
See: https:/
The problem has been exacerbated by merging fix for nova race condition:
https:/
https:/
There are two proposed fix approaches (both WIP):
(yoctozepto) https:/
(mgoddard) https:/
Gerrit topic: bug/1835002
https:/
We should care for ironic too.
Changed in kolla-ansible: | |
status: | New → In Progress |
status: | In Progress → Confirmed |
status: | Confirmed → In Progress |
description: | updated |
Changed in kolla-ansible: | |
importance: | Undecided → High |
Changed in kolla-ansible: | |
assignee: | nobody → Mark Goddard (mgoddard) |
description: | updated |
Changed in kolla-ansible: | |
milestone: | 9.0.0 → none |
Changed in kolla-ansible: | |
status: | Fix Committed → Fix Released |
Reviewed: https:/ /review. opendev. org/668623 /git.openstack. org/cgit/ openstack/ kolla-ansible/ commit/ ?id=c38dd767118 164aae37613d557 ed23691813f617
Committed: https:/
Submitter: Zuul
Branch: master
commit c38dd767118164a ae37613d557ed23 691813f617
Author: Mark Goddard <email address hidden>
Date: Tue Jul 2 08:30:02 2019 +0100
Wait for all compute services before cell discovery
There is a race condition during nova deploy since we wait for at least
one compute service to register itself before performing cells v2 host
discovery. It's quite possible that other compute nodes will not yet
have registered and will therefore not be discovered. This leaves them
not mapped into a cell, and results in the following error if the
scheduler picks one when booting an instance:
Host 'xyz' is not mapped to any cell
The problem has been exacerbated by merging a fix [1][2] for a nova race
condition, which disabled the dynamic periodic discovery mechanism in
the nova scheduler.
This change fixes the issue by waiting for all expected compute services
to register themselves before performing host discovery. This includes
both virtualised compute services and bare metal compute services.
[1] https:/ /bugs.launchpad .net/kolla- ansible/ +bug/1832987 /review. opendev. org/665554
[2] https:/
Change-Id: I2915e2610e5c0b 8d67412e7ec77f7 575b8fe9921
Closes-Bug: #1835002