os-brick 1.4.0 increases volume setup failure rates
Bug #1592043 reported by
Sean Dague
This bug affects 1 person
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
OpenStack Compute (nova) |
Fix Released
|
Undecided
|
Matt Riedemann | ||
os-brick |
Invalid
|
Critical
|
Walt Boring | ||
oslo.privsep |
Fix Released
|
Undecided
|
Unassigned |
Bug Description
Since merging upper constraints 1.4.0 into upper-constraints, the multinode grenade jobs are hitting a nearly 1/3 failure rate on boot from volume scenarios around volume setup. This would be on Newton code using Mitaka configs.
Representative failures are of the following form: http://
The 1/3 failure rate is suspicious, and in the past has often hinted towards a race condition interacting between parallel API requests.
The failure rate increase can be seen here - http://
description: | updated |
Changed in os-brick: | |
assignee: | nobody → Walt Boring (walter-boring) |
importance: | Undecided → Critical |
Changed in os-brick: | |
status: | Confirmed → In Progress |
Changed in nova: | |
assignee: | nobody → Angus Lees (gus) |
status: | New → In Progress |
Changed in nova: | |
assignee: | Angus Lees (gus) → Matt Riedemann (mriedem) |
To post a comment you must log in.
http:// logstash. openstack. org/#dashboard/ file/logstash. json?query= message% 3A%5C%22FailedT oDropPrivileges %3A%20privsep% 20helper% 20command% 20exited% 20non-zero% 20(1)%5C% 22%20AND% 20tags% 3A%5C%22screen- n-cpu.txt% 5C%22%20AND% 20voting% 3A1&from= 7d
I'm wondering if https:/ /github. com/openstack/ os-brick/ commit/ 80703d3e2070c16 a745d75d497dedc 5ec1b9e714 is doing something wrong with checking for multipathd with privsep.