Rescue fails with 'Failed to terminate process: Device or resource busy' in the n-cpu log
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
OpenStack Compute (nova) |
Fix Released
|
High
|
Matt Riedemann | ||
Juno |
Won't Fix
|
Undecided
|
Unassigned | ||
Kilo |
Fix Released
|
Undecided
|
Unassigned | ||
Ubuntu Cloud Archive |
Invalid
|
Undecided
|
Unassigned | ||
Juno |
Fix Released
|
Undecided
|
Unassigned | ||
nova (Ubuntu) |
Invalid
|
Undecided
|
Unassigned |
Bug Description
[Impact]
* Users may sometimes fail to shutdown an instance if the associated qemu
process is on uninterruptable sleep (typically IO).
[Test Case]
* 1. create some IO load in a VM
2. look at the associated qemu, make sure it has STAT D in ps output
3. shutdown the instance
4. with the patch in place, nova will retry calling libvirt to shutdown
the instance 3 times to wait for the signal to be delivered to the
qemu process.
[Regression Potential]
* None
message: "Failed to terminate process" AND message:
The above log stash-query reports back only the failed jobs, the 'Failed to terminate process' close other failed rescue tests,
but tempest does not always reports them as an error at the end.
message: "Failed to terminate process" AND tags:"screen-
Usual console log:
Details: (ServerRescueTe
Usual n-cpu exception:
http://
2014-08-07 03:32:02.855 ERROR oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
2014-08-07 03:32:02.855 22829 TRACE oslo.messaging.
Related branches
- Corey Bryant: Abstain
-
Diff: 163 lines (+141/-0)3 files modifieddebian/changelog (+7/-0)
debian/patches/series (+1/-0)
debian/patches/shutdown-timeout-retry.patch (+133/-0)
tags: | added: compute |
tags: | added: testing |
tags: | added: kilo-backport-potential |
Changed in nova: | |
milestone: | none → liberty-1 |
status: | Fix Committed → Fix Released |
description: | updated |
tags: | added: patch |
Changed in nova: | |
milestone: | liberty-1 → 12.0.0 |
Changed in nova (Ubuntu): | |
status: | New → Invalid |
Changed in cloud-archive: | |
status: | New → Invalid |
http:// logstash. openstack. org/#eyJzZWFyY2 giOiJtZXNzYWdlO lwiRmFpbGVkIHRv IHRlcm1pbmF0ZSB wcm9jZXNzXCIgQU 5EIG1lc3NhZ2U6X CJJbnN0YW5jZU5v dFJlc2N1YWJsZVw iIEFORCBtZXNzYW dlOlwiRXhjZXB0a W9uIGR1cmluZyBt ZXNzYWdlIGhhbmR saW5nXCIgQU5EIH RhZ3M6XCJzY3JlZ W4tbi1jcHUudHh0 XCIiLCJmaWVsZHM iOltdLCJvZmZzZX QiOjAsInRpbWVmc mFtZSI6ImN1c3Rv bSIsImdyYXBobW9 kZSI6ImNvdW50Ii widGltZSI6eyJmc m9tIjoiMjAxNC0w Ny0zMFQxNzo0NTo zMiswMDowMCIsIn RvIjoiMjAxNC0wO C0xM1QxNzo0NToz MiswMDowMCIsInV zZXJfaW50ZXJ2YW wiOiIwIn0sInN0Y W1wIjoxNDA3OTUx OTU3NzU0fQ= =