no unquiesce for volume backed on quiesce failure
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
OpenStack Compute (nova) |
Fix Released
|
Medium
|
Eric M Gonzalez | ||
Ocata |
Fix Committed
|
Medium
|
Matt Riedemann | ||
Pike |
Fix Committed
|
Medium
|
Matt Riedemann | ||
Queens |
Fix Committed
|
Medium
|
Matt Riedemann |
Bug Description
Extension of bug #1731986;
The above bug and fix catches errors that occur during the snapshot of an instance's volumes. I later discovered that a failure can occur during the call to quisce_instance() that raises an uncaught Exceptions through snapshot_
Replication is tricky; my failures result during the RPC call to the compute host and a MessagingTimeout waiting for a reply. I have not found a way to handily replicate this. My compute combination is: Nova Mitaka, Libvirt-1.3.1, & Ceph Jewel
Similar to the above bug, this condition was discovered in Mitaka and the issue remains in Queens.
My proposed patch adds a blanket Exception catch around the call to rpcapi.
Stack trace from nova-api-os container, responsible for quiesce / unquiesce of instance during snapshot:
[req-6229d689-
Traceback (most recent call last):
File "/openstack/
return f(*args, **kwargs)
File "/openstack/
return f(*args, **kwargs)
File "/openstack/
return func(*args, **kwargs)
File "/openstack/
return func(*args, **kwargs)
File "/openstack/
metadata)
File "/openstack/
return f(self, context, instance, *args, **kw)
File "/openstack/
mapping=None)
File "/openstack/
self.
File "/openstack/
six.
File "/openstack/
self.
File "/openstack/
return cctxt.call(ctxt, 'quiesce_instance', instance=instance)
File "/openstack/
retry=
File "/openstack/
timeout=
File "/openstack/
retry=retry)
File "/openstack/
result = self._waiter.
File "/openstack/
message = self.waiters.
File "/openstack/
'to message ID %s' % msg_id)
MessagingTimeout: Timed out waiting for a reply to message ID 70ee5f80284b4b6
Changed in nova: | |
importance: | Undecided → Medium |
Changed in nova: | |
assignee: | Eric M Gonzalez (egrh3) → Matt Riedemann (mriedem) |
Changed in nova: | |
assignee: | Matt Riedemann (mriedem) → Eric M Gonzalez (egrh3) |
Fix proposed to branch: master /review. openstack. org/550865
Review: https:/