OpenStack Compute (nova)

Comment 4 for bug 1719915

Revision history for this message

Balazs Gibizer (balazs-gibizer) wrote on 2017-09-27:

So these race happens at the delete of the instance:
Captured traceback:
2017-09-27 13:53:01.197304 | ~~~~~~~~~~~~~~~~~~~
2017-09-27 13:53:01.197349 | b'Traceback (most recent call last):'
2017-09-27 13:53:01.197462 | b' File "/home/jenkins/workspace/gate-nova-tox-functional-py35-ubuntu-xenial/.tox/functional-py35/lib/python3.5/site-packages/mock/mock.py", line 1305, in patched'
2017-09-27 13:53:01.197510 | b' return func(*args, **keywargs)'
2017-09-27 13:53:01.197625 | b' File "/home/jenkins/workspace/gate-nova-tox-functional-py35-ubuntu-xenial/nova/tests/functional/test_servers.py", line 2426, in test_live_migrate_delete'
2017-09-27 13:53:01.197676 | b' server, source_rp_uuid, dest_rp_uuid)'
2017-09-27 13:53:01.197786 | b' File "/home/jenkins/workspace/gate-nova-tox-functional-py35-ubuntu-xenial/nova/tests/functional/test_servers.py", line 1331, in _delete_and_check_allocations'
2017-09-27 13:53:01.197850 | b" 'DISK_GB': 0}, source_usages)"
2017-09-27 13:53:01.197965 | b' File "/home/jenkins/workspace/gate-nova-tox-functional-py35-ubuntu-xenial/.tox/functional-py35/lib/python3.5/site-packages/testtools/testcase.py", line 411, in assertEqual'
2017-09-27 13:53:01.198019 | b' self.assertThat(observed, matcher, message)'
2017-09-27 13:53:01.198132 | b' File "/home/jenkins/workspace/gate-nova-tox-functional-py35-ubuntu-xenial/.tox/functional-py35/lib/python3.5/site-packages/testtools/testcase.py", line 498, in assertThat'
2017-09-27 13:53:01.198173 | b' raise mismatch_error'
2017-09-27 13:53:01.198220 | b'testtools.matchers._impl.MismatchError: !=:'
2017-09-27 13:53:01.198273 | b"reference = {'DISK_GB': 0, 'MEMORY_MB': 0, 'VCPU': 0}"
2017-09-27 13:53:01.198327 | b"actual = {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}"
2017-09-27 13:53:01.198354 | b''
2017-09-27 13:53:01.198381 | b''

Most probably the instance already disappeared from the REST API, as that is what _wait_unit_deleted waits for, but the allocation hasn't been deleted.

So these race happens at the delete of the instance:
Captured traceback:
2017-09-27 13:53:01.197304 | ~~~~~~~~~~~~~~~~~~~
2017-09-27 13:53:01.197349 |     b'Traceback (most recent call last):'
2017-09-27 13:53:01.197462 |     b'  File "/home/jenkins/workspace/gate-nova-tox-functional-py35-ubuntu-xenial/.tox/functional-py35/lib/python3.5/site-packages/mock/mock.py", line 1305, in patched'
2017-09-27 13:53:01.197510 |     b'    return func(*args, **keywargs)'
2017-09-27 13:53:01.197625 |     b'  File "/home/jenkins/workspace/gate-nova-tox-functional-py35-ubuntu-xenial/nova/tests/functional/test_servers.py", line 2426, in test_live_migrate_delete'
2017-09-27 13:53:01.197676 |     b'    server, source_rp_uuid, dest_rp_uuid)'
2017-09-27 13:53:01.197786 |     b'  File "/home/jenkins/workspace/gate-nova-tox-functional-py35-ubuntu-xenial/nova/tests/functional/test_servers.py", line 1331, in _delete_and_check_allocations'
2017-09-27 13:53:01.197850 |     b"    'DISK_GB': 0}, source_usages)"
2017-09-27 13:53:01.197965 |     b'  File "/home/jenkins/workspace/gate-nova-tox-functional-py35-ubuntu-xenial/.tox/functional-py35/lib/python3.5/site-packages/testtools/testcase.py", line 411, in assertEqual'
2017-09-27 13:53:01.198019 |     b'    self.assertThat(observed, matcher, message)'
2017-09-27 13:53:01.198132 |     b'  File "/home/jenkins/workspace/gate-nova-tox-functional-py35-ubuntu-xenial/.tox/functional-py35/lib/python3.5/site-packages/testtools/testcase.py", line 498, in assertThat'
2017-09-27 13:53:01.198173 |     b'    raise mismatch_error'
2017-09-27 13:53:01.198220 |     b'testtools.matchers._impl.MismatchError: !=:'
2017-09-27 13:53:01.198273 |     b"reference = {'DISK_GB': 0, 'MEMORY_MB': 0, 'VCPU': 0}"
2017-09-27 13:53:01.198327 |     b"actual    = {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}"
2017-09-27 13:53:01.198354 |     b''
2017-09-27 13:53:01.198381 |     b''

Most probably the instance already disappeared from the REST API, as that is what _wait_unit_deleted waits for, but the allocation hasn't been deleted.