Traceback (most recent call last):
File "nova/tests/functional/notification_sample_tests/test_instance.py", line 63, in test_live_migration_actions
action(server)
File "/home/zuul/src/git.openstack.org/openstack/nova/.tox/functional/local/lib/python2.7/site-packages/mock/mock.py", line 1305, in patched
return func(*args, **keywargs)
File "nova/tests/functional/notification_sample_tests/test_instance.py", line 78, in _test_live_migration_rollback
self._wait_for_notification('instance.live_migration_rollback.start')
File "nova/tests/functional/notification_sample_tests/notification_sample_base.py", line 231, in _wait_for_notification
'notification %s hasn\'t been received' % event_type)
File "/home/zuul/src/git.openstack.org/openstack/nova/.tox/functional/local/lib/python2.7/site-packages/unittest2/case.py", line 702, in assertTrue
raise self.failureException(msg)
AssertionError: False is not true : notification instance.live_migration_rollback.start hasn't been received
There was 5 failures in the last 7 days.
http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22AssertionError%3A%20False%20is%20not%20true%20%3A%20notification%20instance.live_migration_rollback.start%20hasn't%20been%20received%5C%22
The logs does not show anything unusual. Locally I was not able to reproduce the problem during more than 50 trials. By comparing the logs between the local successful run and the gate failures the only interesting thing differences is timing. On my machine the it took less then a second from starting the second compute to execute the live migration and receive the rollback notification. On the gate failure it took 4 seconds from starting the second compute to get the last log message before the test failed. So it seems that the gate execution a lot slower. Currently the timeout to wait for the rollback notification to arrive is 1 second. So it is possible that the test times out on the gate before the notification has a chance to arrive.