Occasional unit tests failures caused by timeouts

Bug #2065953 reported by Takashi Kajinami
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Cinder
New
Undecided
Unassigned

Bug Description

We've seen that a few of the unit test cases occasionally fails because of timeout.
I've not yet identified the specific test case affected by this problem.

Example build:
https://zuul.opendev.org/t/openstack/build/c468469e82364512b5383640c373f88e

Example output:

cinder.tests.unit.backup.drivers.test_backup_google.GoogleBackupDriverTestCase.test_backup_backup_metadata_fail2
----------------------------------------------------------------------------------------------------------------

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):

      File "/usr/lib/python3.11/unittest/mock.py", line 1369, in patched
    return func(*newargs, **newkeywargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

      File "/home/zuul/src/opendev.org/openstack/cinder/cinder/tests/unit/backup/drivers/test_backup_google.py", line 81, in func_wrapper
    return func(self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^

      File "/usr/lib/python3.11/unittest/mock.py", line 1369, in patched
    return func(*newargs, **newkeywargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

      File "/home/zuul/src/opendev.org/openstack/cinder/cinder/tests/unit/backup/drivers/test_backup_google.py", line 494, in test_backup_backup_metadata_fail2
    self.assertRaises(exception.BackupOperationError,

      File "/home/zuul/src/opendev.org/openstack/cinder/.tox/py311/lib/python3.11/site-packages/testtools/testcase.py", line 469, in assertRaises
    self.assertThat(our_callable, matcher)

      File "/home/zuul/src/opendev.org/openstack/cinder/.tox/py311/lib/python3.11/site-packages/testtools/testcase.py", line 480, in assertThat
    mismatch_error = self._matchHelper(matchee, matcher, message, verbose)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

      File "/home/zuul/src/opendev.org/openstack/cinder/.tox/py311/lib/python3.11/site-packages/testtools/testcase.py", line 532, in _matchHelper
    mismatch = matcher.match(matchee)
               ^^^^^^^^^^^^^^^^^^^^^^

      File "/home/zuul/src/opendev.org/openstack/cinder/.tox/py311/lib/python3.11/site-packages/testtools/matchers/_exception.py", line 104, in match
    mismatch = self.exception_matcher.match(exc_info)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

      File "/home/zuul/src/opendev.org/openstack/cinder/.tox/py311/lib/python3.11/site-packages/testtools/matchers/_higherorder.py", line 62, in match
    mismatch = matcher.match(matchee)
               ^^^^^^^^^^^^^^^^^^^^^^

      File "/home/zuul/src/opendev.org/openstack/cinder/.tox/py311/lib/python3.11/site-packages/testtools/testcase.py", line 459, in match
    reraise(*matchee)

      File "/home/zuul/src/opendev.org/openstack/cinder/.tox/py311/lib/python3.11/site-packages/testtools/compat.py", line 26, in reraise
    raise exc_obj.with_traceback(exc_tb)

      File "/home/zuul/src/opendev.org/openstack/cinder/.tox/py311/lib/python3.11/site-packages/testtools/matchers/_exception.py", line 97, in match
    result = matchee()
             ^^^^^^^^^

      File "/home/zuul/src/opendev.org/openstack/cinder/.tox/py311/lib/python3.11/site-packages/testtools/testcase.py", line 1041, in __call__
    return self._callable_object(*self._args, **self._kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

      File "/home/zuul/src/opendev.org/openstack/cinder/cinder/backup/chunkeddriver.py", line 620, in backup
    shalist = eventlet.tpool.execute(self._calculate_sha, data)
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

      File "/home/zuul/src/opendev.org/openstack/cinder/.tox/py311/lib/python3.11/site-packages/eventlet/tpool.py", line 106, in execute
    setup()

      File "/home/zuul/src/opendev.org/openstack/cinder/.tox/py311/lib/python3.11/site-packages/eventlet/tpool.py", line 289, in setup
    t.start()

      File "/usr/lib/python3.11/threading.py", line 962, in start
    self._started.wait()

      File "/usr/lib/python3.11/threading.py", line 622, in wait
    signaled = self._cond.wait(timeout)
               ^^^^^^^^^^^^^^^^^^^^^^^^

      File "/usr/lib/python3.11/threading.py", line 320, in wait
    waiter.acquire()

      File "/home/zuul/src/opendev.org/openstack/cinder/.tox/py311/lib/python3.11/site-packages/fixtures/_fixtures/timeout.py", line 52, in signal_handler
    raise TimeoutException()

    fixtures._fixtures.timeout.TimeoutException

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.