neutron.tests.functional.plugins.ml2.drivers.ovn.mech_driver.test_mech_driver.TestVirtualPorts.test_virtual_port_created_before fails randomly

[Maciej Jozefczyk]

Sometimes we see random failures of the test:

neutron.tests.functional.plugins.ml2.drivers.ovn.mech_driver.test_mech_driver.TestVirtualPorts.test_virtual_port_created_before

neutron.tests.functional.plugins.ml2.drivers.ovn.mech_driver.test_mech_driver.TestVirtualPorts.test_virtual_port_created_beforetesttools.testresult.real._StringException: Traceback (most recent call last):
  File "/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional/lib/python3.6/site-packages/mock/mock.py", line 1330, in patched
    return func(*args, **keywargs)
  File "/home/zuul/src/opendev.org/openstack/neutron/neutron/tests/base.py", line 182, in func
    return f(self, *args, **kwargs)
  File "/home/zuul/src/opendev.org/openstack/neutron/neutron/tests/functional/plugins/ml2/drivers/ovn/mech_driver/test_mech_driver.py", line 280, in test_virtual_port_created_before
    ovn_vport.options[ovn_const.LSP_OPTIONS_VIRTUAL_PARENTS_KEY])
  File "/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional/lib/python3.6/site-packages/testtools/testcase.py", line 417, in assertIn
    self.assertThat(haystack, Contains(needle), message)
  File "/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional/lib/python3.6/site-packages/testtools/testcase.py", line 498, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: '88c0378b-71bd-454b-a0df-8c70b57d257a' not in '49043b88-554f-48d0-888d-eeaa749e752f'

[Bence Romsics (bence-romsics)]

There seems to be a variant where the same test times out. For example here:

https://5110f6f7a488eb32cf0a-1fc32fafa023f97dfff9a14f28efb11e.ssl.cf2.rackcdn.com/706152/10/check/neutron-functional/c034f1d/job-output.txt

[Slawek Kaplonski (slaweq)]

Similar error in different test: https://87ace9534a53ef030fdb-5ceaba4a59a2578b108bb2f456b59bef.ssl.cf5.rackcdn.com/710782/3/check/neutron-functional/fcf5a14/testr_results.html

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/712888

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.opendev.org/713860

[OpenStack Infra (hudson-openstack)]

Change abandoned by Maciej Józefczyk (<email address hidden>) on branch: master
Review: https://review.opendev.org/712888

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/713860
Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=ceb27f2c7d9d91526e9062bfaad71d2a270318bf
Submitter: Zuul
Branch: master

commit ceb27f2c7d9d91526e9062bfaad71d2a270318bf
Author: Maciej Józefczyk <email address hidden>
Date: Thu Mar 19 12:03:49 2020 +0000

    Mark TestVirtualPorts tests as unstable

    Based on debug performed in [1] the TestVirtualPorts
    are unstable. At lease one of tests per 20
    retries of functional job fail in various
    places.
    We don't think it is worth to spend more
    time on debugging those tests, because there is
    a possible easier solution: set virtual port
    type based on DEVICE_TYPE, and do not rely
    on allowed address pairs.

    [1] https://review.opendev.org/#/c/712888/

    Related-Bug: #1865453

    Change-Id: Iffef8ceb9ca458820a7b3e604a53281f7e93b810

[Slawek Kaplonski (slaweq)]

It's still marked as unstable...