test_install_flood_to_tun failed with: 'tun_id=0x378' not in u' unchanged'

Bug #1697533 reported by Ihar Hrachyshka
12
This bug affects 2 people
Affects Status Importance Assigned to Milestone
neutron
Fix Released
Critical
Jakub Libosvar

Bug Description

http://logs.openstack.org/59/471059/2/check/gate-neutron-dsvm-functional-ubuntu-xenial/cd6149b/testr_results.html.gz

Traceback (most recent call last):
  File "neutron/tests/base.py", line 118, in func
    return f(self, *args, **kwargs)
  File "neutron/tests/common/helpers.py", line 241, in check_ovs_and_skip
    return f(test)
  File "neutron/tests/functional/agent/test_ovs_flows.py", line 445, in test_install_flood_to_tun
    self.assertIn(("tun_id=0x%(tun_id)x" % kwargs), trace["Final flow"])
  File "/opt/stack/new/neutron/.tox/dsvm-functional/local/lib/python2.7/site-packages/testtools/testcase.py", line 417, in assertIn
    self.assertThat(haystack, Contains(needle), message)
  File "/opt/stack/new/neutron/.tox/dsvm-functional/local/lib/python2.7/site-packages/testtools/testcase.py", line 498, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: 'tun_id=0x378' not in u' unchanged'

Changed in neutron:
importance: Undecided → Critical
tags: added: functional-tests gate-failure ovs
Changed in neutron:
status: New → Confirmed
Changed in neutron:
assignee: nobody → Jakub Libosvar (libosvar)
Revision history for this message
Jakub Libosvar (libosvar) wrote :

It looks like test_post_commit_vswitchd_completed_failures didn't reset mocks and they influence other tests running in the same test-process worker. All tests running in the worker 5 with native interface are affected.

Revision history for this message
Jakub Libosvar (libosvar) wrote :

So the comment above is not related to this bug but it's definitely weird.

I tracked the failure down that test_install_flood_to_tun uses static data to create tunnel which are used also by other tests.

Tunneling port failed to create because it was present in ovsdb from test_add_tunnel_port_ipv4:
http://logs.openstack.org/59/471059/2/check/gate-neutron-dsvm-functional-ubuntu-xenial/cd6149b/logs/dsvm-functional-logs/neutron.tests.functional.agent.test_ovs_lib.OVSBridgeTestCase.test_add_tunnel_port_ipv4_vsctl_.txt.gz

2017-06-09T22:46:05.542Z|10312|tunnel|WARN|port5c4054bf2d5: attempting to add tunnel port with same config as port 'port20c9efa5cd3' (198.51.100.1->192.0.2.1, key=flow, dp port=3, pkt mark=0)
2017-06-09T22:46:05.542Z|10313|ofproto|WARN|test-br1d49c624: could not add port port5c4054bf2d5 (File exists)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to neutron (master)

Fix proposed to branch: master
Review: https://review.openstack.org/475911

Changed in neutron:
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to neutron (master)

Reviewed: https://review.openstack.org/475911
Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=330ebbb1b14cc0f7abf0cd7873461c858a1e645f
Submitter: Jenkins
Branch: master

commit 330ebbb1b14cc0f7abf0cd7873461c858a1e645f
Author: Jakub Libosvar <email address hidden>
Date: Tue Jun 20 19:58:58 2017 +0000

    functional-tests: Make addresses for tunneling unique

    OVS can hold only one tunnel with same endpoints. Some tests had
    hardcoded values for both tunnel endpoints which made them unable to run
    in parallel manner.

    This patch takes always exclusive address using resource allocator.

    Change-Id: If81296d54656551b24917d561f235edb96a6c2df
    Closes-bug: #1697533

Changed in neutron:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/neutron 11.0.0.0b3

This issue was fixed in the openstack/neutron 11.0.0.0b3 development milestone.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.