functional tests failing in both master and stable/queens due to ovsdbapp timeouts

[Daniel Alvarez]

After we bumped ovsdbapp to 0.9.1 [0], functional tests are failing in our gate for both master and stable/queens branches. It was bumped to address this bug in neutron [1].

However, for networking-ovn it caused timeout failures like:

      File "/opt/stack/networking-ovn/.tox/dsvm-functional/lib/python2.7/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 57, in commit
        timeout=self.timeout)
    ovsdbapp.exceptions.TimeoutException: Commands [<ovsdbapp.schema.ovn_southbound.commands.LspBindCommand object at 0x6631c50>] exceeded timeout 5 seconds

I verified that downgrading ovsdbapp manually to 0.9.0 works okay. Also running functional tests with ovsdbapp 0.9.1 serially (ostestr --serial) works fine as well.

[0] https://review.openstack.org/#/c/541258/
[1] https://bugs.launchpad.net/neutron/+bug/1741889

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/546198

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: stable/queens
Review: https://review.openstack.org/546199

[Daniel Alvarez (dalvarezs)]

Disregard, running it serially doesn't help either. Sorry for confusing

[Miguel Angel Ajo (mangelajo)]

But running from ostestr does? :?

[Daniel Alvarez (dalvarezs)]

Again, I made a mistake running it manually with ostestr. Forcing tox to downgrade to ovsdbapp==0.9.0 didn't help either. It must be something else, investigating.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/queens
Review: https://review.openstack.org/547006

[OpenStack Infra (hudson-openstack)]

Change abandoned by Daniel Alvarez (<email address hidden>) on branch: master
Review: https://review.openstack.org/547014

[OpenStack Infra (hudson-openstack)]

Change abandoned by Numan Siddique (<email address hidden>) on branch: master
Review: https://review.openstack.org/546986

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/queens
Review: https://review.openstack.org/547039

[OpenStack Infra (hudson-openstack)]

Change abandoned by Daniel Alvarez (<email address hidden>) on branch: master
Review: https://review.openstack.org/547017
Reason: For some reason I sent this patch to stable/queens but it didn't work. This patch is for stable/queens only :)

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/queens
Review: https://review.openstack.org/547334

[OpenStack Infra (hudson-openstack)]

Change abandoned by Daniel Alvarez (<email address hidden>) on branch: master
Review: https://review.openstack.org/547077
Reason: this was meant for stable/queens

[OpenStack Infra (hudson-openstack)]

Change abandoned by Daniel Alvarez (<email address hidden>) on branch: master
Review: https://review.openstack.org/546198

[OpenStack Infra (hudson-openstack)]

Change abandoned by Daniel Alvarez (<email address hidden>) on branch: stable/queens
Review: https://review.openstack.org/546199

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/546986
Committed: https://git.openstack.org/cgit/openstack/networking-ovn/commit/?id=5d19dad877a5589e026ab4af7b09e6c8ee97fc22
Submitter: Zuul
Branch: master

commit 5d19dad877a5589e026ab4af7b09e6c8ee97fc22
Author: Numan Siddique <email address hidden>
Date: Thu Feb 22 19:18:57 2018 +0530

    Fix functional tests by using ovs with commit 8b70d82461ea104858ebd7d397ec004f6974240b

    Use branch 2.9. The commit 8bf332225d4a73f359c806ad907bcb78ad2a6087
    - "ovn-northd: Reduce amount of flow hashing." in ovs master has caused
    regressions because of which functional tests are failing. So use the commit
    8b70d82461ea104858ebd7d397ec004f6974240b.
    We can revert back to master, once the regressions are addressed.

    Change-Id: Ic50865033088443769442667385ed303624e7691
    Closes-bug: #1750599

[OpenStack Infra (hudson-openstack)]

Change abandoned by Daniel Alvarez (<email address hidden>) on branch: stable/queens
Review: https://review.openstack.org/547006
Reason: in favor of: https://review.openstack.org/#/c/543374/

[OpenStack Infra (hudson-openstack)]

Change abandoned by Lucas Alvares Gomes (<email address hidden>) on branch: stable/queens
Review: https://review.openstack.org/547334

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/networking-ovn 5.0.0.0b1 development milestone.

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/547039
Committed: https://git.openstack.org/cgit/openstack/networking-ovn/commit/?id=b57c59ea482b2605ab6b6c9ba36e3032d94cf897
Submitter: Zuul
Branch: stable/queens

commit b57c59ea482b2605ab6b6c9ba36e3032d94cf897
Author: Daniel Alvarez <email address hidden>
Date: Thu Feb 22 15:51:18 2018 +0100

    Run tempest release job and functional tests against OVS 2.9

    This patch makes both the functional tests and tempest release
    job to run against OVS 2.9 which is the latest release at the
    time that stable/queens is going to be released.

    This is also fixing the functional tests that currently run
    against OVS master branch and currently breaks those.

    Closes-bug: #1750599

    Change-Id: Ie631cfebee98a2d2656c9e7f4430792c115ceda8
    Signed-off-by: Daniel Alvarez <email address hidden>

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/networking-ovn 4.0.2 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/networking-ovn 4.0.3 release.