[ndr] "neutron-tempest-plugin-dynamic-routing" failing

[Rodolfo Alonso]

"neutron-tempest-plugin-dynamic-routing" jobs are currently failing (same error in the last 4 tested releases). E.g.: https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_7ab/891550/2/check/neutron-tempest-plugin-dynamic-routing/7ab85ff/testr_results.html

Error: https://paste.opendev.org/show/bTwcOK65EKMQkiOhAvL9/

[Brian Haley (brian-haley)]

Digging deeper into the tempest log looks like the 'docker exec' is failing, but I don't know why.

2023-08-16 01:09:13.901 111076 INFO os_ken.tests.integrated.common.docker_base [-] sudo docker run --privileged=true -v /tmp/ctn_docker/bgp/q1:/etc/quagga --name q1 --hostname q1 -id quagga
2023-08-16 01:09:14.097 111076 INFO os_ken.tests.integrated.common.docker_base [-] sudo docker exec q1 ip li set up dev lo
2023-08-16 01:09:14.097 111076 ERROR os_ken.tests.integrated.common.docker_base [-] stdout:
2023-08-16 01:09:14.098 111076 ERROR os_ken.tests.integrated.common.docker_base [-] stderr: Error response from daemon: Container ce89787f1142ea66f8a865f56f971c4c4505f636ebc91739033f7799e14e44ae is not running

2023-08-16 01:09:14.098 111076 INFO tempest.test [-] <class 'os_ken.tests.integrated.common.docker_base.CommandError'> raised in BgpSpeakerIpv4Test.setUpClass. Invoking tearDownClass.

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/891600

[OpenStack Infra (hudson-openstack)]

Change abandoned by "Brian Haley <email address hidden>" on branch: master
Review: https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/891600
Reason: Merged into https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/891550

[Dr. Jens Harbott (j-harbott)]

Proposed fix https://review.opendev.org/c/openstack/os-ken/+/891658

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/891550
Committed: https://opendev.org/openstack/neutron-tempest-plugin/commit/d84b96d294439c6ad70794da94c5f69c8853e9b1
Submitter: "Zuul (22348)"
Branch: master

commit d84b96d294439c6ad70794da94c5f69c8853e9b1
Author: Brian Haley <email address hidden>
Date: Tue Aug 15 17:23:13 2023 -0400

    Set GLOBAL_VENV=false to fix broken gate jobs

    Set GLOBAL_VENV=false in neutron-tempest-plugin-base
    job definition to fix gate jobs broken by devstack
    change [0].

    Had to make the neutron-tempest-plugin-dynamic-routing-*
    jobs non-voting as they are failing on the master branch
    check queue. Work is still ongoing on a fix.

    [0] https://review.opendev.org/c/openstack/devstack/+/558930

    Closes-bug: #2031415
    Related-bug: #2031526
    Change-Id: I2cab7e9169ca6ddaea8b580dbb995e0886bd93c1

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/neutron-dynamic-routing/+/892450

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/neutron-dynamic-routing/+/892450
Committed: https://opendev.org/openstack/neutron-dynamic-routing/commit/24db9d0f2a9158ec59e71779735dd3626a237fcf
Submitter: "Zuul (22348)"
Branch: master

commit 24db9d0f2a9158ec59e71779735dd3626a237fcf
Author: yatinkarel <email address hidden>
Date: Wed Aug 23 11:01:14 2023 +0530

    Install os-ken from git repo

    Currently jobs with "os-ken" in LIBS_FROM_GIT installs os-ken
    from pypi but instead should be installed from git.

    Partial-Bug: #2032738
    Related-Bug: #2031526
    Change-Id: I6b9c28f0cdb1e135052d57c7927b3573f1670a8c

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/892755

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/892755
Committed: https://opendev.org/openstack/neutron-tempest-plugin/commit/9e3969b0dfcff0fda234d28721d68c15fca6969c
Submitter: "Zuul (22348)"
Branch: master

commit 9e3969b0dfcff0fda234d28721d68c15fca6969c
Author: yatin <email address hidden>
Date: Mon Aug 28 05:35:27 2023 +0000

    Revert "Set GLOBAL_VENV=false to fix broken gate jobs"

    This reverts commit d84b96d294439c6ad70794da94c5f69c8853e9b1.

    Reason for revert: OVS jobs with GLOBAL_VENV=True are being fixed
    with [1]. dynamic-routing jobs already fixed with os-ken latest release[2].

    [1] https://review.opendev.org/c/openstack/devstack/+/892848
    [2] https://review.opendev.org/c/openstack/releases/+/892214

    Depends-On: https://review.opendev.org/c/openstack/devstack/+/892848
    Related-bug: #2031415
    Related-bug: #2031526
    Change-Id: Ifae116a443ba500deb4cf01fdc92c87eb83d7582

[Rodolfo Alonso (rodolfo-alonso-hernandez)]

The job is fixed and working right now: https://zuul.opendev.org/t/openstack/builds?job_name=neutron-tempest-plugin-dynamic-routing&skip=0

I'm closing this bug.