test_connectivity_between_vms_on_different_networks does not work on all backends

[Lucas Alvares Gomes]

The test_connectivity_between_vms_on_different_networks test does not work with a OVN based cloud. The reason is because the test is not only asserting that two VMs on different networks can communicate (ping each other) but it's also trying to assert that you can ping other ports such as the DHCP port from one network to another [0]. That will rely on how different backends implement such services.

[0] https://github.com/openstack/tempest/blob/cc36ab34a33b195f56186e22a1aecaf825a07b0f/tempest/scenario/test_network_basic_ops.py#L489-L490

[Ghanshyam Mann (ghanshyammann)]

is there any failure link for this tests on ovn?

also i find we are not running this test (which is marked as slow) on networking-ovn gate. how about running slow test also there as you are running only network tests

https://github.com/openstack/networking-ovn/blob/687889d92706c9120b3fdd0efcc22a72e0c64637/zuul.d/networkin-ovn-jobs.yaml#L24

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/611068
Committed: https://git.openstack.org/cgit/openstack/tempest/commit/?id=d595c3606c9c1c1829e3e0b283fd3409d74f1cde
Submitter: Zuul
Branch: master

commit d595c3606c9c1c1829e3e0b283fd3409d74f1cde
Author: Lucas Alvares Gomes <email address hidden>
Date: Tue Oct 16 14:38:11 2018 +0100

    Make connectivity test less backend dependent

    The test_connectivity_between_vms_on_different_networks should assert
    connectivity between different VMS on different networks but the test is
    also asserting that one VM can ping the services port (such as DHCP)
    running on the other network and that may not be the case for all
    backends.

    OVN for example uses a "localport" type to implement a
    DHCP port. That port type in OVN does not allow traffic
    outside the network it belongs to [0] which is causing the test
    test_connectivity_between_vms_on_different_networks to fail when used
    with networking-ovn.

    This patch is modifying the test to only ping the relevant ports when
    asserting that the VMs have connectivity with each other.

    [0]
    https://github.com/openvswitch/ovs/blob/d9677a1f0eaf6352c44af3ba3a4c2faf76a2a39b/ovn/controller/physical.c#L1176-L1182

    Closes-Bug: #1798317
    Change-Id: Ia4a6ee65d3d737f8452b4aed9bf4624455a3b050

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/tempest 20.0.0 release.