OVN gate not running IPv6 Tempest scenario tests

[Eran Kuris]

It looks like OVN gate not running IPv6 Tempest scenario tests besides 1 test: tempest.scenario.test_network_v6.TestGettingAddress.test_dualnet_multi_prefix_slaac

All other tests are not running:
tempest.scenario.test_network_v6.TestGettingAddress.test_dhcp6_stateless_from_os
tempest.scenario.test_network_v6.TestGettingAddress.test_dualnet_dhcp6_stateless_from_os
tempest.scenario.test_network_v6.TestGettingAddress.test_dualnet_multi_prefix_dhcpv6_stateless
tempest.scenario.test_network_v6.TestGettingAddress.test_slaac_from_os
tempest.scenario.test_network_v6.TestGettingAddress.test_dualnet_slaac_from_os
tempest.scenario.test_network_v6.TestGettingAddress.test_multi_prefix_dhcpv6_stateless
tempest.scenario.test_network_v6.TestGettingAddress.test_multi_prefix_slaac

http://logs.openstack.org/22/566822/2/check/networking-ovn-tempest-dsvm-ovs-release-centos7/38d9f29/logs/testr_results.html.gz

[Eran Kuris (ekuris)]

version Queen

[Lucas Alvares Gomes (lucasagomes)]

So the reason why these tests are not executed in our current tempest job is because they are tagged as "slow" [0]. We disable all slow tests [1] because running them as part of the current tempest job might cause it to timeout.

[0] https://github.com/openstack/tempest/blob/745f758621eec57d45e91db20a4ad81bd0e23e9d/tempest/scenario/test_network_v6.py#L217-L252

[1] https://github.com/openstack/networking-ovn/blob/302a21ec689d7d12f83afacd7a7bd49dea2004f7/devstack/devstackgaterc#L67-L68

[Lucas Alvares Gomes (lucasagomes)]

Removed the queens tag because we don't run it in any branch

[Eran Kuris (ekuris)]

Don't we want to add them to get more coverage & quality?
Maybe we need a separated job/gate for it?

[Lucas Alvares Gomes (lucasagomes)]

@Eran, absolutely yeah. I think we indeed will need a separated job for those tests

[Eran Kuris (ekuris)]

Someone is working on creating a separated job for those tests that marked as "slow"

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/652041

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/652041
Committed: https://git.openstack.org/cgit/openstack/networking-ovn/commit/?id=ea6977cfed7b5205014c484e7a33d3be9a55129e
Submitter: Zuul
Branch: master

commit ea6977cfed7b5205014c484e7a33d3be9a55129e
Author: Slawek Kaplonski <email address hidden>
Date: Fri Apr 12 12:55:48 2019 +0200

    Add networking-ovn-tempest-slow job to check queue

    It will run all tempest tests marked as "slow", so e.g. most of
    the tests from tempest.scenario.test_network_v6 module.

    For now it is added as non-voting job. If it will be working well
    we can switch it to be voting and gating.

    Change-Id: Idfeec1fa4375c346b23ed7b53f352755ea555c5d
    Close-Bug: #1770151