Scenario010 octavia job times out when executing tempest

[Sagi (Sergey) Shnaidman]

It's not constant behaviour, but scenario010 octavia jobs times out often where they are stuck on tempest execution. Possibly some of tests break network or take too much time.
It happens in various branches and both check and periodic jobs:

http://dashboard-ci.tripleo.org/d/3-DYSmOGk/jobs-exploration?var-influxdb_filter=job_name%7C%3D~%7C%2Fscenario010%2F&var-influxdb_filter=result%7C!%3D%7CSKIPPED&var-influxdb_filter=result%7C!%3D%7CNODE_FAILURE&var-influxdb_filter=result%7C%3D%7CTIMED_OUT

tripleo-ci-centos-8-scenario010-standalone
periodic-tripleo-ci-centos-8-scenario010-kvm-standalone-octavia-master
periodic-tripleo-ci-centos-8-scenario010-standalone-octavia-victoria
periodic-tripleo-ci-centos-8-scenario010-kvm-standalone-octavia-victoria
and others.

Logs:
https://logserver.rdoproject.org/openstack-component-octavia/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario010-kvm-standalone-octavia-master/278fc07/logs/
https://logserver.rdoproject.org/openstack-component-octavia/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario010-kvm-standalone-octavia-master/333ba94/logs/
https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario010-standalone-master/5eb0317/logs/
https://logserver.rdoproject.org/openstack-component-octavia/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario010-kvm-standalone-octavia-master/b470e1d/logs/

[Gregory Thiemonge (gthiemonge)]

Many new tests have been added in octavia-tempest-plugin, it now takes a lot of time to run the test suite in tripleo CI.
We want to limit scenario010 to only run smoke tests from octavia-tempest-plugin, so the commit https://review.opendev.org/c/openstack/tripleo-ci/+/766278 would fix the timeout issues.

[Brent Eagles (beagles)]

While the job definition in tripleo-ci/zuul.d limits the number of tests, it might be best to make the smoke tests the default in the featureset to avoid octavia tempest jobs from being too long by default. Derived job definitions can override the default whitelist to enable more jobs if necessary.