Description:
Master Sc010-kvm job is failing on octavia related tempest test: octavia_tempest_plugin.tests.scenario.v2.test_traffic_ops.TrafficOperationsScenarioTest
tempest run:-
~~~
{1} setUpClass (octavia_tempest_plugin.tests.scenario.v2.test_traffic_ops.TrafficOperationsScenarioTest) [0.000000s] ... FAILED
Captured traceback:
~~~~~~~~~~~~~~~~~~~
Traceback (most recent call last):
File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 445, in _make_request
six.raise_from(e, None)
File "<string>", line 3, in raise_from
File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 440, in _make_request
httplib_response = conn.getresponse()
File "/usr/lib64/python3.9/http/client.py", line 1377, in getresponse
response.begin()
File "/usr/lib64/python3.9/http/client.py", line 320, in begin
version, status, reason = self._read_status()
File "/usr/lib64/python3.9/http/client.py", line 281, in _read_status
line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
File "/usr/lib64/python3.9/socket.py", line 704, in readinto
return self._sock.recv_into(b)
socket.timeout: timed out
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/python3.9/site-packages/tempest/test.py", line 168, in setUpClass
raise value.with_traceback(trace)
.
.
File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPConnectionPool(host='192.168.24.3', port=8774): Read timed out. (read timeout=60)
~~~
nova errors:-
~~~
2022-05-12 14:17:19.252 ERROR /var/log/containers/nova/nova-api.log: 6 ERROR nova.api.openstack.wsgi File "/usr/lib/python3.9/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper
2022-05-12 14:17:19.252 ERROR /var/log/containers/nova/nova-api.log: 6 ERROR nova.api.openstack.wsgi return fn(*args, **kwargs)
2022-05-12 14:17:19.252 ERROR /var/log/containers/nova/nova-api.log: 6 ERROR nova.api.openstack.wsgi File "/usr/lib/python3.9/site-packages/nova/objects/keypair.py", line 40, in _get_from_db
2022-05-12 14:17:19.252 ERROR /var/log/containers/nova/nova-api.log: 6 ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name)
2022-05-12 14:17:19.252 ERROR /var/log/containers/nova/nova-api.log: 6 ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair octavia-ssh-key not found for user 7527fbfe4d204aafaff987d944a25019
.
.
05-12 14:18:28.320 ERROR /var/log/containers/nova/nova-api.log: 6 ERROR nova.api.openstack.wsgi File "/usr/lib/python3.9/site-packages/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db
2022-05-12 14:18:28.320 ERROR /var/log/containers/nova/nova-api.log: 6 ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id)
2022-05-12 14:18:28.320 ERROR /var/log/containers/nova/nova-api.log: 6 ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor octavia_65 could not be found.
.
.
24:47.052 ERROR /var/log/containers/nova/nova-api.log: 6 ERROR nova.api.openstack.wsgi File "/usr/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name
2022-05-12 14:24:47.052 ERROR /var/log/containers/nova/nova-api.log: 6 ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message)
2022-05-12 14:24:47.052 ERROR /var/log/containers/nova/nova-api.log: 6 ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'tempest-lb_member_SG-867648610'
~~~
Nova API is not responding per the HAProxy logs:
May 12 14:24:23 standalone haproxy[7]: 192.168.24.3:51460 [12/May/ 2022:14: 22:53.266] nova_osapi nova_osapi_ be/standalone. ctlplane. localdomain 0/0/0/90093/90093 504 397 - - ---- 41/3/2/2/0 0/0 "POST /v2.1/servers HTTP/1.1"