neutron

neutron-tempest-with-uwsgi job failing tempest tests with: Floating ip <fip> failed to associate with server <server id> in time

Bug #1960022 reported by yatin on 2022-02-04

This bug affects 1 person

Affects		Status	Importance	Assigned to	Milestone
	neutron	Fix Released	High	Unassigned

Bug Description

Tempest test failing in neutron-tempest-with-uwsgi with below TraceBack:-

Last successful job is seen on 28th Jan, 2022.

ft1.1: setUpClass (tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON)testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/opt/stack/tempest/tempest/test.py", line 182, in setUpClass
    raise value.with_traceback(trace)
  File "/opt/stack/tempest/tempest/test.py", line 175, in setUpClass
    cls.resource_setup()
  File "/opt/stack/tempest/tempest/api/compute/servers/test_server_actions.py", line 84, in resource_setup
    cls.server_id = cls.recreate_server(None, validatable=True)
  File "/opt/stack/tempest/tempest/api/compute/base.py", line 431, in recreate_server
    server = cls.create_test_server(
  File "/opt/stack/tempest/tempest/api/compute/base.py", line 270, in create_test_server
    body, servers = compute.create_test_server(
  File "/opt/stack/tempest/tempest/common/compute.py", line 268, in create_test_server
    LOG.exception('Server %s failed to delete in time',
  File "/opt/stack/tempest/.tox/tempest/lib/python3.8/site-packages/oslo_utils/excutils.py", line 227, in __exit__
    self.force_reraise()
  File "/opt/stack/tempest/.tox/tempest/lib/python3.8/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
    raise self.value
  File "/opt/stack/tempest/tempest/common/compute.py", line 246, in create_test_server
    _setup_validation_fip()
  File "/opt/stack/tempest/tempest/common/compute.py", line 231, in _setup_validation_fip
    waiters.wait_for_server_floating_ip(
  File "/opt/stack/tempest/tempest/common/waiters.py", line 571, in wait_for_server_floating_ip
    raise lib_exc.TimeoutException(msg)
tempest.lib.exceptions.TimeoutException: Request timed out
Details: Floating ip {'id': '42ad634c-9fce-4fff-87e0-c16cfddaa3ca', 'tenant_id': '485663e37c554596aff00daf8b166106', 'floating_ip_address': '172.24.5.190', 'floating_network_id': 'ca44af5f-08e7-4463-a77b-9660d250a82b', 'router_id': None, 'port_id': None, 'fixed_ip_address': None, 'status': 'DOWN', 'project_id': '485663e37c554596aff00daf8b166106', 'description': '', 'port_details': None, 'tags': [], 'created_at': '2022-02-03T13:28:19Z', 'updated_at': '2022-02-03T13:28:19Z', 'revision_number': 0, 'ip': '172.24.5.190'} failed to associate with server 7329393c-ed1d-433f-8be0-7a15a72b60e7 in time.

As per neutron log fip get's created/associated/disassociated:-
Feb 03 13:28:19.390516 ubuntu-focal-ovh-bhs1-0028297773 <email address hidden>[63722]: DEBUG neutron.db.db_base_plugin_common [None req-bf1740b9-bf5c-4a21-a073-1af294df8f30 tempest-ServerActionsTestJSON-974914713 tempest-ServerActionsTestJSON-974914713-project] Allocated IP 172.24.5.190 (ca44af5f-08e7-4463-a77b-9660d250a82b/b8944f8b-e1ee-4e3c-9a3b-e8c2f93ea5eb/9ec9d1c3-5cce-4393-9fb2-ab9407711e99) {{(pid=63722) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Feb 03 13:28:29.818159 ubuntu-focal-ovh-bhs1-0028297773 <email address hidden>[63722]: INFO neutron.db.l3_db [None req-c75b805c-590a-4793-ac9d-51d93945926a tempest-ServerActionsTestJSON-974914713 tempest-ServerActionsTestJSON-974914713-project] Floating IP 42ad634c-9fce-4fff-87e0-c16cfddaa3ca associated. External IP: 172.24.5.190, port: a2859895-1f57-439f-8235-a9a7540e9a75.

Feb 03 13:31:50.314556 ubuntu-focal-ovh-bhs1-0028297773 <email address hidden>[63722]: INFO neutron.db.l3_db [req-10cd545c-dfcf-48b5-9754-0fb68c3bb271 req-30c83f43-a0b2-4cdd-915a-4afd4f8e7ced tempest-ServerActionsTestJSON-974914713 tempest-ServerActionsTestJSON-974914713-project] Floating IP 42ad634c-9fce-4fff-87e0-c16cfddaa3ca disassociated. External IP: 172.24.5.190, port: a2859895-1f57-439f-8235-a9a7540e9a75.