tripleo

Tempest test "neutron_tempest_plugin.api.test_port_forwardings.PortForwardingTestJSON" failing on periodic-tripleo-ci-centos-9-standalone-full-tempest-api-master

Bug #1989197 reported by Jakob Meng on 2022-09-09

This bug affects 1 person

Affects		Status	Importance	Assigned to	Milestone
	tripleo	Fix Released	Critical	Unassigned	tripleo zed-1

Bug Description

Our job periodic-tripleo-ci-centos-9-standalone-full-tempest-api-master fails consistently [1][2][3][4] on Tempest test:

neutron_tempest_plugin.api.test_port_forwardings.PortForwardingTestJSON

with:

  Traceback (most recent call last):
    File "/usr/lib/python3.9/site-packages/tempest/common/utils/__init__.py", line 89, in wrapper
      return func(*func_args, **func_kwargs)
    File "/usr/lib/python3.9/site-packages/neutron_tempest_plugin/api/test_port_forwardings.py", line 184, in test_associate_2_port_forwardings_to_floating_ip
      self._verify_created_pfs(fip['id'], created_pfs)
    File "/usr/lib/python3.9/site-packages/neutron_tempest_plugin/api/test_port_forwardings.py", line 137, in _verify_created_pfs
      self.assertIn(expected_pf, fip['port_forwardings'])
    File "/usr/lib/python3.9/site-packages/testtools/testcase.py", line 399, in assertIn
      self.assertThat(haystack, Contains(needle), message)
    File "/usr/lib/python3.9/site-packages/testtools/testcase.py", line 480, in assertThat
      raise mismatch_error
  testtools.matchers._impl.MismatchError: {'external_port': 2222, 'internal_port': 1111, 'protocol': 'tcp', 'internal_ip_address': '10.100.0.10'} not in [{'id': '1fec49f0-5191-4ebb-9e07-2d1e6fd428f4', 'protocol': 'tcp', 'internal_ip_address': '10.100.0.10', 'internal_port_id': '78a8e933-62ca-42cf-9758-dafc522ce1b5', 'internal_port': 1111, 'external_port': 2222}, {'id': 'f9201f97-f50c-44bc-b916-4be7ea88d9f0', 'protocol': 'tcp', 'internal_ip_address': '10.100.0.4', 'internal_port_id': '6b4210b5-d498-42ee-b9f7-ba7b99038442', 'internal_port': 3333, 'external_port': 4444}]

[1] https://logserver.rdoproject.org/56/44656/13/check/periodic-tripleo-ci-centos-9-standalone-full-tempest-api-master/727e0e0/logs/undercloud/var/log/tempest/stestr_results.html.gz
[2] https://logserver.rdoproject.org/50/44150/20/check/periodic-tripleo-ci-centos-9-standalone-full-tempest-api-master/455b029/logs/undercloud/var/log/tempest/stestr_results.html.gz
[3] https://logserver.rdoproject.org/29/44829/4/check/periodic-tripleo-ci-centos-9-standalone-full-tempest-api-master/8101527/logs/undercloud/var/log/tempest/stestr_results.html.gz
[4] https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-standalone-full-tempest-api-master/a987fcb/logs/undercloud/var/log/tempest/stestr_results.html.gz

Tags:

Jakob Meng (jm1337) on 2022-09-09

Changed in tripleo:
status:	New → Triaged
importance:	Undecided → Critical
milestone:	none → zed-1
tags:	added: ci promotion-blocker

Revision history for this message

Jakob Meng (jm1337) wrote on 2022-09-09:

job history:

https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-9-standalone-full-tempest-api-master&skip=0

skiplist patch:

https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/856764

Revision history for this message

yatin (yatinkarel) wrote on 2022-09-13:

[1] is required to fix the failing api tests.

Proposed revert of skip list [2] and testing in [3]

The reason it's not happening in neutron CI but in promotion pipelines because in tripleo jobs we use tempestconf and discover available api_extensions while in neutron jobs we add it statically[4] so currently those tests are skipped in neutron jobs.

[1] https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/855608
[2] https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/857067
[3] https://review.rdoproject.org/r/c/testproject/+/44894
[4] https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/855608/2/zuul.d/master_jobs.yaml#79