tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops fails in all c8s integration jobs

Bug #1957913 reported by Takashi Kajinami
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
puppet-openstack-integration
Fix Released
Critical
Takashi Kajinami

Bug Description

Starting from Jan 13th, all integration jobs on CentOS8 Stream are failing, because of the following test case.

tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops

Looking at the output of tempest, ping to a floating ip always fails.

tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops[compute,id-f323b3ba-82f8-4db7-8ea6-6a895869ec49,network,smoke]
-------------------------------------------------------------------------------------------------------------------------------------------------

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):

      File "/usr/lib/python3.6/site-packages/tempest/common/utils/__init__.py", line 70, in wrapper
    return f(*func_args, **func_kwargs)

      File "/usr/lib/python3.6/site-packages/tempest/scenario/test_network_basic_ops.py", line 436, in test_network_basic_ops
    self._check_public_network_connectivity(should_connect=True)

      File "/usr/lib/python3.6/site-packages/tempest/scenario/test_network_basic_ops.py", line 214, in _check_public_network_connectivity
    message, server, mtu=mtu)

      File "/usr/lib/python3.6/site-packages/tempest/scenario/manager.py", line 948, in check_vm_connectivity
    msg=msg)

      File "/usr/lib/python3.6/site-packages/unittest2/case.py", line 705, in assertTrue
    raise self.failureException(msg)

    AssertionError: False is not true : Public network connectivity check failed
Timed out waiting for 172.24.5.151 to become reachable

Changed in puppet-openstack-integration:
importance: Undecided → Critical
assignee: nobody → Takashi Kajinami (kajinamit)
Changed in puppet-openstack-integration:
status: New → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to puppet-openstack-integration (stable/xena)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to puppet-openstack-integration (stable/wallaby)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to puppet-openstack-integration (stable/victoria)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to puppet-openstack-integration (stable/ussuri)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to puppet-openstack-integration (stable/train)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to puppet-openstack-integration (master)

Reviewed: https://review.opendev.org/c/openstack/puppet-openstack-integration/+/824685
Committed: https://opendev.org/openstack/puppet-openstack-integration/commit/50c2dab0634e33ed3ce15af0baf03a878ef0b131
Submitter: "Zuul (22348)"
Branch: master

commit 50c2dab0634e33ed3ce15af0baf03a878ef0b131
Author: Takashi Kajinami <email address hidden>
Date: Fri Jan 14 18:33:47 2022 +0900

    Fix unprivileged ping

    Recent iputils in CentOS 8 Stream removed capabilities on the ping
    binary and requires the change in net.ipv4.ping_group_range to allow
    unprivileged users to ping, however the change in systemd[1] is not
    yet shipped.

    This is a temporal workaround and sets the kernel parameter. This can
    be removed once the fix is shipped as part of a new systemd package.

    [1] https://github.com/redhat-plumbers/systemd-rhel8/pull/246

    Closes-Bug: #1957913
    Change-Id: I6fc0e7a62106c53d983818fc8c8b9d1e1cdebb31

Changed in puppet-openstack-integration:
status: In Progress → Fix Released
tags: added: in-stable-xena
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to puppet-openstack-integration (stable/xena)

Reviewed: https://review.opendev.org/c/openstack/puppet-openstack-integration/+/824694
Committed: https://opendev.org/openstack/puppet-openstack-integration/commit/468b2263aa3663661b0a3062c4bda0806d31aead
Submitter: "Zuul (22348)"
Branch: stable/xena

commit 468b2263aa3663661b0a3062c4bda0806d31aead
Author: Takashi Kajinami <email address hidden>
Date: Fri Jan 14 18:33:47 2022 +0900

    Fix unprivileged ping

    Recent iputils in CentOS 8 Stream removed capabilities on the ping
    binary and requires the change in net.ipv4.ping_group_range to allow
    unprivileged users to ping, however the change in systemd[1] is not
    yet shipped.

    This is a temporal workaround and sets the kernel parameter. This can
    be removed once the fix is shipped as part of a new systemd package.

    [1] https://github.com/redhat-plumbers/systemd-rhel8/pull/246

    Closes-Bug: #1957913
    Change-Id: I6fc0e7a62106c53d983818fc8c8b9d1e1cdebb31
    (cherry picked from commit 50c2dab0634e33ed3ce15af0baf03a878ef0b131)

tags: added: in-stable-wallaby
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to puppet-openstack-integration (stable/wallaby)

Reviewed: https://review.opendev.org/c/openstack/puppet-openstack-integration/+/824695
Committed: https://opendev.org/openstack/puppet-openstack-integration/commit/9598bebff8a1882726b42468fb9994a9155e2e47
Submitter: "Zuul (22348)"
Branch: stable/wallaby

commit 9598bebff8a1882726b42468fb9994a9155e2e47
Author: Takashi Kajinami <email address hidden>
Date: Fri Jan 14 18:33:47 2022 +0900

    Fix unprivileged ping

    Recent iputils in CentOS 8 Stream removed capabilities on the ping
    binary and requires the change in net.ipv4.ping_group_range to allow
    unprivileged users to ping, however the change in systemd[1] is not
    yet shipped.

    This is a temporal workaround and sets the kernel parameter. This can
    be removed once the fix is shipped as part of a new systemd package.

    [1] https://github.com/redhat-plumbers/systemd-rhel8/pull/246

    Closes-Bug: #1957913
    Change-Id: I6fc0e7a62106c53d983818fc8c8b9d1e1cdebb31
    (cherry picked from commit 50c2dab0634e33ed3ce15af0baf03a878ef0b131)
    (cherry picked from commit 468b2263aa3663661b0a3062c4bda0806d31aead)

tags: added: in-stable-victoria
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to puppet-openstack-integration (stable/victoria)

Reviewed: https://review.opendev.org/c/openstack/puppet-openstack-integration/+/824696
Committed: https://opendev.org/openstack/puppet-openstack-integration/commit/287bcf55846f7d96289f89b1f5fbae85adc7961f
Submitter: "Zuul (22348)"
Branch: stable/victoria

commit 287bcf55846f7d96289f89b1f5fbae85adc7961f
Author: Takashi Kajinami <email address hidden>
Date: Fri Jan 14 18:33:47 2022 +0900

    Fix unprivileged ping

    Recent iputils in CentOS 8 Stream removed capabilities on the ping
    binary and requires the change in net.ipv4.ping_group_range to allow
    unprivileged users to ping, however the change in systemd[1] is not
    yet shipped.

    This is a temporal workaround and sets the kernel parameter. This can
    be removed once the fix is shipped as part of a new systemd package.

    [1] https://github.com/redhat-plumbers/systemd-rhel8/pull/246

    Closes-Bug: #1957913
    Change-Id: I6fc0e7a62106c53d983818fc8c8b9d1e1cdebb31
    (cherry picked from commit 50c2dab0634e33ed3ce15af0baf03a878ef0b131)
    (cherry picked from commit 468b2263aa3663661b0a3062c4bda0806d31aead)
    (cherry picked from commit 9598bebff8a1882726b42468fb9994a9155e2e47)

tags: added: in-stable-ussuri
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to puppet-openstack-integration (stable/ussuri)

Reviewed: https://review.opendev.org/c/openstack/puppet-openstack-integration/+/824697
Committed: https://opendev.org/openstack/puppet-openstack-integration/commit/2c270354698c87e5a43852a75db2e15608c36356
Submitter: "Zuul (22348)"
Branch: stable/ussuri

commit 2c270354698c87e5a43852a75db2e15608c36356
Author: Takashi Kajinami <email address hidden>
Date: Fri Jan 14 18:33:47 2022 +0900

    Fix unprivileged ping

    Recent iputils in CentOS 8 Stream removed capabilities on the ping
    binary and requires the change in net.ipv4.ping_group_range to allow
    unprivileged users to ping, however the change in systemd[1] is not
    yet shipped.

    This is a temporal workaround and sets the kernel parameter. This can
    be removed once the fix is shipped as part of a new systemd package.

    [1] https://github.com/redhat-plumbers/systemd-rhel8/pull/246

    Closes-Bug: #1957913
    Change-Id: I6fc0e7a62106c53d983818fc8c8b9d1e1cdebb31
    (cherry picked from commit 50c2dab0634e33ed3ce15af0baf03a878ef0b131)
    (cherry picked from commit 468b2263aa3663661b0a3062c4bda0806d31aead)
    (cherry picked from commit 9598bebff8a1882726b42468fb9994a9155e2e47)
    (cherry picked from commit 287bcf55846f7d96289f89b1f5fbae85adc7961f)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to puppet-openstack-integration (stable/train)

Reviewed: https://review.opendev.org/c/openstack/puppet-openstack-integration/+/824698
Committed: https://opendev.org/openstack/puppet-openstack-integration/commit/456c01ef0b5b91f7b4d58f62c39b035cb1740801
Submitter: "Zuul (22348)"
Branch: stable/train

commit 456c01ef0b5b91f7b4d58f62c39b035cb1740801
Author: Takashi Kajinami <email address hidden>
Date: Fri Jan 14 18:33:47 2022 +0900

    Fix unprivileged ping

    Recent iputils in CentOS 8 Stream removed capabilities on the ping
    binary and requires the change in net.ipv4.ping_group_range to allow
    unprivileged users to ping, however the change in systemd[1] is not
    yet shipped.

    This is a temporal workaround and sets the kernel parameter. This can
    be removed once the fix is shipped as part of a new systemd package.

    [1] https://github.com/redhat-plumbers/systemd-rhel8/pull/246

    Closes-Bug: #1957913
    Change-Id: I6fc0e7a62106c53d983818fc8c8b9d1e1cdebb31
    (cherry picked from commit 50c2dab0634e33ed3ce15af0baf03a878ef0b131)
    (cherry picked from commit 468b2263aa3663661b0a3062c4bda0806d31aead)
    (cherry picked from commit 9598bebff8a1882726b42468fb9994a9155e2e47)
    (cherry picked from commit 287bcf55846f7d96289f89b1f5fbae85adc7961f)
    (cherry picked from commit 2c270354698c87e5a43852a75db2e15608c36356)

tags: added: in-stable-train
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to puppet-openstack-integration (master)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to puppet-openstack-integration (master)

Reviewed: https://review.opendev.org/c/openstack/puppet-openstack-integration/+/849214
Committed: https://opendev.org/openstack/puppet-openstack-integration/commit/7f32dfabc78fc95652418eea0c5de63c42c9ea7e
Submitter: "Zuul (22348)"
Branch: master

commit 7f32dfabc78fc95652418eea0c5de63c42c9ea7e
Author: Takashi Kajinami <email address hidden>
Date: Sat Jul 9 16:10:19 2022 +0000

    Revert "Fix unprivileged ping"

    This reverts commit 50c2dab0634e33ed3ce15af0baf03a878ef0b131.

    Reason for revert:
    The issue was already resolved in the latest CentOS 8/9.

    Change-Id: I9236986dcf5bc0e893ede89a2f8c67f4f2587ec8
    Related-Bug: #1957913

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to puppet-openstack-integration (stable/yoga)

Related fix proposed to branch: stable/yoga
Review: https://review.opendev.org/c/openstack/puppet-openstack-integration/+/849529

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to puppet-openstack-integration (stable/xena)

Related fix proposed to branch: stable/xena
Review: https://review.opendev.org/c/openstack/puppet-openstack-integration/+/849635

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to puppet-openstack-integration (stable/wallaby)

Related fix proposed to branch: stable/wallaby
Review: https://review.opendev.org/c/openstack/puppet-openstack-integration/+/849636

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to puppet-openstack-integration (stable/victoria)

Related fix proposed to branch: stable/victoria
Review: https://review.opendev.org/c/openstack/puppet-openstack-integration/+/849637

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to puppet-openstack-integration (stable/ussuri)

Related fix proposed to branch: stable/ussuri
Review: https://review.opendev.org/c/openstack/puppet-openstack-integration/+/849638

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to puppet-openstack-integration (stable/train)

Related fix proposed to branch: stable/train
Review: https://review.opendev.org/c/openstack/puppet-openstack-integration/+/849639

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to puppet-openstack-integration (stable/yoga)

Reviewed: https://review.opendev.org/c/openstack/puppet-openstack-integration/+/849529
Committed: https://opendev.org/openstack/puppet-openstack-integration/commit/edacdfed772c4c3b931af9165dcfa875606ac729
Submitter: "Zuul (22348)"
Branch: stable/yoga

commit edacdfed772c4c3b931af9165dcfa875606ac729
Author: Takashi Kajinami <email address hidden>
Date: Sat Jul 9 16:10:19 2022 +0000

    Revert "Fix unprivileged ping"

    This reverts commit 50c2dab0634e33ed3ce15af0baf03a878ef0b131.

    Reason for revert:
    The issue was already resolved in the latest CentOS 8/9.

    Change-Id: I9236986dcf5bc0e893ede89a2f8c67f4f2587ec8
    Related-Bug: #1957913
    (cherry picked from commit 7f32dfabc78fc95652418eea0c5de63c42c9ea7e)

tags: added: in-stable-yoga
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to puppet-openstack-integration (stable/xena)

Reviewed: https://review.opendev.org/c/openstack/puppet-openstack-integration/+/849635
Committed: https://opendev.org/openstack/puppet-openstack-integration/commit/fe8dc851bd8ecfb3db7e9d434d3b6ec4838e455b
Submitter: "Zuul (22348)"
Branch: stable/xena

commit fe8dc851bd8ecfb3db7e9d434d3b6ec4838e455b
Author: Takashi Kajinami <email address hidden>
Date: Sat Jul 9 16:10:19 2022 +0000

    Revert "Fix unprivileged ping"

    This reverts commit 50c2dab0634e33ed3ce15af0baf03a878ef0b131.

    Reason for revert:
    The issue was already resolved in the latest CentOS 8/9.

    Change-Id: I9236986dcf5bc0e893ede89a2f8c67f4f2587ec8
    Related-Bug: #1957913
    (cherry picked from commit 7f32dfabc78fc95652418eea0c5de63c42c9ea7e)
    (cherry picked from commit edacdfed772c4c3b931af9165dcfa875606ac729)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to puppet-openstack-integration (stable/wallaby)

Reviewed: https://review.opendev.org/c/openstack/puppet-openstack-integration/+/849636
Committed: https://opendev.org/openstack/puppet-openstack-integration/commit/38c75c4dd3a967754234b07743fb8a9de146a2a3
Submitter: "Zuul (22348)"
Branch: stable/wallaby

commit 38c75c4dd3a967754234b07743fb8a9de146a2a3
Author: Takashi Kajinami <email address hidden>
Date: Sat Jul 9 16:10:19 2022 +0000

    Revert "Fix unprivileged ping"

    This reverts commit 50c2dab0634e33ed3ce15af0baf03a878ef0b131.

    Reason for revert:
    The issue was already resolved in the latest CentOS 8/9.

    Change-Id: I9236986dcf5bc0e893ede89a2f8c67f4f2587ec8
    Related-Bug: #1957913
    (cherry picked from commit 7f32dfabc78fc95652418eea0c5de63c42c9ea7e)
    (cherry picked from commit edacdfed772c4c3b931af9165dcfa875606ac729)
    (cherry picked from commit fe8dc851bd8ecfb3db7e9d434d3b6ec4838e455b)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to puppet-openstack-integration (stable/victoria)

Reviewed: https://review.opendev.org/c/openstack/puppet-openstack-integration/+/849637
Committed: https://opendev.org/openstack/puppet-openstack-integration/commit/6a47e851d5f78ba284d3da0360a5d0b924ea7c03
Submitter: "Zuul (22348)"
Branch: stable/victoria

commit 6a47e851d5f78ba284d3da0360a5d0b924ea7c03
Author: Takashi Kajinami <email address hidden>
Date: Sat Jul 9 16:10:19 2022 +0000

    Revert "Fix unprivileged ping"

    This reverts commit 50c2dab0634e33ed3ce15af0baf03a878ef0b131.

    Reason for revert:
    The issue was already resolved in the latest CentOS 8/9.

    Change-Id: I9236986dcf5bc0e893ede89a2f8c67f4f2587ec8
    Related-Bug: #1957913
    (cherry picked from commit 7f32dfabc78fc95652418eea0c5de63c42c9ea7e)
    (cherry picked from commit edacdfed772c4c3b931af9165dcfa875606ac729)
    (cherry picked from commit fe8dc851bd8ecfb3db7e9d434d3b6ec4838e455b)
    (cherry picked from commit 38c75c4dd3a967754234b07743fb8a9de146a2a3)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to puppet-openstack-integration (stable/ussuri)

Reviewed: https://review.opendev.org/c/openstack/puppet-openstack-integration/+/849638
Committed: https://opendev.org/openstack/puppet-openstack-integration/commit/01262dd950855456cb00ef1bc1e88ee1f1da34f4
Submitter: "Zuul (22348)"
Branch: stable/ussuri

commit 01262dd950855456cb00ef1bc1e88ee1f1da34f4
Author: Takashi Kajinami <email address hidden>
Date: Sat Jul 9 16:10:19 2022 +0000

    Revert "Fix unprivileged ping"

    This reverts commit 50c2dab0634e33ed3ce15af0baf03a878ef0b131.

    Reason for revert:
    The issue was already resolved in the latest CentOS 8/9.

    Change-Id: I9236986dcf5bc0e893ede89a2f8c67f4f2587ec8
    Related-Bug: #1957913
    (cherry picked from commit 7f32dfabc78fc95652418eea0c5de63c42c9ea7e)
    (cherry picked from commit edacdfed772c4c3b931af9165dcfa875606ac729)
    (cherry picked from commit fe8dc851bd8ecfb3db7e9d434d3b6ec4838e455b)
    (cherry picked from commit 38c75c4dd3a967754234b07743fb8a9de146a2a3)
    (cherry picked from commit 6a47e851d5f78ba284d3da0360a5d0b924ea7c03)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to puppet-openstack-integration (stable/train)

Reviewed: https://review.opendev.org/c/openstack/puppet-openstack-integration/+/849639
Committed: https://opendev.org/openstack/puppet-openstack-integration/commit/4e7c81efaa074687d43211c6ed1bb8e4f97a9046
Submitter: "Zuul (22348)"
Branch: stable/train

commit 4e7c81efaa074687d43211c6ed1bb8e4f97a9046
Author: Takashi Kajinami <email address hidden>
Date: Sat Jul 9 16:10:19 2022 +0000

    Revert "Fix unprivileged ping"

    This reverts commit 50c2dab0634e33ed3ce15af0baf03a878ef0b131.

    Reason for revert:
    The issue was already resolved in the latest CentOS 8/9.

    Change-Id: I9236986dcf5bc0e893ede89a2f8c67f4f2587ec8
    Related-Bug: #1957913
    (cherry picked from commit 7f32dfabc78fc95652418eea0c5de63c42c9ea7e)
    (cherry picked from commit edacdfed772c4c3b931af9165dcfa875606ac729)
    (cherry picked from commit fe8dc851bd8ecfb3db7e9d434d3b6ec4838e455b)
    (cherry picked from commit 38c75c4dd3a967754234b07743fb8a9de146a2a3)
    (cherry picked from commit 6a47e851d5f78ba284d3da0360a5d0b924ea7c03)
    (cherry picked from commit 01262dd950855456cb00ef1bc1e88ee1f1da34f4)

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.