| 2023-04-26 08:44:56 |
Lucas Alvares Gomes |
bug |
|
|
added bug |
| 2023-04-26 09:42:57 |
OpenStack Infra |
neutron: status |
Triaged |
In Progress |
|
| 2023-04-26 12:59:59 |
Brian Haley |
bug |
|
|
added subscriber Brian Haley |
| 2023-04-26 14:02:52 |
Junien F |
bug |
|
|
added subscriber The Canonical Sysadmins |
| 2023-12-12 16:30:48 |
Terry Wilson |
neutron: assignee |
Lucas Alvares Gomes (lucasagomes) |
Terry Wilson (otherwiseguy) |
|
| 2023-12-19 05:34:32 |
yatin |
bug watch added |
|
https://bugzilla.redhat.com/show_bug.cgi?id=2214289 |
|
| 2023-12-19 05:34:45 |
yatin |
bug |
|
|
added subscriber yatin |
| 2024-01-04 13:21:44 |
OpenStack Infra |
neutron: status |
In Progress |
Fix Released |
|
| 2024-01-04 13:55:08 |
Bernard Cafarelli |
bug |
|
|
added subscriber Bernard Cafarelli |
| 2024-02-16 04:20:59 |
Seyeong Kim |
tags |
ovn |
ovn sts |
|
| 2024-02-16 04:21:07 |
Seyeong Kim |
bug task added |
|
neutron (Ubuntu) |
|
| 2024-02-16 04:21:21 |
Seyeong Kim |
nominated for series |
|
Ubuntu Focal |
|
| 2024-02-16 04:21:21 |
Seyeong Kim |
bug task added |
|
neutron (Ubuntu Focal) |
|
| 2024-02-16 04:21:21 |
Seyeong Kim |
nominated for series |
|
Ubuntu Jammy |
|
| 2024-02-16 04:21:21 |
Seyeong Kim |
bug task added |
|
neutron (Ubuntu Jammy) |
|
| 2024-02-16 04:21:29 |
Seyeong Kim |
neutron (Ubuntu): status |
New |
Fix Released |
|
| 2024-02-16 04:24:55 |
Seyeong Kim |
attachment added |
|
lp2017748_focal_yoga.debdiff https://bugs.launchpad.net/ubuntu/+source/neutron/+bug/2017748/+attachment/5746530/+files/lp2017748_focal_yoga.debdiff |
|
| 2024-02-16 04:31:26 |
Seyeong Kim |
description |
Reported at: https://bugzilla.redhat.com/show_bug.cgi?id=2187650
During a scalability test it was noted that a few VMs where having issues being pinged (2 out of ~5000 VMs in the test conducted). After some investigation it was found that the VMs in question did not receive a DHCP lease:
udhcpc: no lease, failing
FAIL
checking http://169.254.169.254/2009-04-04/instance-id
failed 1/20: up 181.90. request failed
And the ovnmeta- namespaces for the networks that the VMs was booting from were missing. Looking into the ovn-metadata-agent.log:
2023-04-18 06:56:09.864 353474 DEBUG neutron.agent.ovn.metadata.agent [-] There is no metadata port for network 9029c393-5c40-4bf2-beec-27413417eafa or it has no MAC or IP addresses configured, tearing the namespace down if needed _get_provision_params /usr/lib/python3.9/site-packages/neutron/agent/ovn/metadata/agent.py:495
Apparently, when the system is under stress (scalability tests) there are some edge cases where the metadata port information has not yet being propagated by OVN to the Southbound database and when the PortBindingChassisEvent event is being handled and try to find either the metadata port of the IP information on it (which is updated by ML2/OVN during subnet creation) it can not be found and fails silently with the error shown above.
Note that, running the same tests but with less concurrency did not trigger this issue. So only happens when the system is overloaded. |
[Impact]
ovnmeta- namespaces are missing intermittently then can't reach to VMs
[Test Case]
TBD
- Not able to reproduce this easily.
[Where problems could occur]
This patches are related to ovn metadata agent in compute.
VM's connectivity can possibly be affected by this patch when ovn is used.
Biding port to datapath could be affected.
[Others]
== ORIGINAL DESCRIPTION ==
Reported at: https://bugzilla.redhat.com/show_bug.cgi?id=2187650
During a scalability test it was noted that a few VMs where having issues being pinged (2 out of ~5000 VMs in the test conducted). After some investigation it was found that the VMs in question did not receive a DHCP lease:
udhcpc: no lease, failing
FAIL
checking http://169.254.169.254/2009-04-04/instance-id
failed 1/20: up 181.90. request failed
And the ovnmeta- namespaces for the networks that the VMs was booting from were missing. Looking into the ovn-metadata-agent.log:
2023-04-18 06:56:09.864 353474 DEBUG neutron.agent.ovn.metadata.agent [-] There is no metadata port for network 9029c393-5c40-4bf2-beec-27413417eafa or it has no MAC or IP addresses configured, tearing the namespace down if needed _get_provision_params /usr/lib/python3.9/site-packages/neutron/agent/ovn/metadata/agent.py:495
Apparently, when the system is under stress (scalability tests) there are some edge cases where the metadata port information has not yet being propagated by OVN to the Southbound database and when the PortBindingChassisEvent event is being handled and try to find either the metadata port of the IP information on it (which is updated by ML2/OVN during subnet creation) it can not be found and fails silently with the error shown above.
Note that, running the same tests but with less concurrency did not trigger this issue. So only happens when the system is overloaded. |
|
| 2024-02-16 04:39:08 |
Seyeong Kim |
neutron (Ubuntu Focal): assignee |
|
Seyeong Kim (seyeongkim) |
|
| 2024-02-16 04:39:11 |
Seyeong Kim |
neutron (Ubuntu Jammy): assignee |
|
Seyeong Kim (seyeongkim) |
|
| 2024-02-16 04:39:27 |
Seyeong Kim |
bug |
|
|
added subscriber Ubuntu Stable Release Updates Team |
| 2024-03-08 13:28:25 |
Sean Schneeweiß |
bug |
|
|
added subscriber Sean Schneeweiß |
| 2024-03-14 07:47:41 |
Hua Zhang |
summary |
OVN: ovnmeta namespaces missing during scalability test causing DHCP issues |
[SRU] OVN: ovnmeta namespaces missing during scalability test causing DHCP issues |
|
| 2024-03-19 09:45:30 |
Edward Hope-Morley |
bug task added |
|
cloud-archive |
|
| 2024-03-19 09:46:12 |
Edward Hope-Morley |
nominated for series |
|
cloud-archive/yoga |
|
| 2024-03-19 09:46:12 |
Edward Hope-Morley |
bug task added |
|
cloud-archive/yoga |
|
| 2024-03-19 09:46:12 |
Edward Hope-Morley |
nominated for series |
|
cloud-archive/zed |
|
| 2024-03-19 09:46:12 |
Edward Hope-Morley |
bug task added |
|
cloud-archive/zed |
|
| 2024-03-22 06:31:23 |
Seyeong Kim |
neutron (Ubuntu Jammy): assignee |
Seyeong Kim (seyeongkim) |
|
|
| 2024-03-22 06:31:26 |
Seyeong Kim |
neutron (Ubuntu Focal): assignee |
Seyeong Kim (seyeongkim) |
|
|
| 2024-03-22 06:31:31 |
Seyeong Kim |
attachment removed |
lp2017748_focal_yoga.debdiff https://bugs.launchpad.net/neutron/+bug/2017748/+attachment/5746530/+files/lp2017748_focal_yoga.debdiff |
|
|
| 2024-03-26 06:36:51 |
Hua Zhang |
attachment added |
|
focal_yoga.debdiff https://bugs.launchpad.net/neutron/+bug/2017748/+attachment/5759481/+files/focal_yoga.debdiff |
|
| 2024-03-26 06:38:09 |
Hua Zhang |
cloud-archive/yoga: assignee |
|
Hua Zhang (zhhuabj) |
|
| 2024-03-26 06:38:16 |
Hua Zhang |
cloud-archive/zed: assignee |
|
Hua Zhang (zhhuabj) |
|
| 2024-05-01 19:51:42 |
Brian Haley |
nominated for series |
|
neutron/wallaby |
|
| 2024-05-01 19:51:42 |
Brian Haley |
bug task added |
|
neutron/wallaby |
|
| 2024-05-01 19:51:42 |
Brian Haley |
nominated for series |
|
neutron/xena |
|
| 2024-05-01 19:51:42 |
Brian Haley |
bug task added |
|
neutron/xena |
|
| 2024-05-01 19:51:42 |
Brian Haley |
nominated for series |
|
neutron/ussuri |
|
| 2024-05-01 19:51:42 |
Brian Haley |
bug task added |
|
neutron/ussuri |
|
| 2024-05-01 19:51:42 |
Brian Haley |
nominated for series |
|
neutron/victoria |
|
| 2024-05-01 19:51:42 |
Brian Haley |
bug task added |
|
neutron/victoria |
|
| 2024-05-01 19:51:58 |
Brian Haley |
bug task deleted |
neutron |
|
|
| 2024-05-01 19:52:41 |
Brian Haley |
bug task added |
|
neutron |
|
| 2024-05-14 01:23:49 |
Hua Zhang |
bug task deleted |
cloud-archive/zed |
|
|
| 2024-05-14 02:16:24 |
Hua Zhang |
attachment added |
|
jammy.debdiff https://bugs.launchpad.net/neutron/+bug/2017748/+attachment/5778137/+files/jammy.debdiff |
|
