Activity log for bug #1965297

Date Who What changed Old value New value Message
2022-03-17 12:14:13 Edward Hope-Morley bug added bug
2022-03-17 13:04:11 OpenStack Infra neutron: status New In Progress
2022-03-17 17:34:14 Miguel Lavalle neutron: assignee Edward Hope-Morley (hopem)
2022-03-17 20:52:36 Miguel Lavalle neutron: importance Undecided Medium
2022-03-18 09:20:13 Hua Zhang bug added subscriber Hua Zhang
2022-05-26 12:35:53 OpenStack Infra neutron: status In Progress Fix Released
2022-05-27 13:11:59 Corey Bryant bug task added neutron (Ubuntu)
2022-05-27 13:12:13 Corey Bryant nominated for series Ubuntu Jammy
2022-05-27 13:12:13 Corey Bryant bug task added neutron (Ubuntu Jammy)
2022-05-27 13:12:13 Corey Bryant nominated for series Ubuntu Kinetic
2022-05-27 13:12:13 Corey Bryant bug task added neutron (Ubuntu Kinetic)
2022-05-27 13:12:13 Corey Bryant nominated for series Ubuntu Impish
2022-05-27 13:12:13 Corey Bryant bug task added neutron (Ubuntu Impish)
2022-05-27 13:12:22 Corey Bryant neutron (Ubuntu Impish): status New Triaged
2022-05-27 13:12:25 Corey Bryant neutron (Ubuntu Jammy): status New Triaged
2022-05-27 13:12:31 Corey Bryant neutron (Ubuntu Impish): importance Undecided High
2022-05-27 13:12:34 Corey Bryant neutron (Ubuntu Jammy): importance Undecided High
2022-05-27 13:12:36 Corey Bryant neutron (Ubuntu Kinetic): status New Triaged
2022-05-27 13:12:38 Corey Bryant neutron (Ubuntu Kinetic): importance Undecided High
2022-05-27 13:12:48 Corey Bryant bug task added cloud-archive
2022-05-27 13:12:59 Corey Bryant nominated for series cloud-archive/zed
2022-05-27 13:12:59 Corey Bryant bug task added cloud-archive/zed
2022-05-27 13:12:59 Corey Bryant nominated for series cloud-archive/yoga
2022-05-27 13:12:59 Corey Bryant bug task added cloud-archive/yoga
2022-05-27 13:12:59 Corey Bryant nominated for series cloud-archive/xena
2022-05-27 13:12:59 Corey Bryant bug task added cloud-archive/xena
2022-05-27 13:13:07 Corey Bryant cloud-archive/xena: status New Triaged
2022-05-27 13:13:10 Corey Bryant cloud-archive/yoga: status New Triaged
2022-05-27 13:13:13 Corey Bryant cloud-archive/zed: status New Triaged
2022-05-27 13:13:17 Corey Bryant cloud-archive/yoga: importance Undecided High
2022-05-27 13:13:21 Corey Bryant cloud-archive/xena: importance Undecided High
2022-05-27 13:13:24 Corey Bryant cloud-archive/zed: importance Undecided High
2022-05-27 14:19:47 OpenStack Infra cloud-archive/xena: status Triaged In Progress
2022-05-27 14:31:20 Edward Hope-Morley description The history to this request is as follows; bug 1916024 fixed an issue that subsequently had to be reverted due to a regression that it introduced (see bug 1927868) and the original issue can once again present itself in that keepalived is unable to send GARP on the qg port until the port is marked as UP by neutron which in loaded environments can sometimes take longer than keepalived will wait (e.g. when an l3-agent is restarted on a host that has hundreds of routers). The reason why qg- ports are marked as DOWN is because of the patch landed as part of bug 1859832 and as I understand it there is now consensus from upstream [1] to revert that patch as well and a better solution is needed to fix that particular issue. I have not found a bug open yet for the revert hence why I am opening this one. [1] https://meetings.opendev.org/meetings/neutron_drivers/2022/neutron_drivers.2022-03-04-14.03.log.txt The history to this request is as follows; bug 1916024 fixed an issue that subsequently had to be reverted due to a regression that it introduced (see bug 1927868) and the original issue can once again present itself in that keepalived is unable to send GARP on the qg port until the port is marked as UP by neutron which in loaded environments can sometimes take longer than keepalived will wait (e.g. when an l3-agent is restarted on a host that has hundreds of routers). The reason why qg- ports are marked as DOWN is because of the patch landed as part of bug 1859832 and as I understand it there is now consensus from upstream [1] to revert that patch as well and a better solution is needed to fix that particular issue. I have not found a bug open yet for the revert hence why I am opening this one. [1] https://meetings.opendev.org/meetings/neutron_drivers/2022/neutron_drivers.2022-03-04-14.03.log.txt ------------ [Impact] Please see LP bug description for full details but in short, this patch is a revert of a patch that has show instability in the field for users of Neutron L3HA. [Test Plan] * Deploy Openstack with Neutron L3 HA enabled * Create a number of HA routers * Check all qrouter namespaces and ensure that the qg- port is UP in all [Regression Potential] Since the original patch was intended to address issues with MLDv2 it is possible that reverting it will re-introduce those issues and a new patch will need to be proposed to address that.
2022-05-27 14:53:02 Corey Bryant nominated for series cloud-archive/victoria
2022-05-27 14:53:02 Corey Bryant bug task added cloud-archive/victoria
2022-05-27 14:53:02 Corey Bryant nominated for series cloud-archive/wallaby
2022-05-27 14:53:02 Corey Bryant bug task added cloud-archive/wallaby
2022-05-27 14:53:02 Corey Bryant nominated for series cloud-archive/ussuri
2022-05-27 14:53:02 Corey Bryant bug task added cloud-archive/ussuri
2022-05-27 14:53:14 Corey Bryant cloud-archive/xena: status In Progress Triaged
2022-05-27 14:53:24 Corey Bryant cloud-archive/wallaby: importance Undecided High
2022-05-27 14:53:24 Corey Bryant cloud-archive/wallaby: status New Triaged
2022-05-27 14:53:34 Corey Bryant cloud-archive/victoria: importance Undecided High
2022-05-27 14:53:34 Corey Bryant cloud-archive/victoria: status New Triaged
2022-05-27 14:53:44 Corey Bryant cloud-archive/ussuri: importance Undecided High
2022-05-27 14:53:44 Corey Bryant cloud-archive/ussuri: status New Triaged
2022-05-27 14:54:08 Corey Bryant nominated for series Ubuntu Focal
2022-05-27 14:54:08 Corey Bryant bug task added neutron (Ubuntu Focal)
2022-05-27 14:54:19 Corey Bryant neutron (Ubuntu Focal): importance Undecided High
2022-05-27 14:54:19 Corey Bryant neutron (Ubuntu Focal): status New Triaged
2022-05-27 16:33:20 Corey Bryant bug added subscriber Ubuntu Stable Release Updates Team
2022-05-27 17:31:21 Brian Murray neutron (Ubuntu Jammy): status Triaged Fix Committed
2022-05-27 17:31:26 Brian Murray bug added subscriber SRU Verification
2022-05-27 17:31:31 Brian Murray tags verification-needed verification-needed-jammy
2022-05-27 17:34:30 Brian Murray neutron (Ubuntu Impish): status Triaged Fix Committed
2022-05-27 17:34:37 Brian Murray tags verification-needed verification-needed-jammy verification-needed verification-needed-impish verification-needed-jammy
2022-05-30 08:20:27 Stefan Hoffmann bug added subscriber Stefan Hoffmann
2022-05-30 11:59:53 OpenStack Infra cloud-archive/xena: status Triaged In Progress
2022-05-31 13:04:33 Corey Bryant cloud-archive: status Triaged Fix Committed
2022-05-31 13:04:36 Corey Bryant cloud-archive/yoga: status Triaged Fix Committed
2022-05-31 13:11:46 Corey Bryant cloud-archive/xena: status In Progress Fix Committed
2022-05-31 13:11:49 Corey Bryant tags verification-needed verification-needed-impish verification-needed-jammy verification-needed verification-needed-impish verification-needed-jammy verification-xena-needed
2022-06-13 20:14:32 OpenStack Infra cloud-archive/wallaby: status Triaged In Progress
2022-06-15 17:57:32 Corey Bryant neutron (Ubuntu Kinetic): status Triaged Fix Released
2022-06-15 17:57:46 Corey Bryant cloud-archive/zed: status Fix Committed Fix Released
2022-06-20 12:30:19 Edward Hope-Morley tags verification-needed verification-needed-impish verification-needed-jammy verification-xena-needed verification-done-jammy verification-needed verification-needed-impish verification-xena-needed
2022-06-20 15:04:58 Edward Hope-Morley tags verification-done-jammy verification-needed verification-needed-impish verification-xena-needed verification-done-impish verification-done-jammy verification-needed verification-xena-needed
2022-06-20 16:14:16 Edward Hope-Morley tags verification-done-impish verification-done-jammy verification-needed verification-xena-needed verification-done verification-done-impish verification-done-jammy verification-xena-done
2022-06-21 22:21:58 Launchpad Janitor neutron (Ubuntu Jammy): status Fix Committed Fix Released
2022-06-21 22:22:05 Brian Murray removed subscriber Ubuntu Stable Release Updates Team
2022-06-22 12:26:29 Corey Bryant cloud-archive/yoga: status Fix Committed Fix Released
2022-06-22 19:36:56 Corey Bryant cloud-archive/xena: status Fix Committed Fix Released
2022-06-25 10:07:33 OpenStack Infra cloud-archive/victoria: status Triaged In Progress
2022-06-25 10:14:13 OpenStack Infra cloud-archive/ussuri: status Triaged In Progress
2022-07-06 13:44:59 Corey Bryant bug added subscriber Ubuntu Stable Release Updates Team
2022-07-06 17:51:37 Corey Bryant cloud-archive/wallaby: status In Progress Fix Committed
2022-07-06 17:51:39 Corey Bryant tags verification-done verification-done-impish verification-done-jammy verification-xena-done verification-done verification-done-impish verification-done-jammy verification-wallaby-needed verification-xena-done
2022-07-06 17:52:46 Corey Bryant cloud-archive/victoria: status In Progress Fix Committed
2022-07-06 17:52:49 Corey Bryant tags verification-done verification-done-impish verification-done-jammy verification-wallaby-needed verification-xena-done verification-done verification-done-impish verification-done-jammy verification-victoria-needed verification-wallaby-needed verification-xena-done
2022-07-13 10:31:07 Robie Basak neutron (Ubuntu Focal): status Triaged Fix Committed
2022-07-13 10:31:13 Robie Basak tags verification-done verification-done-impish verification-done-jammy verification-victoria-needed verification-wallaby-needed verification-xena-done verification-done-impish verification-done-jammy verification-needed verification-needed-focal verification-victoria-needed verification-wallaby-needed verification-xena-done
2022-07-13 17:37:08 Corey Bryant cloud-archive/ussuri: status In Progress Fix Committed
2022-07-13 17:37:11 Corey Bryant tags verification-done-impish verification-done-jammy verification-needed verification-needed-focal verification-victoria-needed verification-wallaby-needed verification-xena-done verification-done-impish verification-done-jammy verification-needed verification-needed-focal verification-ussuri-needed verification-victoria-needed verification-wallaby-needed verification-xena-done
2022-07-18 22:57:28 Brian Murray neutron (Ubuntu Impish): status Fix Committed Won't Fix
2022-07-21 14:31:20 Edward Hope-Morley tags verification-done-impish verification-done-jammy verification-needed verification-needed-focal verification-ussuri-needed verification-victoria-needed verification-wallaby-needed verification-xena-done verification-done-impish verification-done-jammy verification-needed verification-needed-focal verification-ussuri-needed verification-victoria-needed verification-wallaby-done verification-xena-done
2022-07-21 18:35:07 Edward Hope-Morley tags verification-done-impish verification-done-jammy verification-needed verification-needed-focal verification-ussuri-needed verification-victoria-needed verification-wallaby-done verification-xena-done verification-done-impish verification-done-jammy verification-needed verification-needed-focal verification-ussuri-needed verification-victoria-done verification-wallaby-done verification-xena-done
2022-07-21 19:48:48 Edward Hope-Morley tags verification-done-impish verification-done-jammy verification-needed verification-needed-focal verification-ussuri-needed verification-victoria-done verification-wallaby-done verification-xena-done verification-done-focal verification-done-impish verification-done-jammy verification-needed verification-ussuri-needed verification-victoria-done verification-wallaby-done verification-xena-done
2022-07-25 14:27:08 Corey Bryant cloud-archive/wallaby: status Fix Committed Fix Released
2022-07-25 14:29:32 Corey Bryant tags verification-done-focal verification-done-impish verification-done-jammy verification-needed verification-ussuri-needed verification-victoria-done verification-wallaby-done verification-xena-done verification-done-focal verification-done-impish verification-done-jammy verification-doneverification-ussuri-needed verification-victoria-done verification-wallaby-done verification-xena-done
2022-07-25 14:29:37 Corey Bryant cloud-archive/victoria: status Fix Committed Fix Released
2022-07-25 14:29:42 Corey Bryant tags verification-done-focal verification-done-impish verification-done-jammy verification-doneverification-ussuri-needed verification-victoria-done verification-wallaby-done verification-xena-done verification-done verification-done-focal verification-done-impish verification-done-jammy verification-ussuri-needed verification-victoria-done verification-wallaby-done verification-xena-done
2022-07-25 14:42:11 Edward Hope-Morley tags verification-done verification-done-focal verification-done-impish verification-done-jammy verification-ussuri-needed verification-victoria-done verification-wallaby-done verification-xena-done verification-done verification-done-focal verification-done-impish verification-done-jammy verification-ussuri-done verification-victoria-done verification-wallaby-done verification-xena-done
2022-08-03 06:52:05 Launchpad Janitor neutron (Ubuntu Focal): status Fix Committed Fix Released
2022-08-03 19:01:48 Corey Bryant cloud-archive/ussuri: status Fix Committed Fix Released
2023-01-23 13:41:12 OpenStack Infra tags verification-done verification-done-focal verification-done-impish verification-done-jammy verification-ussuri-done verification-victoria-done verification-wallaby-done verification-xena-done in-stable-yoga verification-done verification-done-focal verification-done-impish verification-done-jammy verification-ussuri-done verification-victoria-done verification-wallaby-done verification-xena-done
2023-01-23 13:46:20 OpenStack Infra tags in-stable-yoga verification-done verification-done-focal verification-done-impish verification-done-jammy verification-ussuri-done verification-victoria-done verification-wallaby-done verification-xena-done in-stable-xena in-stable-yoga verification-done verification-done-focal verification-done-impish verification-done-jammy verification-ussuri-done verification-victoria-done verification-wallaby-done verification-xena-done
2023-11-14 23:03:29 OpenStack Infra tags in-stable-xena in-stable-yoga verification-done verification-done-focal verification-done-impish verification-done-jammy verification-ussuri-done verification-victoria-done verification-wallaby-done verification-xena-done in-stable-wallaby in-stable-xena in-stable-yoga verification-done verification-done-focal verification-done-impish verification-done-jammy verification-ussuri-done verification-victoria-done verification-wallaby-done verification-xena-done
2023-11-14 23:03:33 OpenStack Infra tags in-stable-wallaby in-stable-xena in-stable-yoga verification-done verification-done-focal verification-done-impish verification-done-jammy verification-ussuri-done verification-victoria-done verification-wallaby-done verification-xena-done in-stable-victoria in-stable-wallaby in-stable-xena in-stable-yoga verification-done verification-done-focal verification-done-impish verification-done-jammy verification-ussuri-done verification-victoria-done verification-wallaby-done verification-xena-done
2023-11-15 10:11:23 Stefan Hoffmann removed subscriber Stefan Hoffmann