| 2022-10-17 09:35:51 |
Aqsa Malik |
bug |
|
|
added bug |
| 2022-10-17 09:49:13 |
Aqsa Malik |
bug |
|
|
added subscriber Sreekanth Chowdary Sreeramineni |
| 2022-10-17 09:58:13 |
Nobuto Murata |
bug |
|
|
added subscriber Nobuto Murata |
| 2022-10-18 10:37:18 |
Lars Merke |
bug |
|
|
added subscriber Lars Merke |
| 2022-10-18 11:48:35 |
Przemyslaw Hausman |
bug |
|
|
added subscriber Canonical Field Critical |
| 2022-10-18 15:20:32 |
Przemyslaw Hausman |
attachment added |
|
rabbitctl_cluster_status_before_shutdown.txt https://bugs.launchpad.net/charm-rabbitmq-server/+bug/1993149/+attachment/5624872/+files/rabbitctl_cluster_status_before_shutdown.txt |
|
| 2022-10-18 15:20:52 |
Przemyslaw Hausman |
attachment added |
|
rabbitctl_cluster_status_after_shutdown.txt https://bugs.launchpad.net/charm-rabbitmq-server/+bug/1993149/+attachment/5624873/+files/rabbitctl_cluster_status_after_shutdown.txt |
|
| 2022-10-19 08:20:06 |
Przemyslaw Hausman |
bug |
|
|
added subscriber Przemyslaw Hausman |
| 2022-10-19 22:53:23 |
Corey Bryant |
charm-rabbitmq-server: assignee |
|
Corey Bryant (corey.bryant) |
|
| 2022-10-20 11:18:40 |
DUFOUR Olivier |
bug |
|
|
added subscriber DUFOUR Olivier |
| 2022-10-20 22:16:31 |
Corey Bryant |
charm-rabbitmq-server: status |
New |
Triaged |
|
| 2022-10-20 22:16:33 |
Corey Bryant |
charm-rabbitmq-server: importance |
Undecided |
Critical |
|
| 2022-10-21 12:53:07 |
Corey Bryant |
bug task added |
|
python-oslo.messaging (Ubuntu) |
|
| 2022-10-21 12:53:20 |
Corey Bryant |
bug task added |
|
oslo.messaging |
|
| 2022-10-21 12:53:27 |
Corey Bryant |
python-oslo.messaging (Ubuntu): status |
New |
Triaged |
|
| 2022-10-21 12:53:29 |
Corey Bryant |
python-oslo.messaging (Ubuntu): importance |
Undecided |
Critical |
|
| 2022-10-21 12:53:32 |
Corey Bryant |
python-oslo.messaging (Ubuntu): assignee |
|
Corey Bryant (corey.bryant) |
|
| 2022-10-21 12:53:38 |
Corey Bryant |
charm-rabbitmq-server: assignee |
Corey Bryant (corey.bryant) |
|
|
| 2022-10-21 12:53:45 |
Corey Bryant |
charm-rabbitmq-server: importance |
Critical |
Low |
|
| 2022-10-21 12:54:53 |
Corey Bryant |
nominated for series |
|
Ubuntu Jammy |
|
| 2022-10-21 12:54:53 |
Corey Bryant |
bug task added |
|
python-oslo.messaging (Ubuntu Jammy) |
|
| 2022-10-21 12:54:53 |
Corey Bryant |
nominated for series |
|
Ubuntu Kinetic |
|
| 2022-10-21 12:54:53 |
Corey Bryant |
bug task added |
|
python-oslo.messaging (Ubuntu Kinetic) |
|
| 2022-10-21 12:55:07 |
Corey Bryant |
bug task added |
|
cloud-archive |
|
| 2022-10-21 12:55:23 |
Corey Bryant |
nominated for series |
|
cloud-archive/zed |
|
| 2022-10-21 12:55:23 |
Corey Bryant |
bug task added |
|
cloud-archive/zed |
|
| 2022-10-21 12:55:23 |
Corey Bryant |
nominated for series |
|
cloud-archive/yoga |
|
| 2022-10-21 12:55:23 |
Corey Bryant |
bug task added |
|
cloud-archive/yoga |
|
| 2022-10-21 12:57:28 |
Corey Bryant |
cloud-archive/yoga: status |
New |
Triaged |
|
| 2022-10-21 12:57:30 |
Corey Bryant |
cloud-archive/zed: status |
New |
Triaged |
|
| 2022-10-21 12:57:32 |
Corey Bryant |
cloud-archive/zed: importance |
Undecided |
Critical |
|
| 2022-10-21 12:57:33 |
Corey Bryant |
cloud-archive/yoga: importance |
Undecided |
Critical |
|
| 2022-10-21 12:57:39 |
Corey Bryant |
python-oslo.messaging (Ubuntu Jammy): status |
New |
Triaged |
|
| 2022-10-21 12:57:41 |
Corey Bryant |
python-oslo.messaging (Ubuntu Jammy): importance |
Undecided |
Critical |
|
| 2022-10-21 21:03:20 |
Corey Bryant |
description |
When testing rabbitmq-server HA in our OpenStack Yoga cloud environment (Rabbitmq Server release 3.9/stable) we faced the following issues:
- When the leader unit is down we are unable to launch any VMs and the launched ones stay stuck in the 'BUILD' state.
- While checking the logs we see that several OpenStack services has issues in communicating with the rabbitmq-server
- After restarting all the services using rabbitmq (like Nova, Cinder, Neutron etc) the issue gets resolved and the VMs can be launched successfully
The corresponding logs are available at: https://pastebin.ubuntu.com/p/Bk3yktR8tp/
We also observed the same for rabbitmq-server unit which is first in the list of 'nova.conf' file, and after restarting the concerned rabbitmq unit we see that scheduling of VMs work fine again.
As this can be seen from this part of the log as well:
"Reconnected to AMQP server on 192.168.34.251:5672 via [amqp] client with port 41922." |
When testing rabbitmq-server HA in our OpenStack Yoga cloud environment (Rabbitmq Server release 3.9/stable) we faced the following issues:
- When the leader unit is down we are unable to launch any VMs and the launched ones stay stuck in the 'BUILD' state.
- While checking the logs we see that several OpenStack services has issues in communicating with the rabbitmq-server
- After restarting all the services using rabbitmq (like Nova, Cinder, Neutron etc) the issue gets resolved and the VMs can be launched successfully
The corresponding logs are available at: https://pastebin.ubuntu.com/p/Bk3yktR8tp/
We also observed the same for rabbitmq-server unit which is first in the list of 'nova.conf' file, and after restarting the concerned rabbitmq unit we see that scheduling of VMs work fine again.
As this can be seen from this part of the log as well:
"Reconnected to AMQP server on 192.168.34.251:5672 via [amqp] client with port 41922."
====== Ubuntu SRU Details =======
[Impact]
Active/active HA for rabbitmq is broken when a node goes down.
[Test Case]
Deploy openstack with 3 units of rabbitmq in active/active HA.
[Regression Potential]
Due to the criticality of this issue, I've decided to revert the upstream change that is causing the problem as a stop-gap until a proper fix is in place. That fix came in via https://bugs.launchpad.net/oslo.messaging/+bug/1935864. As a result we may see performance degradation in polling as described in that bug. |
|
| 2022-10-21 21:03:26 |
Corey Bryant |
bug |
|
|
added subscriber Ubuntu Stable Release Updates Team |
| 2022-10-26 12:15:30 |
Brian Murray |
python-oslo.messaging (Ubuntu Kinetic): status |
Triaged |
Fix Committed |
|
| 2022-10-26 12:15:40 |
Brian Murray |
bug |
|
|
added subscriber SRU Verification |
| 2022-10-26 12:15:53 |
Brian Murray |
tags |
|
verification-needed verification-needed-kinetic |
|
| 2022-10-26 12:24:24 |
Brian Murray |
python-oslo.messaging (Ubuntu Jammy): status |
Triaged |
Fix Committed |
|
| 2022-10-26 12:24:41 |
Brian Murray |
tags |
verification-needed verification-needed-kinetic |
verification-needed verification-needed-jammy verification-needed-kinetic |
|
| 2022-10-26 14:07:58 |
Corey Bryant |
cloud-archive: status |
Triaged |
Fix Committed |
|
| 2022-10-26 14:08:29 |
Corey Bryant |
cloud-archive/yoga: status |
Triaged |
Fix Committed |
|
| 2022-10-26 14:08:31 |
Corey Bryant |
tags |
verification-needed verification-needed-jammy verification-needed-kinetic |
verification-needed verification-needed-jammy verification-needed-kinetic verification-yoga-needed |
|
| 2022-10-27 11:18:12 |
Aqsa Malik |
tags |
verification-needed verification-needed-jammy verification-needed-kinetic verification-yoga-needed |
verification-needed verification-needed-jammy verification-needed-kinetic verification-yoga-done |
|
| 2022-10-28 06:43:22 |
Nobuto Murata |
tags |
verification-needed verification-needed-jammy verification-needed-kinetic verification-yoga-done |
verification-needed verification-needed-jammy verification-needed-kinetic verification-needed-zed verification-yoga-done |
|
| 2022-10-28 08:56:50 |
DUFOUR Olivier |
tags |
verification-needed verification-needed-jammy verification-needed-kinetic verification-needed-zed verification-yoga-done |
verification-done-jammy verification-needed verification-needed-kinetic verification-needed-zed verification-yoga-done |
|
| 2022-10-28 10:50:22 |
DUFOUR Olivier |
tags |
verification-done-jammy verification-needed verification-needed-kinetic verification-needed-zed verification-yoga-done |
verification-done-jammy verification-done-zed verification-needed verification-needed-kinetic verification-yoga-done |
|
| 2022-10-28 18:22:43 |
Thobias Trevisan |
bug |
|
|
added subscriber Thobias Trevisan |
| 2022-10-28 18:39:32 |
Felipe Alencastro |
bug |
|
|
added subscriber Felipe Alencastro |
| 2022-10-31 15:45:51 |
DUFOUR Olivier |
tags |
verification-done-jammy verification-done-zed verification-needed verification-needed-kinetic verification-yoga-done |
verification-done-jammy verification-done-kinetic verification-done-zed verification-needed verification-yoga-done |
|
| 2022-11-01 00:42:43 |
DUFOUR Olivier |
tags |
verification-done-jammy verification-done-kinetic verification-done-zed verification-needed verification-yoga-done |
verification-done verification-done-jammy verification-done-kinetic verification-done-zed verification-yoga-done |
|
| 2022-11-01 11:19:14 |
Launchpad Janitor |
python-oslo.messaging (Ubuntu): status |
Fix Committed |
Fix Released |
|
| 2022-11-15 15:34:24 |
Launchpad Janitor |
python-oslo.messaging (Ubuntu Kinetic): status |
Fix Committed |
Fix Released |
|
| 2022-11-15 15:34:27 |
Brian Murray |
removed subscriber Ubuntu Stable Release Updates Team |
|
|
|
| 2022-11-15 15:34:54 |
Launchpad Janitor |
python-oslo.messaging (Ubuntu Jammy): status |
Fix Committed |
Fix Released |
|
| 2022-11-15 15:47:10 |
Corey Bryant |
cloud-archive: status |
Fix Committed |
Fix Released |
|
| 2022-11-15 15:47:15 |
Corey Bryant |
cloud-archive/zed: status |
Fix Committed |
Fix Released |
|
| 2022-11-15 15:47:30 |
Corey Bryant |
cloud-archive/yoga: status |
Fix Committed |
Fix Released |
|
| 2022-12-05 18:10:19 |
OpenStack Infra |
oslo.messaging: status |
New |
In Progress |
|
| 2023-02-14 01:40:48 |
Nobuto Murata |
charm-rabbitmq-server: status |
Triaged |
Invalid |
|
| 2023-03-10 23:03:12 |
Billy Olsen |
removed subscriber Canonical Field Critical |
|
|
|
| 2023-04-11 11:52:54 |
Christian Rohmann |
bug |
|
|
added subscriber Christian Rohmann |
| 2023-05-18 14:19:42 |
OpenStack Infra |
oslo.messaging: status |
In Progress |
Fix Released |
|
| 2023-05-31 08:12:29 |
zibort |
bug |
|
|
added subscriber Lev Klimin |
| 2023-06-02 15:11:44 |
OpenStack Infra |
tags |
verification-done verification-done-jammy verification-done-kinetic verification-done-zed verification-yoga-done |
in-stable-zed verification-done verification-done-jammy verification-done-kinetic verification-done-zed verification-yoga-done |
|
| 2023-06-12 02:22:05 |
OpenStack Infra |
tags |
in-stable-zed verification-done verification-done-jammy verification-done-kinetic verification-done-zed verification-yoga-done |
in-stable-yoga in-stable-zed verification-done verification-done-jammy verification-done-kinetic verification-done-zed verification-yoga-done |
|
| 2023-06-23 01:42:10 |
OpenStack Infra |
tags |
in-stable-yoga in-stable-zed verification-done verification-done-jammy verification-done-kinetic verification-done-zed verification-yoga-done |
in-stable-xena in-stable-yoga in-stable-zed verification-done verification-done-jammy verification-done-kinetic verification-done-zed verification-yoga-done |
|
| 2023-07-27 13:43:23 |
Mesut Muhammet Şahin |
bug |
|
|
added subscriber Mesut Muhammet Şahin |
