| 2015-12-02 10:54:25 |
Mehdi Abaakouk |
bug |
|
|
added bug |
| 2015-12-02 10:55:24 |
Mehdi Abaakouk |
oslo.messaging: assignee |
|
Mehdi Abaakouk (sileht) |
|
| 2015-12-02 10:55:29 |
Mehdi Abaakouk |
oslo.messaging: importance |
Undecided |
High |
|
| 2015-12-02 10:59:01 |
Mehdi Abaakouk |
description |
Hi,
When a client died/restart/stop but was waiting more replies that the rpc_connection_pool size,
the server will hold all connections from the pool during the retry logic in case of the client come back with the same reaply_queue_id (that occurs only is rabbit is restart, not the client).
Cheers, |
Hi,
When a client died/restart/stop but was waiting more replies that the rpc_connection_pool size,
the server will hold all connections from the pool during the retry logic in case of the client come back with the same reply_queue_id (that occurs only is rabbit is restart, not the client).
Cheers, |
|
| 2015-12-02 10:59:18 |
Mehdi Abaakouk |
summary |
rabbit: starvation of connection pool |
rabbit: starvation of connections for reply |
|
| 2015-12-02 11:54:47 |
OpenStack Infra |
oslo.messaging: status |
New |
In Progress |
|
| 2015-12-03 01:07:38 |
Koji Iida |
bug |
|
|
added subscriber Koji Iida |
| 2015-12-03 21:06:26 |
OpenStack Infra |
oslo.messaging: status |
In Progress |
Fix Committed |
|
| 2015-12-07 18:53:02 |
Davanum Srinivas (DIMS) |
oslo.messaging: status |
Fix Committed |
Fix Released |
|
| 2015-12-07 18:53:02 |
Davanum Srinivas (DIMS) |
oslo.messaging: milestone |
|
3.1.0 |
|
| 2015-12-09 07:42:02 |
OpenStack Infra |
tags |
|
in-stable-kilo |
|
| 2015-12-11 09:30:22 |
OpenStack Infra |
tags |
in-stable-kilo |
in-stable-kilo in-stable-liberty |
|
| 2015-12-15 10:41:58 |
OpenStack Infra |
tags |
in-stable-kilo in-stable-liberty |
in-feature-pika in-stable-kilo in-stable-liberty |
|
| 2015-12-25 08:37:02 |
Xiang Hui |
description |
Hi,
When a client died/restart/stop but was waiting more replies that the rpc_connection_pool size,
the server will hold all connections from the pool during the retry logic in case of the client come back with the same reply_queue_id (that occurs only is rabbit is restart, not the client).
Cheers, |
Hi,
When a client died/restart/stop but was waiting more replies that the rpc_connection_pool size,
the server will hold all connections from the pool during the retry logic in case of the client come back with the same reply_queue_id (that occurs only is rabbit is restart, not the client).
Cheers,
---------------------------
[Impact]
This patch addresses an issue when multiple clients lost networks/died/restart/stop, the server will hold all connections from the pool(rpc_connection_pool size) during the retry logic in case of the client come back with the same reply_queue_id (that occurs only is rabbit is restart, not the client), and which cause nova-conductor infinitely reconnects to rabbit if large nova-compute hosts are deployment until all of the connections of the old reply messages are expired, for the quite large scaled cloud, high availability is broken.
[Test Case]
Note steps are for trusty-icehouse, including latest oslo.messaging library (1.3.0-0ubuntu1.2 at the time of this writing).
Deploy an OpenStack cloud w/ multiple rabbit nodes and multiple nova compute hosts then cut off the network between OpenStack services and RabbitMQ. Observe that the nova-conductor is infinitely reconnecting to rabbit nodes.
[Regression Potential]
None. |
|
| 2015-12-25 08:37:46 |
Xiang Hui |
attachment added |
|
trusty-icehouse.debdiff https://bugs.launchpad.net/oslo.messaging/+bug/1521958/+attachment/4540046/+files/trusty-icehouse.debdiff |
|
| 2015-12-29 08:33:27 |
Xiang Hui |
attachment added |
|
trusty-juno.debdiff https://bugs.launchpad.net/oslo.messaging/+bug/1521958/+attachment/4541633/+files/trusty-juno.debdiff |
|
| 2015-12-31 04:43:38 |
Xiang Hui |
branch linked |
|
lp:~xianghui/ubuntu/trusty/oslo.messaging/juno-lp1521958 |
|
| 2015-12-31 04:47:08 |
Xiang Hui |
branch linked |
|
lp:~xianghui/ubuntu/trusty/oslo.messaging/icehouse-lp1521958 |
|
| 2016-02-02 10:31:39 |
Louis Bouchard |
bug task added |
|
oslo.messaging (Ubuntu) |
|
| 2016-02-02 10:31:47 |
Louis Bouchard |
nominated for series |
|
Ubuntu Trusty |
|
| 2016-02-02 10:31:47 |
Louis Bouchard |
bug task added |
|
oslo.messaging (Ubuntu Trusty) |
|
| 2016-02-02 10:55:24 |
Louis Bouchard |
nominated for series |
|
Ubuntu Vivid |
|
| 2016-02-02 10:55:24 |
Louis Bouchard |
bug task added |
|
oslo.messaging (Ubuntu Vivid) |
|
| 2016-02-02 11:08:50 |
Edward Hope-Morley |
bug task added |
|
cloud-archive |
|
| 2016-02-02 11:10:50 |
Edward Hope-Morley |
oslo.messaging (Ubuntu Vivid): status |
New |
Fix Released |
|
| 2016-02-02 12:30:29 |
Ubuntu Foundations Team Bug Bot |
tags |
in-feature-pika in-stable-kilo in-stable-liberty |
in-feature-pika in-stable-kilo in-stable-liberty patch |
|
| 2016-02-02 12:30:37 |
Ubuntu Foundations Team Bug Bot |
bug |
|
|
added subscriber Ubuntu Sponsors Team |
| 2016-02-02 13:17:13 |
James Page |
nominated for series |
|
cloud-archive/juno |
|
| 2016-02-02 13:17:13 |
James Page |
bug task added |
|
cloud-archive/juno |
|
| 2016-02-02 22:21:46 |
Mathew Hodson |
oslo.messaging (Ubuntu): importance |
Undecided |
Medium |
|
| 2016-02-02 22:21:48 |
Mathew Hodson |
oslo.messaging (Ubuntu Trusty): importance |
Undecided |
Medium |
|
| 2016-02-02 22:21:50 |
Mathew Hodson |
oslo.messaging (Ubuntu Vivid): importance |
Undecided |
Medium |
|
| 2016-02-03 04:44:25 |
Xiang Hui |
attachment added |
|
trusty-juno-lp1521958.debdiff https://bugs.launchpad.net/oslo.messaging/+bug/1521958/+attachment/4562665/+files/trusty-juno-lp1521958.debdiff |
|
| 2016-02-03 04:44:56 |
Xiang Hui |
attachment added |
|
trusty-icehouse-lp1521958.debdiff https://bugs.launchpad.net/oslo.messaging/+bug/1521958/+attachment/4562666/+files/trusty-icehouse-lp1521958.debdiff |
|
| 2016-02-03 11:38:05 |
Edward Hope-Morley |
cloud-archive/juno: assignee |
|
Xiang Hui (xianghui) |
|
| 2016-03-08 13:04:49 |
Xiang Hui |
cloud-archive/juno: assignee |
Xiang Hui (xianghui) |
Corey Bryant (corey.bryant) |
|
| 2016-03-14 15:55:30 |
Dominique Poulain |
bug |
|
|
added subscriber Dominique Poulain |
| 2016-03-15 10:08:46 |
Edward Hope-Morley |
tags |
in-feature-pika in-stable-kilo in-stable-liberty patch |
in-feature-pika in-stable-kilo in-stable-liberty patch sts-sru |
|
| 2016-03-18 19:14:43 |
Corey Bryant |
bug task added |
|
python-oslo.messaging (Ubuntu) |
|
| 2016-03-18 19:14:57 |
Corey Bryant |
bug task deleted |
python-oslo.messaging (Ubuntu Trusty) |
|
|
| 2016-03-18 19:15:05 |
Corey Bryant |
bug task deleted |
python-oslo.messaging (Ubuntu Vivid) |
|
|
| 2016-03-18 19:15:21 |
Corey Bryant |
nominated for series |
|
Ubuntu Wily |
|
| 2016-03-18 19:15:21 |
Corey Bryant |
bug task added |
|
oslo.messaging (Ubuntu Wily) |
|
| 2016-03-18 19:15:21 |
Corey Bryant |
bug task added |
|
python-oslo.messaging (Ubuntu Wily) |
|
| 2016-03-18 19:15:31 |
Corey Bryant |
bug task deleted |
oslo.messaging (Ubuntu Wily) |
|
|
| 2016-03-18 19:16:37 |
Corey Bryant |
bug task deleted |
cloud-archive/juno |
|
|
| 2016-03-18 19:17:01 |
Corey Bryant |
bug task deleted |
cloud-archive |
|
|
| 2016-03-18 19:17:20 |
Corey Bryant |
bug task added |
|
cloud-archive |
|
| 2016-03-18 19:17:31 |
Corey Bryant |
nominated for series |
|
cloud-archive/juno |
|
| 2016-03-18 19:17:31 |
Corey Bryant |
bug task added |
|
cloud-archive/juno |
|
| 2016-03-18 19:19:39 |
Corey Bryant |
cloud-archive/juno: assignee |
|
Corey Bryant (corey.bryant) |
|
| 2016-03-18 19:19:42 |
Corey Bryant |
python-oslo.messaging (Ubuntu Wily): assignee |
|
Corey Bryant (corey.bryant) |
|
| 2016-03-18 19:19:44 |
Corey Bryant |
oslo.messaging (Ubuntu Vivid): assignee |
|
Corey Bryant (corey.bryant) |
|
| 2016-03-18 19:19:46 |
Corey Bryant |
oslo.messaging (Ubuntu Trusty): assignee |
|
Corey Bryant (corey.bryant) |
|
| 2016-03-18 19:19:51 |
Corey Bryant |
oslo.messaging (Ubuntu): status |
New |
Invalid |
|
| 2016-03-18 19:19:55 |
Corey Bryant |
python-oslo.messaging (Ubuntu): status |
New |
Invalid |
|
| 2016-03-18 19:20:00 |
Corey Bryant |
cloud-archive: status |
New |
Invalid |
|
| 2016-03-18 19:20:19 |
Corey Bryant |
python-oslo.messaging (Ubuntu Wily): status |
New |
In Progress |
|
| 2016-03-18 19:22:06 |
Corey Bryant |
oslo.messaging (Ubuntu Vivid): status |
Fix Released |
In Progress |
|
| 2016-03-18 19:22:28 |
Corey Bryant |
python-oslo.messaging (Ubuntu Wily): importance |
Undecided |
Medium |
|
| 2016-03-18 19:22:30 |
Corey Bryant |
cloud-archive: importance |
Undecided |
Critical |
|
| 2016-03-18 19:22:34 |
Corey Bryant |
cloud-archive: importance |
Critical |
Undecided |
|
| 2016-03-18 19:22:36 |
Corey Bryant |
cloud-archive/juno: importance |
Undecided |
Medium |
|
| 2016-03-18 19:22:43 |
Corey Bryant |
oslo.messaging (Ubuntu): importance |
Medium |
Undecided |
|
| 2016-03-18 19:22:50 |
Corey Bryant |
oslo.messaging (Ubuntu Vivid): status |
In Progress |
New |
|
| 2016-03-24 16:32:34 |
Chris J Arges |
python-oslo.messaging (Ubuntu Wily): status |
In Progress |
Fix Committed |
|
| 2016-03-24 16:32:37 |
Chris J Arges |
bug |
|
|
added subscriber Ubuntu Stable Release Updates Team |
| 2016-03-24 16:32:38 |
Chris J Arges |
bug |
|
|
added subscriber SRU Verification |
| 2016-03-24 16:32:42 |
Chris J Arges |
tags |
in-feature-pika in-stable-kilo in-stable-liberty patch sts-sru |
in-feature-pika in-stable-kilo in-stable-liberty patch sts-sru verification-needed |
|
| 2016-03-25 07:31:47 |
Mathew Hodson |
bug |
|
|
added subscriber Mathew Hodson |
| 2016-03-31 12:12:39 |
James Page |
nominated for series |
|
cloud-archive/liberty |
|
| 2016-03-31 12:12:39 |
James Page |
bug task added |
|
cloud-archive/liberty |
|
| 2016-03-31 12:12:56 |
James Page |
oslo.messaging (Ubuntu Vivid): status |
New |
Won't Fix |
|
| 2016-03-31 12:14:13 |
James Page |
cloud-archive/liberty: status |
New |
Fix Committed |
|
| 2016-03-31 12:14:15 |
James Page |
tags |
in-feature-pika in-stable-kilo in-stable-liberty patch sts-sru verification-needed |
in-feature-pika in-stable-kilo in-stable-liberty patch sts-sru verification-liberty-needed verification-needed |
|
| 2016-03-31 19:55:09 |
Mathew Hodson |
bug task deleted |
oslo.messaging (Ubuntu) |
|
|
| 2016-04-14 18:47:05 |
Corey Bryant |
tags |
in-feature-pika in-stable-kilo in-stable-liberty patch sts-sru verification-liberty-needed verification-needed |
in-feature-pika in-stable-kilo in-stable-liberty patch sts-sru verification-done verification-liberty-done |
|
| 2016-04-20 13:17:10 |
Launchpad Janitor |
python-oslo.messaging (Ubuntu Wily): status |
Fix Committed |
Fix Released |
|
| 2016-04-20 13:17:21 |
Chris J Arges |
removed subscriber Ubuntu Stable Release Updates Team |
|
|
|
| 2016-04-20 13:28:40 |
James Page |
cloud-archive/liberty: status |
Fix Committed |
Fix Released |
|
| 2016-05-11 19:15:44 |
Corey Bryant |
nominated for series |
|
cloud-archive/kilo |
|
| 2016-05-11 19:15:44 |
Corey Bryant |
bug task added |
|
cloud-archive/kilo |
|
| 2016-05-11 19:15:53 |
Corey Bryant |
cloud-archive/kilo: assignee |
|
Corey Bryant (corey.bryant) |
|
| 2016-05-11 20:35:46 |
Ryan Beisner |
cloud-archive/kilo: status |
New |
Fix Committed |
|
| 2016-05-11 20:35:47 |
Ryan Beisner |
tags |
in-feature-pika in-stable-kilo in-stable-liberty patch sts-sru verification-done verification-liberty-done |
in-feature-pika in-stable-kilo in-stable-liberty patch sts-sru verification-done verification-kilo-needed verification-liberty-done |
|
| 2016-05-12 02:20:31 |
Mathew Hodson |
removed subscriber Mathew Hodson |
|
|
|
| 2016-05-18 13:06:27 |
Ryan Beisner |
cloud-archive/kilo: status |
Fix Committed |
Fix Released |
|
| 2016-05-18 19:33:00 |
Corey Bryant |
cloud-archive/juno: status |
New |
Won't Fix |
|
| 2016-05-18 19:33:06 |
Corey Bryant |
cloud-archive/juno: assignee |
Corey Bryant (corey.bryant) |
|
|
| 2016-05-20 21:08:42 |
Mathew Hodson |
oslo.messaging (Ubuntu Trusty): status |
New |
Triaged |
|
| 2016-07-01 07:04:04 |
Martin Pitt |
removed subscriber Ubuntu Sponsors Team |
|
|
|
| 2016-07-01 07:08:10 |
Martin Pitt |
oslo.messaging (Ubuntu Trusty): status |
Triaged |
In Progress |
|
| 2016-07-01 07:21:31 |
Martin Pitt |
oslo.messaging (Ubuntu Trusty): status |
In Progress |
Fix Committed |
|
| 2016-07-01 07:21:35 |
Martin Pitt |
bug |
|
|
added subscriber Ubuntu Stable Release Updates Team |
| 2016-07-01 07:21:38 |
Martin Pitt |
tags |
in-feature-pika in-stable-kilo in-stable-liberty patch sts-sru verification-done verification-kilo-needed verification-liberty-done |
in-feature-pika in-stable-kilo in-stable-liberty patch sts-sru verification-kilo-needed verification-liberty-done |
|
| 2016-07-01 07:21:39 |
Martin Pitt |
tags |
in-feature-pika in-stable-kilo in-stable-liberty patch sts-sru verification-kilo-needed verification-liberty-done |
in-feature-pika in-stable-kilo in-stable-liberty patch sts-sru verification-kilo-needed verification-liberty-done verification-needed |
|
| 2016-07-01 22:37:25 |
Mathew Hodson |
bug |
|
|
added subscriber Mathew Hodson |
| 2016-08-11 11:28:18 |
Launchpad Janitor |
branch linked |
|
lp:ubuntu/trusty-proposed/oslo.messaging |
|
| 2016-08-26 07:43:40 |
Xiang Hui |
tags |
in-feature-pika in-stable-kilo in-stable-liberty patch sts-sru verification-kilo-needed verification-liberty-done verification-needed |
in-feature-pika in-stable-kilo in-stable-liberty patch sts-sru verification-done verification-kilo-needed |
|
| 2016-08-26 08:01:37 |
Mathew Hodson |
tags |
in-feature-pika in-stable-kilo in-stable-liberty patch sts-sru verification-done verification-kilo-needed |
in-feature-pika in-stable-kilo in-stable-liberty patch sts-sru verification-done |
|
| 2016-08-31 15:04:44 |
Launchpad Janitor |
oslo.messaging (Ubuntu Trusty): status |
Fix Committed |
Fix Released |
|
| 2016-08-31 18:55:10 |
Mathew Hodson |
cloud-archive: status |
Invalid |
Fix Released |
|
| 2016-08-31 18:55:13 |
Mathew Hodson |
python-oslo.messaging (Ubuntu): status |
Invalid |
Fix Released |
|
| 2016-08-31 18:55:16 |
Mathew Hodson |
python-oslo.messaging (Ubuntu): importance |
Undecided |
Medium |
|
| 2016-08-31 18:55:24 |
Mathew Hodson |
removed subscriber Mathew Hodson |
|
|
|
| 2016-11-09 12:16:49 |
Louis Bouchard |
tags |
in-feature-pika in-stable-kilo in-stable-liberty patch sts-sru verification-done |
in-feature-pika in-stable-kilo in-stable-liberty patch verification-done |
|
