Activity log for bug #1462438

Date Who What changed Old value New value Message
2015-06-05 16:28:55 Mark Vanderwiel bug added bug
2015-06-05 16:42:07 Mark Vanderwiel description When using rabbit mq in multi controller environment (HA), if a controller node (with rabbitmq service) goes down, it can take a a long time (15 minutes) for compute nodes to automatically recover and begin using the alternate rabbitmq service. There existing heartbeat configuration options in oslo rabbitmq support to better handle these situations. https://github.com/openstack/oslo.messaging/blob/d685e6f80a5dfc5fba638beacde762c8ccf9a89d/oslo_messaging/_drivers/impl_rabbit.py#L138 cfg.IntOpt('heartbeat_timeout_threshold', default=0, help="Number of seconds after which the Rabbit broker is " "considered down if heartbeat's keep-alive fails " "(0 disable the heartbeat). EXPERIMENTAL"), cfg.IntOpt('heartbeat_rate', default=2, help='How often times during the heartbeat_timeout_threshold ' 'we check the heartbeat.'), These will be added to Common messaging attributes, and then to all the cookbook that uses rabbitmq. When using rabbit mq in multi controller environment (HA), if a controller node (with rabbitmq service) goes down, it can take a a long time (15 minutes) for compute nodes to automatically recover and begin using the alternate rabbitmq service. There existing heartbeat configuration options in oslo rabbitmq support to better handle these situations. https://github.com/openstack/oslo.messaging/blob/d685e6f80a5dfc5fba638beacde762c8ccf9a89d/oslo_messaging/_drivers/impl_rabbit.py#L138 cfg.IntOpt('heartbeat_timeout_threshold', default=0, help="Number of seconds after which the Rabbit broker is " "considered down if heartbeat's keep-alive fails " "(0 disable the heartbeat). EXPERIMENTAL"), cfg.IntOpt('heartbeat_rate', default=2, help='How often times during the heartbeat_timeout_threshold ' 'we check the heartbeat.'), These will be added to Common messaging attributes, and then to all the cookbook that uses rabbitmq. cookbook-openstack-bare-metal/templates/default/ironic.conf.erb:[oslo_messaging_rabbit] cookbook-openstack-block-storage/templates/default/cinder.conf.erb:[oslo_messaging_rabbit] cookbook-openstack-compute/templates/default/nova.conf.erb:[oslo_messaging_rabbit] cookbook-openstack-identity/templates/default/keystone.conf.erb:[oslo_messaging_rabbit] cookbook-openstack-image/templates/default/glance-api.conf.erb:[oslo_messaging_rabbit] cookbook-openstack-image/templates/default/glance-registry.conf.erb:[oslo_messaging_rabbit] cookbook-openstack-network/templates/default/neutron.conf.erb:[oslo_messaging_rabbit] cookbook-openstack-orchestration/templates/default/heat.conf.erb:[oslo_messaging_rabbit]
2015-06-05 16:42:11 Mark Vanderwiel openstack-chef: importance Undecided Medium
2015-06-05 16:42:17 Mark Vanderwiel openstack-chef: milestone kilo-rc1
2015-06-05 16:51:58 OpenStack Infra openstack-chef: status New In Progress
2015-06-15 03:05:05 OpenStack Infra openstack-chef: assignee Mark Vanderwiel (vanderwl) Ma Wen Cheng (mars914)
2015-06-22 20:08:30 Mark Vanderwiel openstack-chef: status In Progress Fix Released