Fuel for OpenStack

Need to define explicit values for the rabbit_heartbeat parameter to all OpenStack services

Bug #1447559 reported by Leontii Istomin
14
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Opinion
High
Unassigned
Fuel for OpenStack 6.1-updates
6.0.x
Opinion
High
Unassigned
Fuel for OpenStack 6.0-updates
6.1.x
Opinion
High
Unassigned
Fuel for OpenStack 6.1-updates
7.0.x
Invalid
High
Bogdan Dobrelya
Fuel for OpenStack 7.0

Bug Description

Originally, AMQP heartbeats was developed as a 60 seconds hardcode in the MOS 5.1, but it seems that they were reworked and there is now a configuration option exist, which is rabbit_heartbeat. Fuel should not rely on implicit default values as this might bring back the issues similar to https://bugs.launchpad.net/fuel/+bug/1289200. Fuel should ensure explicit values for AMQP heartbeats enabled by puppet.

Regarding bug https://bugs.launchpad.net/mos/+bug/1430894
we need to enable amqp heatbeats for rabbitmq case.

Regarding this bug https://bugs.launchpad.net/mos/+bug/1447189
we need to set this parameter to 520 value

See original description
Leontii Istomin (listomin)
no longer affects: mos
Nastya Urlapova (aurlapova)
Changed in fuel:
assignee: nobody → MOS Oslo (mos-oslo)
milestone: none → 6.1
Alexey Khivin (akhivin)
Changed in fuel:
assignee: MOS Oslo (mos-oslo) → Fuel Library Team (fuel-library)
Revision history for this message
Bogdan Dobrelya (bogdando) wrote :

Cannot be fixed for the 6.0.x unless support of rabbit heartbeats backported to Neutron in 6.0.x as well

Changed in fuel:
importance: Undecided → High
status: New → Triaged
assignee: Fuel Library Team (fuel-library) → Bogdan Dobrelya (bogdando)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (master)

Fix proposed to branch: master
Review: https://review.openstack.org/176729

Changed in fuel:
status: Triaged → In Progress
Bogdan Dobrelya (bogdando)
summary: - Need to add rabbit_heartbeat parameter to OpenStack services
+ Need to adjust value of rabbit_heartbeat parameter to all OpenStack
+ services
Bogdan Dobrelya (bogdando)
Changed in fuel:
status: In Progress → Opinion
Bogdan Dobrelya (bogdando)
Changed in fuel:
importance: High → Medium
milestone: 6.1 → 7.0
tags: added: low-hanging-fruit
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on fuel-library (master)

Change abandoned by Bogdan Dobrelya (<email address hidden>) on branch: master
Review: https://review.openstack.org/176729

Revision history for this message
Bogdan Dobrelya (bogdando) wrote : Re: Need to enable rabbit_heartbeat parameter to all OpenStack services but Neutron (as it was agreed)

I'm restoring the change request as without heartbeats enabled nova compute services may be non functional after AMQP node failover

summary: - Need to adjust value of rabbit_heartbeat parameter to all OpenStack
- services
+ Need to enable rabbit_heartbeat parameter to all OpenStack services but
+ Neutron (as it was agreed)
Revision history for this message
Bogdan Dobrelya (bogdando) wrote :

IIRC, originally, AMQP heartbeats was developed as a 60 seconds hardcode in the MOS 5.1, but it seems that they were reworked and disabled by default, hence Fuel must ensure them now via puppet

Changed in fuel:
milestone: 7.0 → 6.1
no longer affects: fuel/7.0.x
no longer affects: fuel/6.1.x
Changed in fuel:
status: Opinion → In Progress
summary: Need to enable rabbit_heartbeat parameter to all OpenStack services but
- Neutron (as it was agreed)
+ Neutron (as it was agreed with MOS team)
description: updated
tags: added: rabbitmq
Revision history for this message
Bogdan Dobrelya (bogdando) wrote : Re: Need to enable rabbit_heartbeat parameter to all OpenStack services but Neutron (as it was agreed with MOS team)

The status of this bug is unknown for the 6.0.x, hence incomplete

Bogdan Dobrelya (bogdando)
description: updated
description: updated
summary: Need to enable rabbit_heartbeat parameter to all OpenStack services but
- Neutron (as it was agreed with MOS team)
+ Neutron
Bogdan Dobrelya (bogdando)
summary: - Need to enable rabbit_heartbeat parameter to all OpenStack services but
- Neutron
+ Need to define explicit values for the rabbit_heartbeat parameter to all
+ OpenStack services but Neutron
description: updated
Revision history for this message
Eugene Nikanorov (enikanorov) wrote : Re: Need to define explicit values for the rabbit_heartbeat parameter to all OpenStack services but Neutron

Neutron and oslo.messaging have been fixed with regard to heartbeats, e.g. amqp heartbeats are working ok.
Setting heart beat interval is possible.

Bogdan Dobrelya (bogdando)
summary: Need to define explicit values for the rabbit_heartbeat parameter to all
- OpenStack services but Neutron
+ OpenStack services
description: updated
Revision history for this message
Bogdan Dobrelya (bogdando) wrote :

As related bug https://bugs.launchpad.net/fuel/+bug/1454174 had shown, this is still nice-to-have improvement as it does not fix the main issue, which is nova-compute service sometimes may be marked as down by mistake.

Changed in fuel:
milestone: 6.1 → 7.0
status: In Progress → Opinion
OpenStack Infra (hudson-openstack)
Changed in fuel:
status: Opinion → In Progress
Revision history for this message
Bogdan Dobrelya (bogdando) wrote :

This bug is invalid for Kilo as Oslo.messaging will configure the heartbeats for all services as required

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on fuel-library (master)

Change abandoned by Bogdan Dobrelya (<email address hidden>) on branch: master
Review: https://review.openstack.org/176729

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.