rabbitmq nodes repeatedly reporting the master node as being 'down' then 'up'

Bug #1309027 reported by Tom Howley
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Expired
Medium
Unassigned

Bug Description

I have a 3-node notcompute/control setup in my overcloud with a rabbitmq cluster across the three nodes:

notcompute0 is the master in the cluster.
The other two nodes are repeatedly logging messages, such as the following:

=INFO REPORT==== 17-Apr-2014::13:49:26 ===
rabbit on node 'rabbit@overcloud-notcompute0-nnu4kdtefome' up

=INFO REPORT==== 17-Apr-2014::13:50:10 ===
rabbit on node 'rabbit@overcloud-notcompute0-nnu4kdtefome' down

=INFO REPORT==== 17-Apr-2014::13:50:12 ===
rabbit on node 'rabbit@overcloud-notcompute0-nnu4kdtefome' up

=INFO REPORT==== 17-Apr-2014::13:50:56 ===
rabbit on node 'rabbit@overcloud-notcompute0-nnu4kdtefome' down

=INFO REPORT==== 17-Apr-2014::13:50:58 ===
rabbit on node 'rabbit@overcloud-notcompute0-nnu4kdtefome' up

=INFO REPORT==== 17-Apr-2014::13:51:43 ===
rabbit on node 'rabbit@overcloud-notcompute0-nnu4kdtefome' down

=INFO REPORT==== 17-Apr-2014::13:51:45 ===
rabbit on node 'rabbit@overcloud-notcompute0-nnu4kdtefome' up

=INFO REPORT==== 17-Apr-2014::13:52:08 ===
rabbit on node 'rabbit@overcloud-notcompute0-nnu4kdtefome' down

=INFO REPORT==== 17-Apr-2014::13:52:09 ===
rabbit on node 'rabbit@overcloud-notcompute0-nnu4kdtefome' up

=INFO REPORT==== 17-Apr-2014::13:52:29 ===
rabbit on node 'rabbit@overcloud-notcompute0-nnu4kdtefome' down

=INFO REPORT==== 17-Apr-2014::13:52:31 ===
rabbit on node 'rabbit@overcloud-notcompute0-nnu4kdtefome' up

=INFO REPORT==== 17-Apr-2014::13:53:15 ===
rabbit on node 'rabbit@overcloud-notcompute0-nnu4kdtefome' down

=INFO REPORT==== 17-Apr-2014::13:53:17 ===
rabbit on node 'rabbit@overcloud-notcompute0-nnu4kdtefome' up

=INFO REPORT==== 17-Apr-2014::13:54:02 ===
rabbit on node 'rabbit@overcloud-notcompute0-nnu4kdtefome' down

=INFO REPORT==== 17-Apr-2014::13:54:04 ===
rabbit on node 'rabbit@overcloud-notcompute0-nnu4kdtefome' up

=INFO REPORT==== 17-Apr-2014::13:54:48 ===
rabbit on node 'rabbit@overcloud-notcompute0-nnu4kdtefome' down

=INFO REPORT==== 17-Apr-2014::13:54:50 ===
rabbit on node 'rabbit@overcloud-notcompute0-nnu4kdtefome' up

Revision history for this message
Robert Collins (lifeless) wrote :

we don't have hostname propogation for multi-node control planes yet (amongst other issues) - so this is probably a symptom of multi-node control planes not being finished yet.

Changed in tripleo:
status: New → Incomplete
Revision history for this message
Tom Howley (tom-howley) wrote :

Just to clarify that hit this issue with a working rabbitmq cluster over three overcloud controller nodes.

Revision history for this message
Ben Nemec (bnemec) wrote :

Just setting an importance so this will stop showing up in the untriaged list. :-)

If this persists after the multi-node control planes are expected to be working then we need to revisit it.

Changed in tripleo:
importance: Undecided → Medium
Revision history for this message
Launchpad Janitor (janitor) wrote :

[Expired for tripleo because there has been no activity for 60 days.]

Changed in tripleo:
status: Incomplete → Expired
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.