mysql process (or node) restart triggers full Galera sync

Bug #1293673 reported by Brad Durrow
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Invalid
High
Unassigned

Bug Description

{"build_id": "2013-12-27_00-24-14", "ostf_sha": "83ada35fec2664089e07fdc0d34861ae2a4d948a", "build_number": "214", "nailgun_sha": "af1598bcc9faf468d4d9265cc5c51fa8cea53136", "fuelmain_sha": "17eed776b30886851ae0042fa7a30184f5cd8eb6", "astute_sha": "6ce36837882399e0d3bb1ffdb2c3b2d8dcb84b54", "release": "4.0", "fuellib_sha": "eebe07913ee09311c8e7c9231f6785081327dc0e"}

Fuel 4.0, HA (3 controllers), Neutron VLAN, Ceph backend

A controller reboot or crm resource restart p-mysql causes that node to go into this state (as reported by mysql -e "show status like 'wsrep_local_state_comment';"):

wsrep_local_state_comment | Joining: receiving State Transfer

Currently on my cluster the node remains in this state for about 30 minutes.

Revision history for this message
Vladimir Kuklin (vkuklin) wrote :

Please, attach diagnostic snapshot.

Changed in fuel:
status: New → Incomplete
Revision history for this message
Andrew Woodward (xarses) wrote :

Vlad, what logs would be helpful, Brad's environment has over 10gb of logs so a snapshot is not realistic.

Revision history for this message
Vladimir Kuklin (vkuklin) wrote :

mysql and all pacemaker logs are mandatory

Changed in fuel:
status: Incomplete → New
importance: Undecided → High
Changed in fuel:
status: New → Incomplete
Mike Scherbakov (mihgen)
Changed in fuel:
milestone: none → 5.0
Andrew Woodward (xarses)
tags: added: customer-found ha
Revision history for this message
Mike Scherbakov (mihgen) wrote :

Brad, thank you for reporting a bug. Unfortunately, looks like we can't proceed without logs. If you reproduce this again, please attach logs and any additional details you may fine useful. Closing as Invalid for now.

Changed in fuel:
status: Incomplete → Invalid
Revision history for this message
Andrew Woodward (xarses) wrote :

This is the expected process for Galera, however I'm marking it as a dupe of 1293680 because it being used in the VIP while this state is a problem

Revision history for this message
Brad Durrow (l-brad) wrote : Re: [Bug 1293673] Re: mysql process (or node) restart triggers full Galera sync

This is two separate problems. 1293673 compounds 1293680 but one is related to MySQL galera config and the other is related to haproxy config.

Please excuse my thumb's tpyos.

> On May 7, 2014, at 6:07 PM, Andrew Woodward <email address hidden> wrote:
>
> *** This bug is a duplicate of bug 1293680 ***
> https://bugs.launchpad.net/bugs/1293680
>
> This is the expected process for Galera, however I'm marking it as a
> dupe of 1293680 because it being used in the VIP while this state is a
> problem
>
> ** This bug has been marked a duplicate of bug 1293680
> while Galera node is in Sync or Donor state many services are down
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1293673
>
> Title:
> mysql process (or node) restart triggers full Galera sync
>
> Status in Fuel: OpenStack installer that works:
> Invalid
>
> Bug description:
> {"build_id": "2013-12-27_00-24-14", "ostf_sha":
> "83ada35fec2664089e07fdc0d34861ae2a4d948a", "build_number": "214",
> "nailgun_sha": "af1598bcc9faf468d4d9265cc5c51fa8cea53136",
> "fuelmain_sha": "17eed776b30886851ae0042fa7a30184f5cd8eb6",
> "astute_sha": "6ce36837882399e0d3bb1ffdb2c3b2d8dcb84b54", "release":
> "4.0", "fuellib_sha": "eebe07913ee09311c8e7c9231f6785081327dc0e"}
>
> Fuel 4.0, HA (3 controllers), Neutron VLAN, Ceph backend
>
> A controller reboot or crm resource restart p-mysql causes that node
> to go into this state (as reported by mysql -e "show status like
> 'wsrep_local_state_comment';"):
>
> wsrep_local_state_comment | Joining: receiving State Transfer
>
> Currently on my cluster the node remains in this state for about 30
> minutes.
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/fuel/+bug/1293673/+subscriptions

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.