Glance not reporting all units to percona-cluster

Bug #1442526 reported by Adam Collard
12
This bug affects 1 person
Affects Status Importance Assigned to Milestone
glance (Juju Charms Collection)
Fix Released
High
James Page

Bug Description

In symptoms which look remarkably similar to bug 1441811, but with Juju 1.22.1 on MAAS and therefore none of the SNAT issues, when glance tried to syncdb its connection to mysql (percona-cluster) got rejected.

The deployment was an Autopilot, two phased HA deployment, with waits between the phases to allow hacluster relations to settle. Percona-cluster units were deployed serially.

I've attached the full log, we can see that the charm (repeatedly) notes that 10.1.69.206 (glance/0) does not have a grant, the other units (glance/1 and glance/2) seem to have grants setup.

The traceback: http://paste.ubuntu.com/10789871/

grep mysql-0.*glance: http://paste.ubuntu.com/10789890/

The error went away when I "juju resolved --retry glance/0" by hand, several hours after the initial failure.

Related branches

Revision history for this message
Adam Collard (adam-collard) wrote :
description: updated
description: updated
Changed in glance (Juju Charms Collection):
assignee: nobody → Liam Young (gnuoy)
Revision history for this message
James Page (james-page) wrote :

unit-mysql-0[901]: 2015-04-09 16:48:14 DEBUG unit.mysql/0.juju-log cmd.go:247 cluster:2: Grant does NOT exist for host '10.1.69.206' on db 'glance'
unit-mysql-0[901]: 2015-04-09 16:48:14 DEBUG unit.mysql/0.juju-log cmd.go:247 cluster:2: Grant exists for host '10.1.69.234' on db 'glance'
unit-mysql-0[901]: 2015-04-09 16:48:14 DEBUG unit.mysql/0.juju-log cmd.go:247 cluster:2: Grant exists for host '10.1.69.223' on db 'glance'

Revision history for this message
James Page (james-page) wrote :

unit-glance-0[894]: 2015-04-09 16:47:58 INFO unit.glance/0.shared-db-relation-changed logger.go:40 2015-04-09 16:47:58.321 21114 CRITICAL glance [-] OperationalError: (OperationalError) (1130, "Host '10-1-69-206.beretstack' is not allowed to connect to this MySQL server") None None

James Page (james-page)
Changed in glance (Juju Charms Collection):
importance: Undecided → High
James Page (james-page)
Changed in glance (Juju Charms Collection):
status: New → In Progress
assignee: Liam Young (gnuoy) → James Page (james-page)
milestone: none → 15.04
James Page (james-page)
Changed in glance (Juju Charms Collection):
status: In Progress → Fix Committed
James Page (james-page)
Changed in glance (Juju Charms Collection):
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.