Activity log for bug #1454317

Date Who What changed Old value New value Message
2015-05-12 15:57:41 Liam Young bug added bug
2015-05-12 15:58:41 Liam Young description If the sst-password charm config option is not set then the charm generates a password. Unfortunatly in a clustered environment all units race to do this independantly of one another which can result in the wrong password being shared. For example in this three node deployment, the password is consistent accross the units: $ juju run --unit percona/0 "relation-get -r cluster:10 mysql-sstuser.passwd percona/1; relation-get -r cluster:10 mysql-sstuser.passwd percona/2;" P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M $ juju run --unit percona/1 "relation-get -r cluster:10 mysql-sstuser.passwd percona/0; relation-get -r cluster:10 mysql-sstuser.passwd percona/2;" P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M $ juju run --unit percona/2 "relation-get -r cluster:10 mysql-sstuser.passwd percona/0; relation-get -r cluster:10 mysql-sstuser.passwd percona/1;" P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M but it's wrong: $ juju run --service percona "mysql -h localhost -u sstuser --password=P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M" - MachineId: "10" ReturnCode: 1 Stderr: | ERROR 1045 (28000): Access denied for user 'sstuser'@'localhost' (using password: YES) Stdout: "" UnitId: percona/0 - MachineId: "11" ReturnCode: 1 Stderr: | ERROR 1045 (28000): Access denied for user 'sstuser'@'localhost' (using password: YES) Stdout: "" UnitId: percona/1 - MachineId: "12" ReturnCode: 1 Stderr: | ERROR 1045 (28000): Access denied for user 'sstuser'@'localhost' (using password: YES) Stdout: "" UnitId: percona/2 I added some logging to the charm to see what happened to the password: $ juju run --service percona "grep -E 'sstuser' /var/log/juju/unit-percona-*.log" - MachineId: "10" Stdout: | 2015-05-12 15:18:40 DEBUG unit.percona/0.juju-log cmd.go:247 Generating new password file '/var/lib/charm/percona/mysql-sstuser.passwd' 2015-05-12 15:18:40 DEBUG unit.percona/0.juju-log cmd.go:247 Writing password '2py5Y9JCVtW7XgBf8M2hhmVMpwPybpWd' to '/var/lib/charm/percona/mysql-sstuser.passwd' 2015-05-12 15:18:40 INFO unit.percona/0.juju-log cmd.go:247 Writing file /var/lib/charm/percona/mysql-sstuser.passwd root:root 660 2015-05-12 15:18:40 DEBUG unit.percona/0.juju-log cmd.go:247 Migrating mysql-sstuser.passwd 2py5Y9JCVtW7XgBf8M2hhmVMpwPybpWd to peer relation 2015-05-12 15:20:00 DEBUG unit.percona/0.juju-log cmd.go:247 Migrating mysql-sstuser.passwd 2py5Y9JCVtW7XgBf8M2hhmVMpwPybpWd to peer relation 2015-05-12 15:20:00 DEBUG unit.percona/0.juju-log cmd.go:247 Using existing password file '/var/lib/charm/percona/mysql-sstuser.passwd' 2015-05-12 15:20:00 DEBUG unit.percona/0.juju-log cmd.go:247 Migrating mysql-sstuser.passwd 2py5Y9JCVtW7XgBf8M2hhmVMpwPybpWd to peer relation 2015-05-12 15:20:02 DEBUG unit.percona/0.juju-log cmd.go:247 cluster:10: Using existing password file '/var/lib/charm/percona/mysql-sstuser.passwd' 2015-05-12 15:20:02 DEBUG unit.percona/0.juju-log cmd.go:247 cluster:10: Migrating mysql-sstuser.passwd 2py5Y9JCVtW7XgBf8M2hhmVMpwPybpWd to peer relation UnitId: percona/0 - MachineId: "11" Stdout: | 2015-05-12 15:18:39 DEBUG unit.percona/1.juju-log cmd.go:247 Generating new password file '/var/lib/charm/percona/mysql-sstuser.passwd' 2015-05-12 15:18:39 DEBUG unit.percona/1.juju-log cmd.go:247 Writing password 'P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M' to '/var/lib/charm/percona/mysql-sstuser.passwd' 2015-05-12 15:18:39 INFO unit.percona/1.juju-log cmd.go:247 Writing file /var/lib/charm/percona/mysql-sstuser.passwd root:root 660 2015-05-12 15:18:39 DEBUG unit.percona/1.juju-log cmd.go:247 Migrating mysql-sstuser.passwd P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M to peer relation 2015-05-12 15:19:59 DEBUG unit.percona/1.juju-log cmd.go:247 Migrating mysql-sstuser.passwd P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M to peer relation 2015-05-12 15:19:59 DEBUG unit.percona/1.juju-log cmd.go:247 Using existing password file '/var/lib/charm/percona/mysql-sstuser.passwd' 2015-05-12 15:19:59 DEBUG unit.percona/1.juju-log cmd.go:247 Migrating mysql-sstuser.passwd P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M to peer relation 2015-05-12 15:20:06 DEBUG unit.percona/1.juju-log cmd.go:247 cluster:10: Migrating mysql-sstuser.passwd P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M to peer relation UnitId: percona/1 - MachineId: "12" Stdout: | 2015-05-12 15:18:44 DEBUG unit.percona/2.juju-log cmd.go:247 Generating new password file '/var/lib/charm/percona/mysql-sstuser.passwd' 2015-05-12 15:18:44 DEBUG unit.percona/2.juju-log cmd.go:247 Writing password 'PMkbqmzm8Jt5jKK8KWHrRpdF3mg2RCPp' to '/var/lib/charm/percona/mysql-sstuser.passwd' 2015-05-12 15:18:44 INFO unit.percona/2.juju-log cmd.go:247 Writing file /var/lib/charm/percona/mysql-sstuser.passwd root:root 660 2015-05-12 15:18:44 DEBUG unit.percona/2.juju-log cmd.go:247 Migrating mysql-sstuser.passwd PMkbqmzm8Jt5jKK8KWHrRpdF3mg2RCPp to peer relation 2015-05-12 15:20:06 DEBUG unit.percona/2.juju-log cmd.go:247 Migrating mysql-sstuser.passwd PMkbqmzm8Jt5jKK8KWHrRpdF3mg2RCPp to peer relation 2015-05-12 15:20:06 DEBUG unit.percona/2.juju-log cmd.go:247 Using existing password file '/var/lib/charm/percona/mysql-sstuser.passwd' 2015-05-12 15:20:06 DEBUG unit.percona/2.juju-log cmd.go:247 Migrating mysql-sstuser.passwd PMkbqmzm8Jt5jKK8KWHrRpdF3mg2RCPp to peer relation 2015-05-12 15:20:08 DEBUG unit.percona/2.juju-log cmd.go:247 cluster:10: Migrating mysql-sstuser.passwd PMkbqmzm8Jt5jKK8KWHrRpdF3mg2RCPp to peer relation UnitId: percona/2 Each unit generated it's own password and percona/0 actually had the correct password before the peer stored value was overwritten by percona/1: juju run --service percona "mysql -h localhost -u sstuser --password=2py5Y9JCVtW7XgBf8M2hhmVMpwPybpWd -e 'select now() from dual;'" - MachineId: "10" Stdout: | now() 2015-05-12 15:45:53 UnitId: percona/0 - MachineId: "11" Stdout: | now() 2015-05-12 15:45:53 UnitId: percona/1 - MachineId: "12" Stdout: | now() 2015-05-12 15:45:53 UnitId: percona/2 liam@penguin:~$ vi /tmp/bob.py liam@penguin:~$ vi /tmp/sas liam@penguin:~$ cat /tmp/sas If the sst-password charm config option is not set then the charm generates a password. Unfortunatly in a clustered environment all units race to do this independantly of one another which can result in the wrong password being shared. For example in this three node deployment, the password is consistent accross the units: $ juju run --unit percona/0 "relation-get -r cluster:10 mysql-sstuser.passwd percona/1; relation-get -r cluster:10 mysql-sstuser.passwd percona/2;" P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M $ juju run --unit percona/1 "relation-get -r cluster:10 mysql-sstuser.passwd percona/0; relation-get -r cluster:10 mysql-sstuser.passwd percona/2;" P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M $ juju run --unit percona/2 "relation-get -r cluster:10 mysql-sstuser.passwd percona/0; relation-get -r cluster:10 mysql-sstuser.passwd percona/1;" P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M but it's wrong: $ juju run --service percona "mysql -h localhost -u sstuser --password=P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M" - MachineId: "10" ReturnCode: 1 Stderr: | ERROR 1045 (28000): Access denied for user 'sstuser'@'localhost' (using password: YES) Stdout: "" UnitId: percona/0 - MachineId: "11" ReturnCode: 1 Stderr: | ERROR 1045 (28000): Access denied for user 'sstuser'@'localhost' (using password: YES) Stdout: "" UnitId: percona/1 - MachineId: "12" ReturnCode: 1 Stderr: | ERROR 1045 (28000): Access denied for user 'sstuser'@'localhost' (using password: YES) Stdout: "" UnitId: percona/2 I added some logging to the charm to see what happened to the password: $ juju run --service percona "grep -E 'sstuser' /var/log/juju/unit-percona-*.log" - MachineId: "10" Stdout: | 2015-05-12 15:18:40 DEBUG unit.percona/0.juju-log cmd.go:247 Generating new password file '/var/lib/charm/percona/mysql-sstuser.passwd' 2015-05-12 15:18:40 DEBUG unit.percona/0.juju-log cmd.go:247 Writing password '2py5Y9JCVtW7XgBf8M2hhmVMpwPybpWd' to '/var/lib/charm/percona/mysql-sstuser.passwd' 2015-05-12 15:18:40 INFO unit.percona/0.juju-log cmd.go:247 Writing file /var/lib/charm/percona/mysql-sstuser.passwd root:root 660 2015-05-12 15:18:40 DEBUG unit.percona/0.juju-log cmd.go:247 Migrating mysql-sstuser.passwd 2py5Y9JCVtW7XgBf8M2hhmVMpwPybpWd to peer relation 2015-05-12 15:20:00 DEBUG unit.percona/0.juju-log cmd.go:247 Migrating mysql-sstuser.passwd 2py5Y9JCVtW7XgBf8M2hhmVMpwPybpWd to peer relation 2015-05-12 15:20:00 DEBUG unit.percona/0.juju-log cmd.go:247 Using existing password file '/var/lib/charm/percona/mysql-sstuser.passwd' 2015-05-12 15:20:00 DEBUG unit.percona/0.juju-log cmd.go:247 Migrating mysql-sstuser.passwd 2py5Y9JCVtW7XgBf8M2hhmVMpwPybpWd to peer relation 2015-05-12 15:20:02 DEBUG unit.percona/0.juju-log cmd.go:247 cluster:10: Using existing password file '/var/lib/charm/percona/mysql-sstuser.passwd' 2015-05-12 15:20:02 DEBUG unit.percona/0.juju-log cmd.go:247 cluster:10: Migrating mysql-sstuser.passwd 2py5Y9JCVtW7XgBf8M2hhmVMpwPybpWd to peer relation UnitId: percona/0 - MachineId: "11" Stdout: | 2015-05-12 15:18:39 DEBUG unit.percona/1.juju-log cmd.go:247 Generating new password file '/var/lib/charm/percona/mysql-sstuser.passwd' 2015-05-12 15:18:39 DEBUG unit.percona/1.juju-log cmd.go:247 Writing password 'P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M' to '/var/lib/charm/percona/mysql-sstuser.passwd' 2015-05-12 15:18:39 INFO unit.percona/1.juju-log cmd.go:247 Writing file /var/lib/charm/percona/mysql-sstuser.passwd root:root 660 2015-05-12 15:18:39 DEBUG unit.percona/1.juju-log cmd.go:247 Migrating mysql-sstuser.passwd P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M to peer relation 2015-05-12 15:19:59 DEBUG unit.percona/1.juju-log cmd.go:247 Migrating mysql-sstuser.passwd P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M to peer relation 2015-05-12 15:19:59 DEBUG unit.percona/1.juju-log cmd.go:247 Using existing password file '/var/lib/charm/percona/mysql-sstuser.passwd' 2015-05-12 15:19:59 DEBUG unit.percona/1.juju-log cmd.go:247 Migrating mysql-sstuser.passwd P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M to peer relation 2015-05-12 15:20:06 DEBUG unit.percona/1.juju-log cmd.go:247 cluster:10: Migrating mysql-sstuser.passwd P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M to peer relation UnitId: percona/1 - MachineId: "12" Stdout: | 2015-05-12 15:18:44 DEBUG unit.percona/2.juju-log cmd.go:247 Generating new password file '/var/lib/charm/percona/mysql-sstuser.passwd' 2015-05-12 15:18:44 DEBUG unit.percona/2.juju-log cmd.go:247 Writing password 'PMkbqmzm8Jt5jKK8KWHrRpdF3mg2RCPp' to '/var/lib/charm/percona/mysql-sstuser.passwd' 2015-05-12 15:18:44 INFO unit.percona/2.juju-log cmd.go:247 Writing file /var/lib/charm/percona/mysql-sstuser.passwd root:root 660 2015-05-12 15:18:44 DEBUG unit.percona/2.juju-log cmd.go:247 Migrating mysql-sstuser.passwd PMkbqmzm8Jt5jKK8KWHrRpdF3mg2RCPp to peer relation 2015-05-12 15:20:06 DEBUG unit.percona/2.juju-log cmd.go:247 Migrating mysql-sstuser.passwd PMkbqmzm8Jt5jKK8KWHrRpdF3mg2RCPp to peer relation 2015-05-12 15:20:06 DEBUG unit.percona/2.juju-log cmd.go:247 Using existing password file '/var/lib/charm/percona/mysql-sstuser.passwd' 2015-05-12 15:20:06 DEBUG unit.percona/2.juju-log cmd.go:247 Migrating mysql-sstuser.passwd PMkbqmzm8Jt5jKK8KWHrRpdF3mg2RCPp to peer relation 2015-05-12 15:20:08 DEBUG unit.percona/2.juju-log cmd.go:247 cluster:10: Migrating mysql-sstuser.passwd PMkbqmzm8Jt5jKK8KWHrRpdF3mg2RCPp to peer relation UnitId: percona/2 Each unit generated it's own password and percona/0 actually had the correct password before the peer stored value was overwritten by percona/1: juju run --service percona "mysql -h localhost -u sstuser --password=2py5Y9JCVtW7XgBf8M2hhmVMpwPybpWd -e 'select now() from dual;'" - MachineId: "10" Stdout: | now() 2015-05-12 15:45:53 UnitId: percona/0 - MachineId: "11" Stdout: | now() 2015-05-12 15:45:53 UnitId: percona/1 - MachineId: "12" Stdout: | now() 2015-05-12 15:45:53 UnitId: percona/2 Unsuprisingly the password is incorrect in the ha relation as well: $ juju run --unit mysql-hacluster/0 "relation-get -r ha:11 - percona/0 | grep -Eoh 'password.*'" password="P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M" $ juju run --unit mysql-hacluster/1 "relation-get -r ha:11 - percona/1 | grep -Eoh 'password.*'" password="P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M" $ juju run --unit mysql-hacluster/2 "relation-get -r ha:11 - percona/2 | grep -Eoh 'password.*'" password="P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M" If the sst-password charm config option is not set then the charm generates a password. Unfortunatly in a clustered environment all units race to do this independantly of one another which can result in the wrong password being shared. For example in this three node deployment, the password is consistent accross the units: $ juju run --unit percona/0 "relation-get -r cluster:10 mysql-sstuser.passwd percona/1; relation-get -r cluster:10 mysql-sstuser.passwd percona/2;" P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M $ juju run --unit percona/1 "relation-get -r cluster:10 mysql-sstuser.passwd percona/0; relation-get -r cluster:10 mysql-sstuser.passwd percona/2;" P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M $ juju run --unit percona/2 "relation-get -r cluster:10 mysql-sstuser.passwd percona/0; relation-get -r cluster:10 mysql-sstuser.passwd percona/1;" P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M but it's wrong: $ juju run --service percona "mysql -h localhost -u sstuser --password=P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M" - MachineId: "10"   ReturnCode: 1   Stderr: |     ERROR 1045 (28000): Access denied for user 'sstuser'@'localhost' (using password: YES)   Stdout: ""   UnitId: percona/0 - MachineId: "11"   ReturnCode: 1   Stderr: |     ERROR 1045 (28000): Access denied for user 'sstuser'@'localhost' (using password: YES)   Stdout: ""   UnitId: percona/1 - MachineId: "12"   ReturnCode: 1   Stderr: |     ERROR 1045 (28000): Access denied for user 'sstuser'@'localhost' (using password: YES)   Stdout: ""   UnitId: percona/2 I added some logging to the charm to see what happened to the password: $ juju run --service percona "grep -E 'sstuser' /var/log/juju/unit-percona-*.log" - MachineId: "10"   Stdout: |     2015-05-12 15:18:40 DEBUG unit.percona/0.juju-log cmd.go:247 Generating new password file '/var/lib/charm/percona/mysql-sstuser.passwd'     2015-05-12 15:18:40 DEBUG unit.percona/0.juju-log cmd.go:247 Writing password '2py5Y9JCVtW7XgBf8M2hhmVMpwPybpWd' to '/var/lib/charm/percona/mysql-sstuser.passwd'     2015-05-12 15:18:40 INFO unit.percona/0.juju-log cmd.go:247 Writing file /var/lib/charm/percona/mysql-sstuser.passwd root:root 660     2015-05-12 15:18:40 DEBUG unit.percona/0.juju-log cmd.go:247 Migrating mysql-sstuser.passwd 2py5Y9JCVtW7XgBf8M2hhmVMpwPybpWd to peer relation     2015-05-12 15:20:00 DEBUG unit.percona/0.juju-log cmd.go:247 Migrating mysql-sstuser.passwd 2py5Y9JCVtW7XgBf8M2hhmVMpwPybpWd to peer relation     2015-05-12 15:20:00 DEBUG unit.percona/0.juju-log cmd.go:247 Using existing password file '/var/lib/charm/percona/mysql-sstuser.passwd'     2015-05-12 15:20:00 DEBUG unit.percona/0.juju-log cmd.go:247 Migrating mysql-sstuser.passwd 2py5Y9JCVtW7XgBf8M2hhmVMpwPybpWd to peer relation     2015-05-12 15:20:02 DEBUG unit.percona/0.juju-log cmd.go:247 cluster:10: Using existing password file '/var/lib/charm/percona/mysql-sstuser.passwd'     2015-05-12 15:20:02 DEBUG unit.percona/0.juju-log cmd.go:247 cluster:10: Migrating mysql-sstuser.passwd 2py5Y9JCVtW7XgBf8M2hhmVMpwPybpWd to peer relation   UnitId: percona/0 - MachineId: "11"   Stdout: |     2015-05-12 15:18:39 DEBUG unit.percona/1.juju-log cmd.go:247 Generating new password file '/var/lib/charm/percona/mysql-sstuser.passwd'     2015-05-12 15:18:39 DEBUG unit.percona/1.juju-log cmd.go:247 Writing password 'P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M' to '/var/lib/charm/percona/mysql-sstuser.passwd'     2015-05-12 15:18:39 INFO unit.percona/1.juju-log cmd.go:247 Writing file /var/lib/charm/percona/mysql-sstuser.passwd root:root 660     2015-05-12 15:18:39 DEBUG unit.percona/1.juju-log cmd.go:247 Migrating mysql-sstuser.passwd P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M to peer relation     2015-05-12 15:19:59 DEBUG unit.percona/1.juju-log cmd.go:247 Migrating mysql-sstuser.passwd P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M to peer relation     2015-05-12 15:19:59 DEBUG unit.percona/1.juju-log cmd.go:247 Using existing password file '/var/lib/charm/percona/mysql-sstuser.passwd'     2015-05-12 15:19:59 DEBUG unit.percona/1.juju-log cmd.go:247 Migrating mysql-sstuser.passwd P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M to peer relation     2015-05-12 15:20:06 DEBUG unit.percona/1.juju-log cmd.go:247 cluster:10: Migrating mysql-sstuser.passwd P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M to peer relation   UnitId: percona/1 - MachineId: "12"   Stdout: |     2015-05-12 15:18:44 DEBUG unit.percona/2.juju-log cmd.go:247 Generating new password file '/var/lib/charm/percona/mysql-sstuser.passwd'     2015-05-12 15:18:44 DEBUG unit.percona/2.juju-log cmd.go:247 Writing password 'PMkbqmzm8Jt5jKK8KWHrRpdF3mg2RCPp' to '/var/lib/charm/percona/mysql-sstuser.passwd'     2015-05-12 15:18:44 INFO unit.percona/2.juju-log cmd.go:247 Writing file /var/lib/charm/percona/mysql-sstuser.passwd root:root 660     2015-05-12 15:18:44 DEBUG unit.percona/2.juju-log cmd.go:247 Migrating mysql-sstuser.passwd PMkbqmzm8Jt5jKK8KWHrRpdF3mg2RCPp to peer relation     2015-05-12 15:20:06 DEBUG unit.percona/2.juju-log cmd.go:247 Migrating mysql-sstuser.passwd PMkbqmzm8Jt5jKK8KWHrRpdF3mg2RCPp to peer relation     2015-05-12 15:20:06 DEBUG unit.percona/2.juju-log cmd.go:247 Using existing password file '/var/lib/charm/percona/mysql-sstuser.passwd'     2015-05-12 15:20:06 DEBUG unit.percona/2.juju-log cmd.go:247 Migrating mysql-sstuser.passwd PMkbqmzm8Jt5jKK8KWHrRpdF3mg2RCPp to peer relation     2015-05-12 15:20:08 DEBUG unit.percona/2.juju-log cmd.go:247 cluster:10: Migrating mysql-sstuser.passwd PMkbqmzm8Jt5jKK8KWHrRpdF3mg2RCPp to peer relation   UnitId: percona/2 Each unit generated it's own password and percona/0 actually had the correct password before the peer stored value was overwritten by percona/1: juju run --service percona "mysql -h localhost -u sstuser --password=2py5Y9JCVtW7XgBf8M2hhmVMpwPybpWd -e 'select now() from dual;'" - MachineId: "10"   Stdout: |     now()     2015-05-12 15:45:53   UnitId: percona/0 - MachineId: "11"   Stdout: |     now()     2015-05-12 15:45:53   UnitId: percona/1 - MachineId: "12"   Stdout: |     now()     2015-05-12 15:45:53   UnitId: percona/2 Unsuprisingly the password is incorrect in the ha relation as well: $ juju run --unit mysql-hacluster/0 "relation-get -r ha:11 - percona/0 | grep -Eoh 'password.*'" password="P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M" $ juju run --unit mysql-hacluster/1 "relation-get -r ha:11 - percona/1 | grep -Eoh 'password.*'" password="P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M" $ juju run --unit mysql-hacluster/2 "relation-get -r ha:11 - percona/2 | grep -Eoh 'password.*'" password="P2cqSpzb7Jk6fhwj8cJ6Sdydj3TPcj7M"
2015-05-12 15:59:11 Liam Young percona-cluster (Juju Charms Collection): importance Undecided Critical
2015-05-12 15:59:14 Liam Young percona-cluster (Juju Charms Collection): assignee Liam Young (gnuoy)
2015-05-12 15:59:15 Liam Young percona-cluster (Juju Charms Collection): importance Critical High
2015-05-12 15:59:19 Liam Young percona-cluster (Juju Charms Collection): status New Confirmed
2015-05-13 10:04:32 Xiang Hui bug added subscriber Xiang Hui
2015-05-13 10:19:06 Launchpad Janitor branch linked lp:~openstack-charmers/charms/trusty/percona-cluster/next
2015-05-13 10:38:06 Launchpad Janitor branch linked lp:~gnuoy/charms/trusty/percona-cluster/1454317
2015-05-13 10:38:24 Liam Young branch unlinked lp:~openstack-charmers/charms/trusty/percona-cluster/next
2015-07-20 09:55:42 Edward Hope-Morley percona-cluster (Juju Charms Collection): milestone 15.07
2015-07-20 09:55:50 Edward Hope-Morley tags openstack
2015-07-20 09:56:25 Edward Hope-Morley percona-cluster (Juju Charms Collection): status Confirmed In Progress
2015-07-20 10:08:42 Edward Hope-Morley branch linked lp:~gnuoy/charm-helpers/no-create-if-none
2015-08-10 16:48:33 James Page percona-cluster (Juju Charms Collection): milestone 15.07 15.10
2015-09-30 10:49:37 Liam Young percona-cluster (Juju Charms Collection): importance High Wishlist
2015-09-30 10:49:44 Liam Young percona-cluster (Juju Charms Collection): status In Progress Confirmed
2015-09-30 10:49:51 Liam Young percona-cluster (Juju Charms Collection): milestone 15.10
2016-06-27 14:54:15 Larry Michel tags openstack oil openstack
2016-07-04 15:33:06 Nobuto Murata bug added subscriber Nobuto Murata
2016-09-22 11:19:50 James Page percona-cluster (Juju Charms Collection): status Confirmed Triaged
2017-02-23 19:22:09 James Page charm-percona-cluster: importance Undecided Wishlist
2017-02-23 19:22:09 James Page charm-percona-cluster: status New Triaged
2017-02-23 19:22:09 James Page charm-percona-cluster: assignee Liam Young (gnuoy)
2017-02-23 19:22:11 James Page percona-cluster (Juju Charms Collection): status Triaged Invalid
2017-02-28 12:43:37 James Page charm-percona-cluster: assignee Liam Young (gnuoy)
2017-02-28 12:43:39 James Page percona-cluster (Juju Charms Collection): assignee Liam Young (gnuoy)
2017-02-28 12:44:13 James Page charm-percona-cluster: assignee James Page (james-page)
2017-02-28 12:44:14 James Page percona-cluster (Juju Charms Collection): assignee James Page (james-page)
2017-02-28 12:44:18 James Page percona-cluster (Juju Charms Collection): assignee James Page (james-page)
2017-02-28 12:44:54 James Page charm-percona-cluster: status Triaged In Progress
2017-03-08 18:50:55 OpenStack Infra charm-percona-cluster: status In Progress Fix Committed
2017-09-06 08:34:44 James Page charm-percona-cluster: milestone 17.08
2017-09-12 19:15:51 James Page charm-percona-cluster: status Fix Committed Fix Released