I have uploaded the puppet log from the failing node. I have looked at several of these (from trying this many times, they all seem to start with issues with mysql as shown here:
2015-11-12 22:51:40 +0000 Puppet (err): Execution of '/usr/bin/mysqladmin --defaults-extra-file=/root/.my.cnf flush-privileges' returned 1: /usr/bin/mysqladmin: connect to server at '172.27.34.2' failed
2015-11-12 22:51:40 +0000 /Stage[main]/Nova::Db::Mysql/Openstacklib::Db::Mysql[nova]/Openstacklib::Db::Mysql::Host_access[nova_localhost]/Database_grant[nova@localhost/nova]/privileges (err): change from to all failed: Execution of '/usr/bin/mysqladmin --defaults-extra-file=/root/.my.cnf flush-privileges' returned 1: /usr/bin/mysqladmin: connect to server at '172.27.34.2' failed
2015-11-12 23:00:13 +0000 Puppet (err): Execution of '/usr/bin/mysql --defaults-extra-file=/root/.my.cnf mysql -Be describe db' returned 1: ERROR 2003 (HY000): Can't connect to MySQL server on '172.27.34.2' (110)
2015-11-12 23:00:13 +0000 /Stage[main]/Heat::Db::Mysql/Openstacklib::Db::Mysql[heat]/Openstacklib::Db::Mysql::Host_access[heat_localhost]/Database_grant[heat@localhost/heat]/privileges (err): change from to all failed: Execution of '/usr/bin/mysql --defaults-extra-file=/root/.my.cnf mysql -Be describe db' returned 1: ERROR 2003 (HY000): Can't connect to MySQL server on '172.27.34.2' (110)
2015-11-12 23:02:52 +0000 Puppet (err): Execution of '/usr/bin/mysqladmin --defaults-extra-file=/root/.my.cnf flush-privileges' returned 1: /usr/bin/mysqladmin: connect to server at '172.27.34.2' failed
2015-11-12 23:02:52 +0000 /Stage[main]/Heat::Db::Mysql/Openstacklib::Db::Mysql[heat]/Openstacklib::Db::Mysql::Host_access[heat_localhost]/Database_grant[heat@localhost/heat]/privileges (err): change from to all failed: Execution of '/usr/bin/mysqladmin --defaults-extra-file=/root/.my.cnf flush-privileges' returned 1: /usr/bin/mysqladmin: connect to server at '172.27.34.2' failed
2015-11-12 23:10:04 +0000 Puppet (err): Execution of '/usr/bin/mysql --defaults-extra-file=/root/.my.cnf mysql -e create user 'neutron'@'localhost' identified by PASSWORD '*4354BA07EAF949F028416EA248FD0E3F61D115F5'' returned 1: ERROR 2003 (HY000): Can't connect to MySQL server on '172.27.34.2' (110)
2015-11-12 23:10:04 +0000 /Stage[main]/Neutron::Db::Mysql/Openstacklib::Db::Mysql[neutron]/Openstacklib::Db::Mysql::Host_access[neutron_localhost]/Database_user[neutron@localhost]/ensure (err): change from absent to present failed: Execution of '/usr/bin/mysql --defaults-extra-file=/root/.my.cnf mysql -e create user 'neutron'@'localhost' identified by PASSWORD '*4354BA07EAF949F028416EA248FD0E3F61D115F5'' returned 1: ERROR 2003 (HY000): Can't connect to MySQL server on '172.27.34.2' (110)
2015-11-12 23:12:13 +0000 Puppet (err): Execution of '/usr/bin/mysql --defaults-extra-file=/root/.my.cnf mysql -e INSERT INTO db (host, user, db) VALUES ('%', 'neutron', 'neutron')' returned 1: ERROR 2003 (HY000): Can't connect to MySQL server on '172.27.34.2' (110)
I have uploaded the puppet log from the failing node. I have looked at several of these (from trying this many times, they all seem to start with issues with mysql as shown here:
2015-11-12 22:51:40 +0000 Puppet (err): Execution of '/usr/bin/ mysqladmin --defaults- extra-file= /root/. my.cnf flush-privileges' returned 1: /usr/bin/ mysqladmin: connect to server at '172.27.34.2' failed main]/Nova: :Db::Mysql/ Openstacklib: :Db::Mysql[ nova]/Openstack lib::Db: :Mysql: :Host_access[ nova_localhost] /Database_ grant[nova@ localhost/ nova]/privilege s (err): change from to all failed: Execution of '/usr/bin/ mysqladmin --defaults- extra-file= /root/. my.cnf flush-privileges' returned 1: /usr/bin/ mysqladmin: connect to server at '172.27.34.2' failed extra-file= /root/. my.cnf mysql -Be describe db' returned 1: ERROR 2003 (HY000): Can't connect to MySQL server on '172.27.34.2' (110) main]/Heat: :Db::Mysql/ Openstacklib: :Db::Mysql[ heat]/Openstack lib::Db: :Mysql: :Host_access[ heat_localhost] /Database_ grant[heat@ localhost/ heat]/privilege s (err): change from to all failed: Execution of '/usr/bin/mysql --defaults- extra-file= /root/. my.cnf mysql -Be describe db' returned 1: ERROR 2003 (HY000): Can't connect to MySQL server on '172.27.34.2' (110) mysqladmin --defaults- extra-file= /root/. my.cnf flush-privileges' returned 1: /usr/bin/ mysqladmin: connect to server at '172.27.34.2' failed main]/Heat: :Db::Mysql/ Openstacklib: :Db::Mysql[ heat]/Openstack lib::Db: :Mysql: :Host_access[ heat_localhost] /Database_ grant[heat@ localhost/ heat]/privilege s (err): change from to all failed: Execution of '/usr/bin/ mysqladmin --defaults- extra-file= /root/. my.cnf flush-privileges' returned 1: /usr/bin/ mysqladmin: connect to server at '172.27.34.2' failed extra-file= /root/. my.cnf mysql -e create user 'neutron' @'localhost' identified by PASSWORD '*4354BA07EAF94 9F028416EA248FD 0E3F61D115F5' ' returned 1: ERROR 2003 (HY000): Can't connect to MySQL server on '172.27.34.2' (110) main]/Neutron: :Db::Mysql/ Openstacklib: :Db::Mysql[ neutron] /Openstacklib: :Db::Mysql: :Host_access[ neutron_ localhost] /Database_ user[neutron@ localhost] /ensure (err): change from absent to present failed: Execution of '/usr/bin/mysql --defaults- extra-file= /root/. my.cnf mysql -e create user 'neutron' @'localhost' identified by PASSWORD '*4354BA07EAF94 9F028416EA248FD 0E3F61D115F5' ' returned 1: ERROR 2003 (HY000): Can't connect to MySQL server on '172.27.34.2' (110) extra-file= /root/. my.cnf mysql -e INSERT INTO db (host, user, db) VALUES ('%', 'neutron', 'neutron')' returned 1: ERROR 2003 (HY000): Can't connect to MySQL server on '172.27.34.2' (110)
2015-11-12 22:51:40 +0000 /Stage[
2015-11-12 23:00:13 +0000 Puppet (err): Execution of '/usr/bin/mysql --defaults-
2015-11-12 23:00:13 +0000 /Stage[
2015-11-12 23:02:52 +0000 Puppet (err): Execution of '/usr/bin/
2015-11-12 23:02:52 +0000 /Stage[
2015-11-12 23:10:04 +0000 Puppet (err): Execution of '/usr/bin/mysql --defaults-
2015-11-12 23:10:04 +0000 /Stage[
2015-11-12 23:12:13 +0000 Puppet (err): Execution of '/usr/bin/mysql --defaults-