Looks like the https://github.com/openstack/openstack-ansible-os_gnocchi/commit/2261aee6c1961e2ea28de83b563c4e250a051e61 may have broken the gnocchi DB connection
http://logs.openstack.org/34/572034/1/check/openstack-ansible-functional-opensuse-423/3ad7476/job-output.txt.gz#_2018-06-04_08_17_30_952805
oslo_db.sqlalchemy.engines: SQL connection failed. 9 attempts left.", "2018-06-04 08:16:10,582 [10630] WARNING oslo_db.sqlalchemy.engines: SQL connection failed. 8 attempts left.", "2018-06-04 08:16:20,594 [10630] WARNING oslo_db.sqlalchemy.engines: SQL connection failed. 7 attempts left.", "2018-06-04 08:16:30,604 [10630] WARNING oslo_db.sqlalchemy.engines: SQL connection failed. 6 attempts left.", "2018-06-04 08:16:40,615 [10630] WARNING oslo_db.sqlalchemy.engines: SQL connection failed. 5 attempts left.", "2018-06-04 08:16:50,627 [10630] WARNING oslo_db.sqlalchemy.engines: SQL connection failed. 4 attempts left.", "2018-06-04 08:17:00,635 [10630] WARNING oslo_db.sqlalchemy.engines: SQL connection failed. 3 attempts left.", "2018-06-04 08:17:10,646 [10630] WARNING oslo_db.sqlalchemy.engines: SQL connection failed. 2 attempts left.", "2018-06-04 08:17:20,658 [10630] WARNING oslo_db.sqlalchemy.engines: SQL connection failed. 1 attempts left.", "2018-06-04 08:17:30,671 [10630] CRITICAL root: Traceback (most recent call last):", " File \"/openstack/venvs/gnocchi-testing/bin/gnocchi-upgrade\", line 11, in <module>", " sys.exit(upgrade())", " File \"/openstack/venvs/gnocchi-testing/lib/python2.7/site-packages/gnocchi/cli/manage.py\", line 69, in upgrade", " index.upgrade()", " File \"/openstack/venvs/gnocchi-testing/lib/python2.7/site-packages/gnocchi/indexer/sqlalchemy.py\", line 320, in upgrade", " with self.facade.writer_connection() as connection:", " File \"/usr/lib64/python2.7/contextlib.py\", line 17, in __enter__", " return self.gen.next()", " File \"/openstack/venvs/gnocchi-testing/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py\", line 1041, in _transaction_scope", " context=context) as resource:", " File \"/usr/lib64/python2.7/contextlib.py\", line 17, in __enter__", " return self.gen.next()", " File \"/openstack/venvs/gnocchi-testing/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py\", line 611, in _connection", " mode=self.mode)", " File \"/openstack/venvs/gnocchi-testing/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py\", line 397, in _create_connection", " self._start()", " File \"/openstack/venvs/gnocchi-testing/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py\", line 495, in _start", " engine_args, maker_args)", " File \"/openstack/venvs/gnocchi-testing/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py\", line 519, in _setup_for_connection", " sql_connection=sql_connection, **engine_kwargs)", " File \"/openstack/venvs/gnocchi-testing/lib/python2.7/site-packages/debtcollector/renames.py\", line 43, in decorator", " return wrapped(*args, **kwargs)", " File \"/openstack/venvs/gnocchi-testing/lib/python2.7/site-packages/oslo_db/sqlalchemy/engines.py\", line 202, in create_engine", " test_conn = _test_connection(engine, max_retries, retry_interval)", " File \"/openstack/venvs/gnocchi-testing/lib/python2.7/site-packages/oslo_db/sqlalchemy/engines.py\", line 388, in _test_connection", " six.reraise(type(de_ref), de_ref)", " File \"<string>\", line 3, in reraise", "DBConnectionError: (pymysql.err.OperationalError) (2003, \"Can't connect to MySQL server on '127.0.0.1' ([Errno 111] Connection refused)\") (Background on this error at: http://sqlalche.me/e/e3q8)"], "stdout": "", "stdout_lines": []
I does not seem to happen anymore