'Lost connection to MySQL during query' errors in os_keystone role

[Markos Chandras]

There is a new failure on gates

http://logs.openstack.org/91/506391/1/check/gate-openstack-ansible-os_gnocchi-ansible-func-ubuntu-xenial/ef45b7c/console.html#_2017-09-27_02_16_57_357965

The reason may be this
http://logs.openstack.org/91/506391/1/check/gate-openstack-ansible-os_gnocchi-ansible-func-ubuntu-xenial/ef45b7c/logs/openstack/openstack1/keystone/keystone.log.txt.gz#_2017-09-27_02_16_57_182

2017-09-27 02:16:57.182 16925 ERROR keystone Traceback (most recent call last):
2017-09-27 02:16:57.182 16925 ERROR keystone File "/openstack/venvs/keystone-testing/bin/keystone-manage", line 10, in <module>
2017-09-27 02:16:57.182 16925 ERROR keystone sys.exit(main())
2017-09-27 02:16:57.182 16925 ERROR keystone File "/openstack/venvs/keystone-testing/local/lib/python2.7/site-packages/keystone/cmd/manage.py", line 45, in main
2017-09-27 02:16:57.182 16925 ERROR keystone cli.main(argv=sys.argv, config_files=config_files)
2017-09-27 02:16:57.182 16925 ERROR keystone File "/openstack/venvs/keystone-testing/local/lib/python2.7/site-packages/keystone/cmd/cli.py", line 1331, in main
2017-09-27 02:16:57.182 16925 ERROR keystone CONF.command.cmd_class.main()
2017-09-27 02:16:57.182 16925 ERROR keystone File "/openstack/venvs/keystone-testing/local/lib/python2.7/site-packages/keystone/cmd/cli.py", line 523, in main
2017-09-27 02:16:57.182 16925 ERROR keystone upgrades.expand_schema()
2017-09-27 02:16:57.182 16925 ERROR keystone File "/openstack/venvs/keystone-testing/local/lib/python2.7/site-packages/keystone/common/sql/upgrades.py", line 323, in expand_schema
2017-09-27 02:16:57.182 16925 ERROR keystone _sync_common_repo(version=None)
2017-09-27 02:16:57.182 16925 ERROR keystone File "/openstack/venvs/keystone-testing/local/lib/python2.7/site-packages/keystone/common/sql/upgrades.py", line 170, in _sync_common_repo
2017-09-27 02:16:57.182 16925 ERROR keystone init_version=init_version, sanity_check=False)
2017-09-27 02:16:57.182 16925 ERROR keystone File "/openstack/venvs/keystone-testing/local/lib/python2.7/site-packages/oslo_db/sqlalchemy/migration.py", line 81, in db_sync
2017-09-27 02:16:57.182 16925 ERROR keystone raise exception.DBMigrationError(ex)
2017-09-27 02:16:57.182 16925 ERROR keystone DBMigrationError: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query') [SQL: u'ALTER TABLE user ADD CONSTRAINT ixu_user_name_domain_id UNIQUE (domain_id, name)']
2017-09-27 02:16:57.182 16925 ERROR keystone

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/507789

[Markos Chandras (hwoarang)]

This may also fixed by https://review.openstack.org/507701

[Logan V (loganv)]

Yes this is fixed on Ubuntu by https://review.openstack.org/507701. Apparently infra has now pulled in the broken 10.1.27 package.. that's a shame as it was finally pulled off MariaDB's mirrors yesterday.

http://logs.openstack.org/91/506391/1/check/gate-openstack-ansible-os_gnocchi-ansible-func-ubuntu-xenial/ef45b7c/logs/openstack/infra1/apt/history.log.txt.gz confirms 10.1.27 is being installed

http://logs.openstack.org/91/506391/1/check/gate-openstack-ansible-os_gnocchi-ansible-func-ubuntu-xenial/ef45b7c/logs/openstack/infra1/mysql_logs/galera_server_error.log.txt.gz
^ shows the segfault that happens when you try to perform table operations on 10.1.27 when Galera is enabled.

[OpenStack Infra (hudson-openstack)]

Change abandoned by Markos Chandras (hwoarang) (<email address hidden>) on branch: master
Review: https://review.openstack.org/507789