Sporadically I will get the following when deploying an overcloud. The error comes from the undercloud, as if mysql there has a short hiccup:
+ openstack overcloud deploy --templates /home/stack/tripleo-heat-templates --libvirt-type qemu --control-flavor oooq_control --compute-flavor oooq_compute --ceph-storage-flavor oooq_ceph --block-storage-flavor oooq_blockstorage --swift-storage-flavor oooq_objectstorage --timeout 90 -e /home/stack/cloud-names.yaml -e /home/stack/tripleo-heat-templates/environments/network-isolation.yaml -e /home/stack/tripleo-heat-templates/environments/net-single-nic-with-vlans.yaml -e /home/stack/network-environment.yaml -e /home/stack/tripleo-heat-templates/environments/puppet-pacemaker.yaml -e /home/stack/tripleo-heat-templates/environments/low-memory-usage.yaml --validation-warnings-fatal --control-scale 1 --ntp-server pool.ntp.org -e /home/stack/tripleo-heat-templates/environments/config-debug.yaml -e /home/stack/tripleo-heat-templates/environments/ha-docker.yaml -r /home/stack/custom_roles.yaml
Started Mistral Workflow tripleo.validations.v1.check_pre_deployment_validations. Execution ID: eed7c3b1-6f6b-4712-825b-8541fcce645f
{u'body': {u'exception': u"(pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query') [SQL: u'INSERT INTO `Queues` (project, name, metadata) VALUES (%(project)s, %(name)s, %(metadata)s)'] [parameters: {'project': u'5ac518c14589482da9d97c4ca4a58b6a', 'name': u'2eff06e4-2712-4f78-8ab6-6b934c852aef', 'metadata': bytearray(b'{}')}]", u'error': u'Unexpected error.'}, u'headers': {u'status': 500}, u'request': {u'action': u'queue_create', u'body': {u'queue_name': u'2eff06e4-2712-4f78-8ab6-6b934c852aef'}, u'api': u'v2', u'headers': {u'Client-ID': u'dcab4333-7ba2-42e3-a0d1-01b31bf97f75', u'X-Project-ID': u'5ac518c14589482da9d97c4ca4a58b6a'}}}
+ status_code=1
+ openstack stack list
So the error is at the following time:
2017-05-19 06:29:42.015 31478 INFO workflow_trace [-] Task 'send_message' (de1c9cc5-2916-4459-8c9b-8c219d4e965d) [RUNNING -> ERROR, msg=Failed to run action [action_ex_id=814164d4-7d79-4861-a962-394c7d402c39, action_cls='<class 'mistral.actions.action_factory.ZaqarAction'>', attributes='{u'client_method_name': u'queue_post'}', params='{u'queue_name': u'2eff06e4-2712-4f78-8ab6-6b934c852aef', u'messages': {u'body': {u'type': u'tripleo.validations.v1.check_boot_images', u'payload': {u'status': u'SUCCESS', u'errors': [], u'warnings': [], u'kernel_id': u'eedfbbeb-023a-4717-96ac-842376273c85', u'ramdisk_id': u'd42345d8-8a69-4cdd-9c83-e423555690ad', u'message': u'', u'execution': {u'name': u'tripleo.validations.v1.check_boot_images', u'created_at': u'2017-05-19 06:29:40', u'id': u'708639de-3a8f-4536-888c-31783f345757', u'params': {u'index': 0, u'task_execution_id': u'7a97b920-cdfc-4d57-b893-1f4f37d0ba31'}, u'input': {u'deploy_ramdisk_name': u'bm-deploy-ramdisk', u'deploy_kernel_name': u'bm-deploy-kernel', u'queue_name': u'2eff06e4-2712-4f78-8ab6-6b934c852aef', u'run_validations': True}, u'spec': {u'input': [{u'deploy_kernel_name': u'bm-deploy-kernel'}, {u'deploy_ramdisk_name': u'bm-deploy-ramdisk'}, {u'run_validations': True}, {u'queue_name': u'tripleo'}], u'tasks': {u'send_message': {u'retry': u'count=5 delay=1', u'name': u'send_message', u'on-success': [{u'fail': u'<% $.get(\'status\') = "FAILED" %>'}], u'version': u'2.0', u'action': u'zaqar.queue_post', u'input': {u'queue_name': u'<% $.queue_name %>', u'messages': {u'body': {u'type': u'tripleo.validations.v1.check_boot_images', u'payload': {u'status': u"<% $.get('status', 'SUCCESS') %>", u'errors': u'<% $.errors %>', u'warnings': u'<% $.warnings %>', u'kernel_id': u'<% $.kernel_id %>', u'ramdisk_id': u'<% $.ramdisk_id %>', u'message': u"<% $.get('message', '') %>", u'execution': u'<% execution() %>'}}}}, u'type': u'direct'}, u'fail_check_images': {u'version': u'2.0', u'type': u'direct', u'name': u'fail_check_images', u'publish': {u'status': u'FAILED', u'message': u'<% task(check_images).result %>'}, u'on-success': u'send_message'}, u'check_images': {u'name': u'check_images', u'on-error': u'fail_check_images', u'on-success': u'send_message', u'publish-on-error': {u'kernel_id': u'<% task(check_images).result.kernel_id %>', u'ramdisk_id': u'<% task(check_images).result.ramdisk_id %>', u'errors': u'<% task(check_images).result.errors %>', u'warnings': u'<% task(check_images).result.warnings %>'}, u'publish': {u'kernel_id': u'<% task(check_images).result.kernel_id %>', u'ramdisk_id': u'<% task(check_images).result.ramdisk_id %>', u'errors': u'<% task(check_images).result.errors %>', u'warnings': u'<% task(check_images).result.warnings %>'}, u'version': u'2.0', u'action': u'tripleo.validations.check_boot_images', u'input': {u'images': u'<% $.images %>', u'deploy_kernel_name': u'<% $.deploy_kernel_name %>', u'deploy_ramdisk_name': u'<% $.deploy_ramdisk_name %>'}, u'type': u'direct'}, u'check_run_validations': {u'on-complete': [{u'get_images': u'<% $.run_validations %>'}, {u'send_message': u'<% not $.run_validations %>'}], u'version': u'2.0', u'type': u'direct', u'name': u'check_run_validations'}, u'get_images': {u'name': u'get_images', u'on-success': u'check_images', u'publish': {u'images': u'<% task(get_images).result %>'}, u'version': u'2.0', u'action': u'glance.images_list', u'type': u'direct'}}, u'name': u'check_boot_images', u'version': u'2.0', u'output': {u'kernel_id': u'<% $.kernel_id %>', u'errors': u'<% $.errors %>', u'ramdisk_id': u'<% $.ramdisk_id %>', u'warnings': u'<% $.warnings %>'}}}}}}}']
ZaqarAction.queue_post failed: <class 'zaqarclient.transport.errors.InternalServerError'>: Error response from Zaqar. Code: 500. Title: Internal server error. Description: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query') [SQL: u'SELECT `Queues`.metadata \nFROM `Queues` \nWHERE `Queues`.project = %(project_1)s AND `Queues`.name = %(name_1)s'] [parameters: {u'name_1': '2eff06e4-2712-4f78-8ab6-6b934c852aef', u'project_1': u'5ac518c14589482da9d97c4ca4a58b6a'}].] (execution_id=708639de-3a8f-4536-888c-31783f345757)
2017-05-19 06:29:42.020 31478 INFO workflow_trace [-] Task 'send_message' [ERROR -> DELAYED, delay = 1 sec] (execution_id=708639de-3a8f-4536-888c-31783f345757 task_id=de1c9cc5-2916-4459-8c9b-8c219d4e965d)
Yet nothing in /var/log/mariadb/mariadb.log on the undercloud
Full sosreport of the undercloud here: http:// people. redhat. com/mbaldess/ lp1691951/ sosreport- undercloud- 20170519063650. tar.xz
Note that the undercloud has been installed many hours before the deployment that had the error mentioned in this bug