We've seen zaqar return 503 during the deployment which causes the deployment to fail.
http://logs.openstack.org/22/539522/4/check/tripleo-ci-centos-7-containers-multinode/37005e6/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-03-07_00_09_36
2018-03-07 00:09:36 | u'message': u"Failed to run action [action_ex_id=a6d33603-a829-4118-b53d-cc78b7a0d591, action_cls='<class 'mistral.actions.action_factory.ZaqarAction'>', attributes='{u'client_method_name': u'claim_messages'}', params='{u'queue_name': u'tripleo-ui-logging', u'grace': 60, u'ttl': 60}']\n ZaqarAction.claim_messages failed: Error response from Zaqar. Code: 503. Title: Service temporarily unavailable. Description: Claim could not be created. Please try again in a few seconds..",
2018-03-07 00:09:36 | u'status': u'FAILED'}
In looking at the apache logs, we see a 503...
http://logs.openstack.org/22/539522/4/check/tripleo-ci-centos-7-containers-multinode/37005e6/logs/undercloud/var/log/httpd/zaqar_wsgi_access.log.txt.gz
192.168.24.1 - - [07/Mar/2018:00:09:30 +0000] "POST /v2/queues/tripleo-ui-logging/claims HTTP/1.1" 503 135 "-" "python-requests/2.14.2"
This seems to be causes because the tripleo-ui-logging queue does not exist:
http://logs.openstack.org/22/539522/4/check/tripleo-ci-centos-7-containers-multinode/37005e6/logs/undercloud/var/log/zaqar/zaqar.log.txt.gz#_2018-03-07_00_09_30_679
2018-03-07 00:09:30.679 1912 ERROR zaqar.transport.wsgi.v2_0.claims [req-ea2b494e-1f00-4303-b146-3c9e0580331c 38621b8d28a14d88857c2abff18c9e07 3468247bbd3a479d9c77b2442e8d628f - default default] Queue tripleo-ui-logging does not exist for project 3468247bbd3a479d9c77b2442e8d628f: QueueDoesNotExist: Queue tripleo-ui-logging does not exist for project 3468247bbd3a479d9c77b2442e8d628f
2018-03-07 00:09:30.679 1912 ERROR zaqar.transport.wsgi.v2_0.claims Traceback (most recent call last):
2018-03-07 00:09:30.679 1912 ERROR zaqar.transport.wsgi.v2_0.claims File "/usr/lib/python2.7/site-packages/zaqar/transport/wsgi/v2_0/claims.py", line 85, in on_post
2018-03-07 00:09:30.679 1912 ERROR zaqar.transport.wsgi.v2_0.claims **claim_options)
2018-03-07 00:09:30.679 1912 ERROR zaqar.transport.wsgi.v2_0.claims File "/usr/lib/python2.7/site-packages/zaqar/common/pipeline.py", line 97, in consumer
2018-03-07 00:09:30.679 1912 ERROR zaqar.transport.wsgi.v2_0.claims tmp = target(*args, **kwargs)
2018-03-07 00:09:30.679 1912 ERROR zaqar.transport.wsgi.v2_0.claims File "/usr/lib/python2.7/site-packages/zaqar/storage/swift/claims.py", line 111, in create
2018-03-07 00:09:30.679 1912 ERROR zaqar.transport.wsgi.v2_0.claims include_delayed=include_delayed)
2018-03-07 00:09:30.679 1912 ERROR zaqar.transport.wsgi.v2_0.claims File "/usr/lib/python2.7/site-packages/zaqar/storage/swift/messages.py", line 109, in _list
2018-03-07 00:09:30.679 1912 ERROR zaqar.transport.wsgi.v2_0.claims raise errors.QueueDoesNotExist(queue, project)
2018-03-07 00:09:30.679 1912 ERROR zaqar.transport.wsgi.v2_0.claims QueueDoesNotExist: Queue tripleo-ui-logging does not exist for project 3468247bbd3a479d9c77b2442e8d628f
2018-03-07 00:09:30.679 1912 ERROR zaqar.transport.wsgi.v2_0.claims
Honza, it looks like the tripleo-ui-logging queue is missing in zaqar [1]; you have any idea what is happening?
1. http:// logs.openstack. org/22/ 539522/ 4/check/ tripleo- ci-centos- 7-containers- multinode/ 37005e6/ logs/undercloud /var/log/ zaqar/zaqar. log.txt. gz#_2018- 03-07_00_ 09_30_679