Comment 4 for bug 1792872

First this is definitely a thing, from today on master at [1] for example. Unfortunately it doesn't happen consistently - the run prior to [1] was a success (via [2]). Furthermore the trace is not always the same but the error always occurs during the overcloud-prep-images.sh and specifically during the Ironic/Mistral introspection. I think this is a duplicate of https://bugs.launchpad.net/tripleo/+bug/1794952 but choosing this one since it was filed first and has more info already.

Did some digging today to collect info before reaching out to Ironic & Mistral folks. On the tripleo side the code involved lives here [3] and on the ironic side I believe it is this [4]. You can see more of the trace in the mistral engine [5] and executor [6] logs (e.g. like http://paste.openstack.org/raw/731354/ ).

[1] http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/034a1b1/logs/undercloud/home/zuul/overcloud_prep_images.log.txt.gz
[2] http://cistatus.tripleo.org/promotion/
[3] https://github.com/openstack/tripleo-common/blob/5e0e291e0bec62b0ee9f3a989b591960d3a28ac3/workbooks/baremetal.yaml#L8-L59
[4] https://github.com/openstack/python-ironicclient/blob/fb94fb825cccecd11c4a2f78beeff3b0b19956f3/ironicclient/v1/node.py#L503
[5] http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/034a1b1/logs/undercloud/var/log/containers/mistral/engine.log.txt.gz
[6] http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/034a1b1/logs/undercloud/var/log/containers/mistral/executor.log.txt.gz