http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset021-master/e7ac777/logs/undercloud/home/zuul/overcloud_prep_images.log.txt.gz
2018-08-01 09:03:29 | Exception introspecting nodes: {u'status': u'FAILED', u'node_uuids': [u'a41d3f42-416d-4d90-8b24-42d5f83da664', u'9c8e0bb4-b02b-4bf2-be0e-8e077b35a1d3'], u'failed_introspection': [u'a41d3f42-416d-4d90-8b24-42d5f83da664', u'9c8e0bb4-b02b-4bf2-be0e-8e077b35a1d3'], u'result': u'Failure caused by error in tasks: send_message\n\n send_message [task_ex_id=ea6086d5-9177-4e0e-b713-96c446f74eb7] -> Workflow failed due to message status\n [wf_ex_id=551b2737-0137-4f00-96db-9bb8e2cc156d, idx=0]: Workflow failed due to message status\n', u'introspected_nodes': {u'9c8e0bb4-b02b-4bf2-be0e-8e077b35a1d3': {u'uuid': u'9c8e0bb4-b02b-4bf2-be0e-8e077b35a1d3', u'links': [{u'href': u'http://192.168.24.2:13050/v1/introspection/9c8e0bb4-b02b-4bf2-be0e-8e077b35a1d3', u'rel': u'self'}], u'finished_at': None, u'state': u'waiting', u'finished': False, u'error': None, u'started_at': u'2018-08-01T08:23:04'}, u'a41d3f42-416d-4d90-8b24-42d5f83da664': {u'uuid': u'a41d3f42-416d-4d90-8b24-42d5f83da664', u'links': [{u'href': u'http://192.168.24.2:13050/v1/introspection/a41d3f42-416d-4d90-8b24-42d5f83da664', u'rel': u'self'}], u'finished_at': None, u'state': u'waiting', u'finished': False, u'error': None, u'started_at': u'2018-08-01T08:23:05'}}, u'message': u'Retry limit reached with 2 nodes still failing introspection', u'introspection_attempt': 3}
2018-08-01 09:03:29 | Waiting for introspection to finish...
2018-08-01 09:03:29 | Introspection of node 9c8e0bb4-b02b-4bf2-be0e-8e077b35a1d3 timed out.
2018-08-01 09:03:29 | Introspection of node a41d3f42-416d-4d90-8b24-42d5f83da664 timed out.
2018-08-01 09:03:29 | Retrying 2 nodes that failed introspection. Attempt 1 of 3
2018-08-01 09:03:29 | Introspection of node a41d3f42-416d-4d90-8b24-42d5f83da664 timed out.
2018-08-01 09:03:29 | Introspection of node 9c8e0bb4-b02b-4bf2-be0e-8e077b35a1d3 timed out.
2018-08-01 09:03:29 | Retrying 2 nodes that failed introspection. Attempt 2 of 3
2018-08-01 09:03:29 | Introspection of node 9c8e0bb4-b02b-4bf2-be0e-8e077b35a1d3 timed out.
2018-08-01 09:03:29 | Introspection of node a41d3f42-416d-4d90-8b24-42d5f83da664 timed out.
2018-08-01 09:03:29 | Retrying 2 nodes that failed introspection. Attempt 3 of 3
2018-08-01 09:03:29 | Introspection of node 9c8e0bb4-b02b-4bf2-be0e-8e077b35a1d3 timed out.
2018-08-01 09:03:29 | Introspection of node a41d3f42-416d-4d90-8b24-42d5f83da664 timed out.
2018-08-01 09:03:29 | Retry limit reached with 2 nodes still failing introspection
2018-08-01 09:03:29 | {u'status': u'FAILED', u'node_uuids': [u'a41d3f42-416d-4d90-8b24-42d5f83da664', u'9c8e0bb4-b02b-4bf2-be0e-8e077b35a1d3'], u'failed_introspection': [u'a41d3f42-416d-4d90-8b24-42d5f83da664', u'9c8e0bb4-b02b-4bf2-be0e-8e077b35a1d3'], u'result': u'Failure caused by error in tasks: send_message\n\n send_message [task_ex_id=ea6086d5-9177-4e0e-b713-96c446f74eb7] -> Workflow failed due to message status\n [wf_ex_id=551b2737-0137-4f00-96db-9bb8e2cc156d, idx=0]: Workflow failed due to message status\n', u'introspected_nodes': {u'9c8e0bb4-b02b-4bf2-be0e-8e077b35a1d3': {u'uuid': u'9c8e0bb4-b02b-4bf2-be0e-8e077b35a1d3', u'links': [{u'href': u'http://192.168.24.2:13050/v1/introspection/9c8e0bb4-b02b-4bf2-be0e-8e077b35a1d3', u'rel': u'self'}], u'finished_at': None, u'state': u'waiting', u'finished': False, u'error': None, u'started_at': u'2018-08-01T08:23:04'}, u'a41d3f42-416d-4d90-8b24-42d5f83da664': {u'uuid': u'a41d3f42-416d-4d90-8b24-42d5f83da664', u'links': [{u'href': u'http://192.168.24.2:13050/v1/introspection/a41d3f42-416d-4d90-8b24-42d5f83da664', u'rel': u'self'}], u'finished_at': None, u'state': u'waiting', u'finished': False, u'error': None, u'started_at': u'2018-08-01T08:23:05'}}, u'message': u'Retry limit reached with 2 nodes still failing introspection', u'introspection_attempt': 3}
http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset021-master/e7ac777/logs/undercloud/var/log/extra/errors.txt.gz
Can you provide access the the ironic and ironic-inspector logs when this problem occurs?