Comment 4 for bug 1895290

Revision history for this message
chandan kumar (chkumar246) wrote :

We are also seeing in c8 train multinode job https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_b04/749645/51/check/tripleo-ci-centos-8-containers-multinode-train/b045598/logs/undercloud/home/zuul/overcloud_deploy.log

"DEBUG:tripleo_common.image.image_uploader:Released lock on layer sha256:369aa5567f56b79c7001b7e292c42eb615f76b3132cfcf8c70d6c79c8c701078", "DEBUG:tripleo_common.image.image_uploader:[/tripleotraincentos8/centos-binary-multipathd] Waiting for next job: 3 of 4 complete", "DEBUG:urllib3.connectionpool:http://192.168.24.1:8787 \"HEAD /v2/tripleotraincentos8/centos-binary-nova-libvirt/blobs/sha256:ec1681b6a383e4ecedbeddd5abc596f3de835aed6db39a735f62395c8edbff30 HTTP/1.1\" 404 0", "DEBUG:tripleo_common.image.image_export:[tripleotraincentos8/centos-binary-haproxy] Linking layers: /var/lib/image-serve/v2/tripleotraincentos8/centos-binary-haproxy/blobs/sha256:ec1681b6a383e4ecedbeddd5abc596f3de835aed6db39a735f62395c8edbff30.gz -> /var/lib/image-serve/v2/tripleotraincentos8/centos-binary-nova-libvirt/blobs/sha256:ec1681b6a383e4ecedbeddd5abc596f3de835aed6db39a735f62395c8edbff30.gz", "DEBUG:tripleo_common.image.image_uploader:Released lock on layer sha256:ec1681b6a383e4ecedbeddd5abc596f3de835aed6db39a735f62395c8edbff30", "DEBUG:tripleo_common.image.image_uploader:[/tripleotraincentos8/centos-binary-nova-libvirt] Waiting for next job: 4 of 6 complete", "Exception in thread Thread-1:", "Traceback (most recent call last):", " File \"/usr/lib64/python3.6/threading.py\", line 916, in _bootstrap_inner", " self.run()", " File \"/usr/lib64/python3.6/threading.py\", line 864, in run", " self._target(*self._args, **self._kwargs)", " File \"/usr/lib64/python3.6/concurrent/futures/process.py\", line 295, in _queue_management_worker", " shutdown_worker()", " File \"/usr/lib64/python3.6/concurrent/futures/process.py\", line 253, in shutdown_worker", " call_queue.put_nowait(None)", " File \"/usr/lib64/python3.6/multiprocessing/queues.py\", line 129, in put_nowait", " return self.put(obj, False)", " File \"/usr/lib64/python3.6/multiprocessing/queues.py\", line 83, in put", " raise Full", "queue.Full", "", "ERROR:root:Image prepare failed: A process in the process pool was terminated abruptly while the future was running or pending.", "Traceback (most recent call last):", " File \"/usr/bin/tripleo-container-image-prepare\", line 138, in <module>", " lock=lock)", " File \"/usr/lib/python3.6/site-packages/tripleo_common/image/kolla_builder.py\", line 241, in container_images_prepare_multi", " uploader.upload()", " File \"/usr/lib/python3.6/site-packages/tripleo_common/image/image_uploader.py\", line 506, in upload", " uploader.run_tasks()", " File \"/usr/lib/python3.6/site-packages/tripleo_common/image/image_uploader.py\", line 2514, in run_tasks", " for result in p.map(upload_task, self.upload_tasks):", " File \"/usr/lib64/python3.6/concurrent/futures/process.py\", line 366, in _chain_from_iterable_of_lists", " for element in iterable:", " File \"/usr/lib64/python3.6/concurrent/futures/_base.py\", line 586, in result_iterator", " yield fs.pop().result()", " File \"/usr/lib64/python3.6/concurrent/futures/_base.py\", line 432, in result", " return self.__get_result()", " File \"/usr/lib64/python3.6/concurrent/futures/_base.py\", line 384, in __get_result", " raise self._exception", "concurrent.futures.process.BrokenProcessPool: A process in the process pool was terminated abruptly while the future was running or pending."], "stdout": "", "stdout_lines": []}
2020-09-14 11:10:33 | Host 192.168.24.11 not found in /home/zuul/.ssh/known_hosts
2020-09-14 11:10:33 | Overcloud configuration failed.