image build jobs are not using upstream proxy servers

[wes hayutin]

20-07-23 14:58:58.056371 | TASK [oooci-build-images : Download TripleO source image]
2020-07-23 15:01:09.300215 | primary | ERROR
2020-07-23 15:01:09.327436 | primary | {
2020-07-23 15:01:09.327705 | primary | "msg": "Failed to connect to images.rdoproject.org at port 443: [Errno 110] Connection timed out",
2020-07-23 15:01:09.327811 | primary | "status": -1,
2020-07-23 15:01:09.327907 | primary | "url": "https://images.rdoproject.org/CentOS-8-x86_64-GenericCloud.qcow2"
2020-07-23 15:01:09.328001 | primary | }
2020-07-23 15:01:09.513066 |

https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_30a/742529/1/gate/tripleo-buildimage-ironic-python-agent-centos-8/30a24a3/job-output.txt

----------------------------

The url for the image should be replaced w/ the mirror info available in

etc/ci/mirror_info.sh

Ideally the content from images.rdoproject.org/base-image is added to the list of mirrored content if it is not.

[wes hayutin (weshayutin)]

If perhaps CentOS mirrors cans provide a link w/o a version that could be used as well..
this is not usable atm though https://cloud.centos.org/centos/8/x86_64/images/

[wes hayutin (weshayutin)]

FYI.. this issue caused upstream gate failures:
https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_30a/742529/1/gate/tripleo-buildimage-ironic-python-agent-centos-8/30a24a3/job-output.txt

[Sorin Sbarnea (ssbarnea)]

I doubt this is a reliable way of doing it because requires a lot of maintenance. It would far better to have a proxy enabled and make use of it transparently, so when no proxy is configured it would still work.

Otherwise we just keep ourselves busy updating mirror configs. Still, I doubt we can make this a reality over night.

[Marios Andreou (marios-b)]

Sorin merged that [1] which appears to have helped us here

    https://review.opendev.org/#/c/742696/ Make image downloading more resilient (openstack/tripleo-ci)

We haven't seen any related errors this tripleo-ci sprint (31) related to downloading the base DIB image.

Per the description above from weshay this bug is originally to consider changing the image builds to use the mirror_info [2] but I am not sure if we still need that.

[1] https://opendev.org/openstack/tripleo-ci/commit/9637a1aeda5c2006b662b38dbfd4976c75b0f5be
[2] https://github.com/openstack/tripleo-quickstart-extras/blob/6ee1cd838b8a611d69d33e73a11a15e6bbda49e2/roles/nodepool-setup/templates/mirror_info.sh.j2#L1

[Kevin Carter (kevin-carter)]

As noted by Marios it looks like this issue is resolved, and has been replaced by a new issue caused by docker api rate limiting. Marked fix committed and moving on.