tripleo-tox-molecule in check failing on task - "validate image urls task"

[Sandeep Yadav]

Description:

tripleo-tox-molecule in check failing on task - "validate image urls task"

https://174277489f55f5290bc1-fd7c33395ff4d879bfcb5ff66f32813e.ssl.cf1.rackcdn.com/828671/1/check/tripleo-tox-molecule/eb2d632/job-output.txt

~~~
2022-02-10 07:42:56.970444 | primary | failed: [localhost] (item=https://images.rdoproject.org/centos8/wallaby/rdo_trunk/current-tripleo/overcloud-full.tar) => {
2022-02-10 07:42:56.970454 | primary |  "ansible_loop_var": "item",
2022-02-10 07:42:56.970462 | primary |  "changed": false,
2022-02-10 07:42:56.970471 | primary |  "connection": "close",
2022-02-10 07:42:56.970479 | primary |  "content_type": "text/html; charset=iso-8859-1",
2022-02-10 07:42:56.970487 | primary |  "date": "Thu, 10 Feb 2022 07:42:56 GMT",
2022-02-10 07:42:56.970494 | primary |  "elapsed": 0,
2022-02-10 07:42:56.970503 | primary |  "item": "https://images.rdoproject.org/centos8/wallaby/rdo_trunk/current-tripleo/overcloud-full.tar",
2022-02-10 07:42:56.970511 | primary |  "redirected": false,
2022-02-10 07:42:56.970519 | primary |  "server": "Apache/2.4.37 (centos) OpenSSL/1.1.1g",
2022-02-10 07:42:56.970527 | primary |  "status": 404,
2022-02-10 07:42:56.970535 | primary |  "url": "https://images.rdoproject.org/centos8/wallaby/rdo_trunk/current-tripleo/overcloud-full.tar"
~~~

We have two issues:-

1) https://review.opendev.org/c/openstack/tripleo-quickstart/+/828671/ on which above job failed is patch against tq(master - as branchless) - why its looking for wallaby image instead of master.

2) We have storage issue on images.rdoproject.org
https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-8-buildimage-overcloud-full-wallaby/89f6610/job-output.txt

~~~
2022-02-09 22:02:11.083185 | primary | rsync: write failed on "/var/www/html/images/centos8/wallaby/rdo_trunk/d54271c3d274e6db4798c4a1660dd932/overcloud-full.tar": No space left on device (28)
2022-02-09 22:02:11.083213 | primary | rsync error: error in file IO (code 11) at receiver.c(374) [receiver=3.1.3]
2022-02-09 22:02:11.088530 | primary | cp: cannot stat '/home/zuul/*repo_setup*log': No such file or directory
~~~

[Rabi Mishra (rabi)]

> - why its looking for wallaby image instead of master.

I think as tqe is branchless, it's validating image urls for all branches. So probably 1 is a non-issue.

.running: ansible-playbook -e@config/release/master.yml -eansible_python_interpreter=/home/ramishra/work/openstack/tripleo-quickstart/.tox/molecule/bin/python tests/validate-release-config.yml

.running: ansible-playbook -e@config/release/centosci/wallaby-current-tripleo.yml -eansible_python_interpreter=/home/ramishra/work/openstack/tripleo-quickstart/.tox/molecule/bin/python tests/validate-release-config.yml

...

[Rabi Mishra (rabi)]

I meant tripleo-quickstart is branchless.

[Ronelle Landy (rlandy)]

Images were not being pruned.
Some clean up done - and image build job is in rerun.

Infra team is working on fixing the prune script.