https://images.rdoproject.org/centos8/master/rdo_trunk/tripleo-ci-testing/overcloud-full.tar doesn't exist (anymore?)

[Cédric Jeanneret]

Hello,

a molecule test in tripleo-quickstart wants to fetch a remote URI and fails:
TASK [validate image urls] *****************************************************
Wednesday 06 May 2020 14:55:11 +0000 (0:00:00.137) 0:00:00.137 *********
ok: [localhost] => (item=https://images.rdoproject.org/centos8/master/rdo_trunk/tripleo-ci-testing/ironic-python-agent.tar) => {
    "accept_ranges": "bytes",
    "ansible_loop_var": "item",
    "changed": false,
    "connection": "close",
    "content_length": "511098880",
    "content_type": "application/x-tar",
    "cookies": {},
    "cookies_string": "",
    "date": "Wed, 06 May 2020 14:55:12 GMT",
    "elapsed": 0,
    "etag": "\"1e76c000-5a4f682cecd2d\"",
    "item": "https://images.rdoproject.org/centos8/master/rdo_trunk/tripleo-ci-testing/ironic-python-agent.tar",
    "last_modified": "Wed, 06 May 2020 08:25:47 GMT",
    "redirected": false,
    "server": "Apache/2.4.37 (centos) OpenSSL/1.1.1c",
    "status": 200,
    "url": "https://images.rdoproject.org/centos8/master/rdo_trunk/tripleo-ci-testing/ironic-python-agent.tar"
}

MSG:

OK (511098880 bytes)
failed: [localhost] (item=https://images.rdoproject.org/centos8/master/rdo_trunk/tripleo-ci-testing/overcloud-full.tar) => {
    "ansible_loop_var": "item",
    "changed": false,
    "connection": "close",
    "content": "",
    "content_type": "text/html; charset=iso-8859-1",
    "date": "Wed, 06 May 2020 14:55:12 GMT",
    "elapsed": 0,
    "item": "https://images.rdoproject.org/centos8/master/rdo_trunk/tripleo-ci-testing/overcloud-full.tar",
    "redirected": false,
    "server": "Apache/2.4.37 (centos) OpenSSL/1.1.1c",
    "status": 404,
    "url": "https://images.rdoproject.org/centos8/master/rdo_trunk/tripleo-ci-testing/overcloud-full.tar"
}

MSG:

Status code was 404 and not [200]: HTTP Error 404: Not Found

While the directory exists, it only have the ironic-python-agent.tar and related md5 files.

This break CI on master for, at least, oooq.

[Cédric Jeanneret (cjeanner)]

workaround patch has been pushed a bit earlier:
https://review.opendev.org/#/c/725858/

Root cause is apparently in the periodic build job:
https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-master (check for periodic-tripleo-centos-8-buildimage-overcloud-full-master)

there are, at random, ioctl error hitting random RPM install, for instance:
Error unpacking rpm package ansible-pacemaker-1.0.4-0.20200417100509.5847167.el8.noarch
error: unpacking of archive failed on file /usr/share/ansible/plugins/modules/pacemaker_cluster.py;5eb35984: cpio: open failed - Inappropriate ioctl for device
error: ansible-pacemaker-1.0.4-0.20200417100509.5847167.el8.noarch: install failed

[Bhagyashri Shewale (bhagyashri-shewale)]

Hello All,

Patch [1] will fix this issue.

[1]: https://review.opendev.org/#/c/725858/