RHEL 8 master fs01 fails while getting image expected checksum after multiple retry
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
tripleo |
Fix Released
|
Critical
|
Unassigned |
Bug Description
RHEL8 master periodic job fails multiple time while Getting image expected checksum.http://
2019-12-09 14:25:12.130765 | primary | TASK [fetch-images : Get image expected checksum] *******
2019-12-09 14:25:12.148354 | primary | Monday 09 December 2019 14:25:12 -0500 (0:00:00.077) 0:05:12.933 *******
2019-12-09 14:25:12.576790 | primary | FAILED - RETRYING: Get image expected checksum (10 retries left).
2019-12-09 14:25:27.939287 | primary | FAILED - RETRYING: Get image expected checksum (9 retries left).
2019-12-09 14:25:43.376268 | primary | FAILED - RETRYING: Get image expected checksum (8 retries left).
2019-12-09 14:25:58.780638 | primary | FAILED - RETRYING: Get image expected checksum (7 retries left).
2019-12-09 14:26:14.196125 | primary | FAILED - RETRYING: Get image expected checksum (6 retries left).
2019-12-09 14:26:29.604925 | primary | FAILED - RETRYING: Get image expected checksum (5 retries left).
2019-12-09 14:26:44.994088 | primary | FAILED - RETRYING: Get image expected checksum (4 retries left).
2019-12-09 14:27:00.369601 | primary | FAILED - RETRYING: Get image expected checksum (3 retries left).
2019-12-09 14:27:15.769492 | primary | FAILED - RETRYING: Get image expected checksum (2 retries left).
2019-12-09 14:27:31.162452 | primary | FAILED - RETRYING: Get image expected checksum (1 retries left).
2019-12-09 14:27:46.581736 | primary | fatal: [undercloud]: FAILED! => {
2019-12-09 14:27:46.581810 | primary | "attempts": 10,
2019-12-09 14:27:46.581829 | primary | "changed": true,
2019-12-09 14:27:46.581843 | primary | "cmd": [
2019-12-09 14:27:46.581853 | primary | "curl",
2019-12-09 14:27:46.581858 | primary | "-skfL",
2019-12-09 14:27:46.581862 | primary | "http://
2019-12-09 14:27:46.581877 | primary | ],
2019-12-09 14:27:46.581883 | primary | "delta": "0:00:00.011974",
2019-12-09 14:27:46.581888 | primary | "end": "2019-12-09 14:27:46.556492",
2019-12-09 14:27:46.581893 | primary | "rc": 22,
2019-12-09 14:27:46.581897 | primary | "start": "2019-12-09 14:27:46.544518"
2019-12-09 14:27:46.581917 | primary | }
2019-12-09 14:27:46.581924 | primary |
It is seen multiple times.
While trying it on rdo-cloud
[cloud-user@devbox ~]$ curl -skfL http://
[cloud-user@devbox ~]$ echo $?
22
It might happens that the image with this hash bd316fa91fad3df
o/ chandan... adding for context this was filed from https:/ /bugs.launchpad .net/tripleo/ +bug/1853978/ comments/ 16
I think there may be some issue with https:/ /review. opendev. org/#/c/ 697423/ but I'm not sure yet.
I logged onto the rcm guest and indeed there is no overcloud-full:
total 506604
-rw-rw-r--. 1 centos centos 518758400 Dec 9 12:34 ironic-
-rw-rw-r--. 1 centos centos 58 Dec 9 12:34 ironic-
BUT before that change /#/c/697423/ it would have been 'tripleo- ci-testing' and there also no overcloud-full there either!
* [centos@rcn-share rdo_trunk]$ ll tripleo-ci-testing/ python- agent.tar python- agent.tar. md5
total 506636
-rw-rw-r--. 1 centos centos 518789120 Dec 9 18:33 ironic-
-rw-rw-r--. 1 centos centos 58 Dec 9 18:34 ironic-
current-tripleo and previous look OK
total 1634800
-rw-rw-r--. 1 centos centos 518799360 Nov 18 00:30 ironic-
-rw-rw-r--. 1 centos centos 58 Nov 18 00:30 ironic-
-rw-rw-r--. 1 centos centos 1155225600 Nov 18 00:35 overcloud-full.tar
-rw-rw-r--. 1 centos centos 53 Nov 18 00:35 overcloud-
total 1626692
-rw-rw-r--. 1 centos centos 518768640 Nov 14 13:59 ironic-
-rw-rw-r--. 1 centos centos 58 Nov 14 13:59 ironic-
-rw-rw-r--. 1 centos centos 1146951680 Nov 14 14:03 overcloud-full.tar
-rw-rw-r--. 1 centos centos 53 Nov 14 14:04 overcloud-