train current-tripleo containers missing - periodic standalone-upgrade master failing ImageNotFoundException

Bug #1863235 reported by Marios Andreou on 2020-02-14
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Critical
Marios Andreou

Bug Description

In [1][2][3] the periodic-tripleo-ci-centos-7-standalone-upgrade-master fails during overcloud deploy because of MISSING TRAIN CURRENT-TRIPLEO container:

        * 2020-02-13 17:49:49 | ImageNotFoundException: Not found image: docker://trunk.registry.rdoproject.org/tripleotrain/centos-binary-cinder-api:8363905a6a6d5c8b2488619bdf807c5dc17b2842_a8d2b118

The missing tag is current-tripleo train (https://trunk.rdoproject.org/centos7-train/current-tripleo/delorean.repo ==> * baseurl=https://trunk.rdoproject.org/centos7-train/83/63/8363905a6a6d5c8b2488619bdf807c5dc17b2842_a8d2b118 ) because the job deploys train to upgrade to master.

I think this should also then affect train gate. Not sure why the image was deleted (last train promotion on 9th Feb ) but a new promotion should fix it.

Not sure we want standalone-upgrade-master in the voting criteria, but right not this is promotion blocker.

[1] https://logserver.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-standalone-upgrade-master/b6542a8/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz
[2] https://logserver.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-standalone-upgrade-master/60b31ae/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz
[3] https://logserver.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-standalone-upgrade-master/c06c862/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz

Marios Andreou (marios-b) wrote :

I don't think this job should be in criteria. For starters we are not gating on it upstream [1][2] and it is non-voting [3]. Looks like it was added in [4] so I'm going to remove it.

We traditionally have not run master upgrade jobs as voting or in promotion criteria, only latest released branch and earlier. Posted that:

ci-config master: Remove periodic standalone-upgrade-master from master centos criteria https://review.rdoproject.org/r/24945

[1] https://opendev.org/openstack/tripleo-ci/src/commit/841ecc23305aaa3700ca70d908de8f80e9cd7db9/zuul.d/layout.yaml
[2] https://opendev.org/openstack/tripleo-ci/src/commit/841ecc23305aaa3700ca70d908de8f80e9cd7db9/zuul.d/standalone-jobs.yaml#L363
[3] https://opendev.org/openstack/tripleo-ci/src/commit/841ecc23305aaa3700ca70d908de8f80e9cd7db9/zuul.d/standalone-jobs.yaml#L54
[4] https://github.com/rdo-infra/ci-config/commit/5c829f79195b356361a65b3998a8e11c1fc18e2e

Marios Andreou (marios-b) wrote :

this will NOT affect the gates, because though they use current-tripleo, they are pulling containers from docker.io and not rdo registry (containers missing from rdo).

Trying to push the containers again with that hash using https://review.rdoproject.org/r/24954 Run train container build push 8363905a6a6d5c8b2488619bdf807c5dc17b2842_a8d2b118

but this bug should only be impacting the standalone-upgrade job (i.e. deploying current-tripleo train, using rdo-registry containers) and we want to remove that with https://review.rdoproject.org/r/24945 anyway so it isn't urgent that we re-push containers with the test @ /r/24954

Marios Andreou (marios-b) wrote :

closing this out we got a train promotion so the link is updated and containers are there right now

        * https://trunk.rdoproject.org/centos7-train/current-tripleo/delorean.repo
            * baseurl=https://trunk.rdoproject.org/centos7-train/ae/13/ae13f36b8f368e079dda53f1468790ab2253ea69_51b819f9

        * https://trunk.registry.rdoproject.org:8443/oapi/v1/namespaces/tripleotrain/imagestreamtags/
            * "name": "centos-binary-aodh-api:ae13f36b8f368e079dda53f1468790ab2253ea69_51b819f9",

Changed in tripleo:
status: Triaged → Fix Released
Marios Andreou (marios-b) wrote :

also we removed the job from master criteria it should not have been there per comment #1 https://review.rdoproject.org/r/24945 merged

To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers