Master containerized undercloud upgrade job failed with tripleo_podman' role not found

[chandan kumar]

Fs050 master periodic undercloud upgrade job failed in periodic.
http://logs.rdoproject.org/00/24700/1/check/periodic-tripleo-ci-centos-7-singlenode-featureset050-upgrades-master/54ddff7/logs/undercloud/home/zuul/undercloud_upgrade.log

2020-01-28 07:46:32 | TASK [Stop docker] *************************************************************
2020-01-28 07:46:32 | Tuesday 28 January 2020 07:46:32 +0000 (0:00:00.095) 0:00:08.255 *******
2020-01-28 07:46:33 | ERROR! the role 'tripleo_podman' was not found in /home/zuul/undercloud-ansible-QndLsf/roles:/root/.ansible/roles:/home/zuul/undercloud-ansible-QndLsf/roles:/home/zuul/undercloud-ansible-QndLsf/roles:/usr/share/ansible/tripleo-roles:/usr/share/ansible/roles:/usr/share/ceph-ansible/roles:/etc/ansible/roles:/usr/share/openstack-tripleo-validations/roles:/home/zuul/undercloud-ansible-QndLsf
2020-01-28 07:46:33 |
2020-01-28 07:46:33 | The error appears to be in '/home/zuul/undercloud-ansible-QndLsf/Undercloud/post_upgrade_tasks.yaml': line 72, column 11, but may
2020-01-28 07:46:33 | be elsewhere in the file depending on the exact syntax problem.
2020-01-28 07:46:33 |
2020-01-28 07:46:33 | The offending line appears to be:
2020-01-28 07:46:33 |
2020-01-28 07:46:33 | - include_role:
2020-01-28 07:46:33 | name: tripleo_podman
2020-01-28 07:46:33 | ^ here

From rpm list, we found following: http://logs.rdoproject.org/00/24700/1/check/periodic-tripleo-ci-centos-7-singlenode-featureset050-upgrades-master/54ddff7/logs/undercloud/var/log/extra/rpm-list.txt

openstack-tripleo-heat-templates-12.0.1-0.20200127215423.53a7d4e.el7.noarch
tripleo-ansible-0.4.2-0.20200125004949.213072c.el7.noarch

tripleo-ansible is very old here. We need to update the version of tripleo-ansible during post upgrade procees.

[yatin (yatinkarel)]

<< tripleo-ansible is very old here. We need to update the version of tripleo-ansible during post upgrade procees.
Need to do before upgrade runs:- https://opendev.org/openstack/tripleo-upgrade/src/branch/master/tasks/common/undercloud_prerequisites.yaml#L10

[chandan kumar (chkumar246)]

Few more similar issues:
http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-singlenode-featureset050-upgrades-master/1ab6470/logs/undercloud/home/zuul/undercloud_upgrade.log.txt.gz

2020-01-29 02:04:17 | ERROR! the role 'tripleo_module_load' was not found in /home/zuul/undercloud-ansible-6Cxwpg/roles:/root/.ansible/roles:/home/zuul/undercloud-ansible-6Cxwpg/roles:/home/zuul/undercloud-ansible-6Cxwpg/roles:/usr/share/ansible/tripleo-roles:/usr/share/ansible/roles:/usr/share/ceph-ansible/roles:/etc/ansible/roles:/usr/share/openstack-tripleo-validations/roles:/home/zuul/undercloud-ansible-6Cxwpg
2020-01-29 02:04:17 |
2020-01-29 02:04:17 | The error appears to be in '/home/zuul/undercloud-ansible-6Cxwpg/Undercloud/host_prep_tasks.yaml': line 289, column 11, but may
2020-01-29 02:04:17 | be elsewhere in the file depending on the exact syntax problem.
2020-01-29 02:04:17 |
2020-01-29 02:04:17 | The offending line appears to be:
2020-01-29 02:04:17 |
2020-01-29 02:04:17 | - import_role:
2020-01-29 02:04:17 | name: tripleo_module_load
2020-01-29 02:04:17 | ^ here

[chandan kumar (chkumar246)]

Recently, tripleo-ansible got this patch https://review.opendev.org/#/c/703441/ merged recently which renames the role from - to _. the same changes related to tht https://review.opendev.org/#/c/703443/ got merged also. But during upgrade, tripleo-ansible latest version is needed which is not yet available and as there is no tag for tripleo-ansible with the above patch.

First we need to create a new release of tripleo-ansible But i think this patch https://review.opendev.org/703477 aslo needs to be merged.

Once we have a new version available, we can use the same version of tripleo-ansible in tripleo-heat-templates spec file.

[wes hayutin (weshayutin)]

https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-singlenode-featureset050-upgrades-master

[OpenStack Infra (hudson-openstack)]

Change abandoned by mathieu bultel (<email address hidden>) on branch: master
Review: https://review.opendev.org/704564