The tripleo-ci-centos-7-undercloud-upgrades and containerized-undercloud-upgrades fails during undercloud upgrade in restart xinetd task

[Ronelle Landy]

(originally commented #6 @ https://bugs.launchpad.net/tripleo/+bug/1792527 but decided we need a new issue for tracking as that is fix released)
The tripleo-ci-centos-7-undercloud-upgrades and containerized-undercloud-upgrades fails during undercloud upgrade in restart xinetd task with a trace like:

for 2018-10-05 07:01:58 | TASK [restart xinetd in order to free tftp port] *******************************
  2018-10-05 07:01:59 | fatal: [centos-7-ovh-gra1-0002634214]: FAILED! => {"changed": false, "msg": "Could not find the requested service xinetd: host"}
  2018-10-05 07:01:59 |
  2018-10-05 07:01:59 | PLAY RECAP *********************************************************************
  2018-10-05 07:01:59 | centos-7-ovh-gra1-0002634214 : ok=36 changed=14 unreachable=0 failed=1
  2018-10-05 07:01:59 |
  2018-10-05 07:01:59 | Exception: Upgrade failed

there are many examples like [1-4] below. This issue however is fixed by https://bugs.launchpad.net/tripleo/+bug/1792527 and merged to master and stable/rocky. So the question is why are these jobs still hitting it?

From digging it looks like the playbooks generated from the installed tripleo-heat-templates (e.g. Oct 05 07:26:00 Installed: openstack-tripleo-heat-templates-9.0.1-0.20181005001846.493711f.el7.noarch at [5] ) at [6] don't have the fix from the +bug/1792527 from [7]

I see there *is* a yum update performed before the upgrade at [8] but it seems there is no newer version offered?

[1] http://logs.openstack.org/24/607624/1/check/tripleo-ci-centos-7-undercloud-upgrades/89b0b58/logs/undercloud/home/zuul/undercloud_upgrade.log.txt.gz#_2018-10-04_20_10_53
[2] http://logs.openstack.org/45/560445/155/check/tripleo-ci-centos-7-undercloud-upgrades/06186ad/logs/undercloud/home/zuul/undercloud_upgrade.log.txt.gz
[3] http://logs.openstack.org/24/607624/1/check/tripleo-ci-centos-7-undercloud-upgrades/89b0b58/logs/undercloud/home/zuul/undercloud_upgrade.log.txt.gz
[4] http://logs.openstack.org/90/605090/10/check/tripleo-ci-centos-7-undercloud-upgrades/8776838/logs/undercloud/home/zuul/undercloud_upgrade.log.txt.gz
[5] http://logs.openstack.org/30/607830/2/check/tripleo-ci-centos-7-undercloud-upgrades/3603578/logs/undercloud/var/log/yum.log.txt.gz
[6] http://logs.openstack.org/30/607830/2/check/tripleo-ci-centos-7-undercloud-upgrades/3603578/logs/undercloud/home/zuul/undercloud-ansible-OzhrFz/Undercloud/upgrade_tasks.yaml.txt.gz
[7] https://review.openstack.org/#/c/602550/
[8] http://logs.openstack.org/30/607830/2/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/9f29229/logs/undercloud/home/zuul/undercloud_upgrade.sh.txt.gz

[Marios Andreou (marios-b)]

18:47 < marios> 18:29 <@EvilienM> marios: we need https://review.openstack.org/#/c/608282/
18:47 < marios> 18:29 <@EvilienM> that's why
18:47 < marios> 18:29 <@mwhahaha> marios: we tagged final version so package version issues

[Alex Schultz (alex-schultz)]

patch merged back to rocky and we're in the progress of version bumping everything for stein.