Error: Package: openstack-heat-agents-1.5.4-0.20180301153730.ecf43c7.el7.centos.noarch fails to install

[Michele Baldessari]

From http://logs.openstack.org/80/551380/1/check/tripleo-ci-centos-7-containers-multinode/09bedb2/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-03-10_09_38_29 we have:

2018-03-10 09:38:29 | fatal: [192.168.24.3]: FAILED! => {"changed": false, "msg": "Error: Package: openstack-heat-agents-1.5.4-0.20180301153730.ecf43c7.el7.centos.noarch (delorean)
           Requires: python-heat-agent-json-file = 1.5.4-0.20180301153730.ecf43c7.el7.centos
           Installed: python-heat-agent-json-file-1.5.4-0.20180308153305.ecf43c7.el7.centos.noarch (@delorean)
               python-heat-agent-json-file = 1.5.4-0.20180308153305.ecf43c7.el7.centos
           Available: python-heat-agent-json-file-1.5.4-0.20180301153730.ecf43c7.el7.centos.noarch (delorean)
               python-heat-agent-json-file = 1.5.4-0.20180301153730.ecf43c7.el7.centos
Error: Package: openstack-heat-agents-1.5.4-0.20180301153730.ecf43c7.el7.centos.noarch (delorean)
           Requires: python-heat-agent-apply-config = 1.5.4-0.20180301153730.ecf43c7.el7.centos
           Installed: python-heat-agent-apply-config-1.5.4-0.20180308153305.ecf43c7.el7.centos.noarch (@delorean)
               python-heat-agent-apply-config = 1.5.4-0.20180308153305.ecf43c7.el7.centos
           Available: python-heat-agent-apply-config-1.5.4-0.20180301153730.ecf43c7.el7.centos.noarch (delorean)
               python-heat-agent-apply-config = 1.5.4-0.20180301153730.ecf43c7.el7.centos
Error: Package: openstack-heat-agents-1.5.4-0.20180301153730.ecf43c7.el7.centos.noarch (delorean)
           Requires: python-heat-agent = 1.5.4-0.20180301153730.ecf43c7.el7.centos
           Installed: python-heat-agent-1.5.4-0.20180308153305.ecf43c7.el7.centos.noarch (@delorean)
               python-heat-agent = 1.5.4-0.20180308153305.ecf43c7.el7.centos
           Available: python-heat-agent-1.5.4-0.20180301153730.ecf43c7.el7.centos.noarch (delorean)
               python-heat-agent = 1.5.4-0.20180301153730.ecf43c7.el7.centos
Error: Package: openstack-heat-agents-1.5.4-0.20180301153730.ecf43c7.el7.centos.noarch (delorean)
           Requires: python-heat-agent-ansible = 1.5.4-0.20180301153730.ecf43c7.el7.centos
           Installed: python-heat-agent-ansible-1.5.4-0.20180308153305.ecf43c7.el7.centos.noarch (@delorean)
               python-heat-agent-ansible = 1.5.4-0.20180308153305.ecf43c7.el7.centos
           Available: python-heat-agent-ansible-1.5.4-0.20180301153730.ecf43c7.el7.centos.noarch (delorean)
               python-heat-agent-ansible = 1.5.4-0.20180301153730.ecf43c7.el7.centos
Error: Package: openstack-heat-agents-1.5.4-0.20180301153730.ecf43c7.el7.centos.noarch (delorean)
           Requires: python-heat-agent-puppet = 1.5.4-0.20180301153730.ecf43c7.el7.centos
           Installed: python-heat-agent-puppet-1.5.4-0.20180308153305.ecf43c7.el7.centos.noarch (@delorean)
               python-heat-agent-puppet = 1.5.4-0.20180308153305.ecf43c7.el7.centos
           Available: python-heat-agent-puppet-1.5.4-0.20180301153730.ecf43c7.el7.centos.noarch (delorean)
               python-heat-agent-puppet = 1.5.4-0.20180301153730.ecf43c7.el7.centos
Error: Package: openstack-heat-agents-1.5.4-0.20180301153730.ecf43c7.el7.centos.noarch (delorean)
           Requires: python-heat-agent-docker-cmd = 1.5.4-0.20180301153730.ecf43c7.el7.centos
           Installed: python-heat-agent-docker-cmd-1.5.4-0.20180308153305.ecf43c7.el7.centos.noarch (@delorean)
               python-heat-agent-docker-cmd = 1.5.4-0.20180308153305.ecf43c7.el7.centos
           Available: python-heat-agent-docker-cmd-1.5.4-0.20180301153730.ecf43c7.el7.centos.noarch (delorean)
               python-heat-agent-docker-cmd = 1.5.4-0.20180301153730.ecf43c7.el7.centos
Error: Package: openstack-heat-agents-1.5.4-0.20180301153730.ecf43c7.el7.centos.noarch (delorean)
           Requires: python-heat-agent-hiera = 1.5.4-0.20180301153730.ecf43c7.el7.centos
           Installed: python-heat-agent-hiera-1.5.4-0.20180308153305.ecf43c7.el7.centos.noarch (@delorean)
               python-heat-agent-hiera = 1.5.4-0.20180308153305.ecf43c7.el7.centos
           Available: python-heat-agent-hiera-1.5.4-0.20180301153730.ecf43c7.el7.centos.noarch (delorean)
               python-heat-
2018-03-10 09:38:29 | END return value: 1

[Michele Baldessari (michele)]

Some more IRC context:
1404 amoralej ? trown|rover, so the problem is that in multinode queens jobs python-heat-agents* is installed from current repo in https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/bootstrap-overcloud-full-minimal.sh#L39
1404 ? ? but then, repos are changed
1404 ? ? and it tries to install openstack-heat-agents from current-tripleo
1404 ? ? and it fails because of unresolved deps
1405 ? ? http://logs.openstack.org/37/551237/1/check/tripleo-ci-centos-7-3nodes-multinode/e5fa1ba/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-03-11_19_49_49
1405 ? ? i'd say right solution is to use current-tripleo for the initial bootstrap
1406 ? ? or install python-heat-agents* openstack-heat-agents
1406 ? ? but i'd say it's better the first, although i'm not sure
1407 trown|rover ? amoralej: ah I see, I guess it depends on if we have tripleo gates on heat-agents
1407 amoralej ? mmm
1407 ? ? good point
1408 ? ? but in that case, wouldn't it install from temporary repo built on the fly?
1409 trown|rover ? amoralej: well if we had a dependent change it would be in the temp repo, but I think we would still fail without doing `install python-heat-agents* openstack-heat-agents`

[John Trowbridge (trown)]

The root cause here is that we are still using tripleo.sh for this node bootstrapping. The repo setup function in tripleo.sh for stable releases just uses delorean current:

https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/tripleo.sh#L323-L344

I think the simplest solution is just to add openstack-heat-agents to the bootstrap script. We need another bug (tech debt), for getting all of this bootstrapping code into an ansible role, so it can use the same repo config as the rest of the CI job though.

[John Trowbridge (trown)]

Filed another bug for moving bootstrap code to an ansible role: https://bugs.launchpad.net/tripleo/+bug/1755175

[John Trowbridge (trown)]

linked the wrong section of tripleo.sh code above... for posterity, https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/tripleo.sh#L361-L365 is the relevant bit.

[Michele Baldessari (michele)]

I think with https://review.openstack.org/#/c/552015/ merged this one can be closed. Will reopen if I spot this issue in the wild. Thanks, John!