ocata2pike: broken package dependency during upgrade

[Emilien Macchi]

Upgrading from Ocata to Pike doesn't pass the step3 where we upgrade packages:

http://logs.openstack.org/44/504044/1/check/gate-tripleo-ci-centos-7-containers-multinode-upgrades-nv/8206480/logs/undercloud/home/jenkins/overcloud_upgrade_console.log.txt.gz#_2017-09-14_14_26_02

[Javier Peña (jpena-c)]

Find attached a cleaned up file for the upgrade log, in case it can help.

I can't find any error message in the log. Looking at all packages, it looks like the only one where we see "Processing Dependency" but not any indication that it will be installed is ethtool. This is strange, because ethtool is part of the base repos.

[Javier Peña (jpena-c)]

I see the CentOS base repository is disabled: http://logs.openstack.org/44/504044/1/check/gate-tripleo-ci-centos-7-containers-multinode-upgrades-nv/8206480/logs/undercloud/etc/yum.repos.d/CentOS-Base.repo.txt.gz .

This can be the cause of the error, since os-net-config depends on a new package from base (ethtool) in Pike

[Lars Kellogg-Stedman (larsks)]

That link is to the undercloud repository configuration, while the error is happening on the overcloud. Is there any chance it's hitting the same thing as https://bugs.launchpad.net/tripleo/+bug/1717550? Seeing the complete yum error would help.

[Marios Andreou (marios-b)]

Indeed it looks to be the ethtool dependency Javier points at in comment #2 (@Lars you can see /var/log/messages from subnode 2 like http://logs.openstack.org/44/504044/1/check/gate-tripleo-ci-centos-7-containers-multinode-upgrades-nv/8206480/logs/subnode-2/ )

so the error is: "Error: Package: os-net-config-7.2.1-0.20170914123506.04b9cb1.el7.centos.noarch (delorean-current)\n Requires: ethtool" http://logs.openstack.org/44/504044/1/check/gate-tripleo-ci-centos-7-containers-multinode-upgrades-nv/8206480/logs/subnode-2/var/log/messages.txt.gz#_Sep_14_14_25_31

Should/could we enable that base centos repo, or we need another way of making ethtool available

Sep 14 14:25:31 centos-7-2-node-rax-ord-10933264-898494 os-collect-config: fatal: [localhost]: FAILED! => {"changed": true, "failed": true, "msg": "Error: Package: os-net-config-7.2.1-0.20170914123506.04b9cb1.el7.centos.noarch (delorean-current)\n Requires: ethtool\n", "rc": 1, "results": ["Loaded plugins: fastestmirror, priorities\nLoading mirror speeds from cached hostfile\n911 packages excluded due to repository priority protections\nResolving Dependencies\n--> Running transaction check\n---> Package dib-utils.noarch 0:0.0.11-0.20170210183209.51661c3.el7.centos will be updated\n---> Package dib-utils.noarch 0:0.0.11-0.20170210184912.51661c3.el7.centos will be an update\n---> Package liberasurecode.x86_64 0:1.4.0-1.el7 will be updated\n---> Package liberasurecode.x86_64 0:1.5.0-1.el7 will be an update\n---> Package openstack-cinder.noarch 1:10.0.7-0.20170908154324.107cac3.el7.centos will be updated\n---> Package openstack-cinder.noarch 1:11.0.0-0.20170909034127.f67e4ff.el7.centos will be an update\n---> Package openstack-glance.noarch 1:14.0.1-0.20170602111915.0a2074e.el7.centos will be updated\n---> Package openstack-glance.noarch 1:15.0.0-0.20170901153706.1041c1f.el7.centos will be an update\n---> Package openstack-heat-api.noarch 1:8.0.5-0.20170914113842.228248e.el7.centos will be updated\n---> Package openstack-heat-api.noarch 1:9.0.0-0.20170908064402.0de1e37.el7.centos will be an update\n---> Package openstack-heat-api-cfn.noarch 1:8.0.5-0.20170914113842.228248e.el7.centos will be updated\n---> Package openstack-heat-api-cfn.noarch 1:9.0.0-0.20170908064402.0de1e37.el7.centos will be an update\n---> Package openstack-heat-api-cloudwatch.noarch 1:8.0.5-0.20170914113842.228248e.el7.centos will be updated\n---> Package openstack-heat-api-cloudwatch.noarch 1:9.0.0-0.20170908064402.0de1e37.el7.centos will be an update\n---> Package openstack-heat-common.noarch 1:8.0.5-0.20170914113842.228248e.el7.centos will be updated\n---> Package openstack-heat-common.noarch 1:9.0.0-0.20170908064402.0de1e37.el7.centos will be an update\n--> Processing Dependency: python-senlinclient >= 1.1

[Marios Andreou (marios-b)]

kudos weshay on irc just now - he just posted https://review.openstack.org/#/c/505268/

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/505268
Committed: https://git.openstack.org/cgit/openstack/tripleo-quickstart-extras/commit/?id=a07e92ba9444066aee55805d95e0f55392495c06
Submitter: Jenkins
Branch: master

commit a07e92ba9444066aee55805d95e0f55392495c06
Author: Wes Hayutin <email address hidden>
Date: Tue Sep 19 09:52:17 2017 -0400

    add centos base yum repo to upgrade role

    The centos base yum repo role was missing from the
    upgrade role where everything is deleted and readded
    for the appropriate release.

    Closes-Bug: #1717274
    Change-Id: I2c0937b19183444f406865d62009ccfa2f214537

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/tripleo-quickstart-extras 2.1.1 release.