quickstart: ocata/newton overclouds are deployed with pike repos

[Emilien Macchi]

gate-tripleo-ci-centos-7-nonha-multinode-oooq jobs on stable/newton and stable/ocata are now failing because overcloud has repos with packages from trunk (Pike).

[Ben Kero (ben-kero)]

I think I've found the issue. One of the tripleo-quickstart-extras roles is being called that runs tripleo.sh --repo-setup without the STABLE_RELEASE environment variable being set. This can be seen in this log here: http://logs.openstack.org/50/446750/1/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/4bc7b91/logs/undercloud/home/jenkins/toci_vxlan_networking.sh.log.txt.gz

Execution of this can be found here: http://git.openstack.org/cgit/openstack/tripleo-quickstart-extras/tree/roles/undercloud-setup/files/toci_vxlan_networking.sh#n47

Ideally the fix should be to deprecate use of this tripleo.sh multinode_setup() function in favor of logic inside a tripleo-quickstart-extras role, but for now it should work to include the STABLE_RELEASE environment variable to the undercloud-setup role.

You can find an experimental change that does that here: https://review.openstack.org/#/c/446746/

You can find the dependent change to do testing against stable/ocata here: https://review.openstack.org/#/c/446865/

[Sagi (Sergey) Shnaidman (sshnaidm)]

Gabriel added function to copy all required env variables to subnodes: https://github.com/openstack-infra/tripleo-ci/blob/7fdbe42018867634fb7c465da82f14d93c081b57/toci_gate_test-oooq.sh#L205-L205

But it doesn't work because you use different TRIPLEO_ROOT locations.
Anyway, I proposed a workaround just overwriting repos on subnodes to right ones: https://review.openstack.org/#/c/446949/

[Tom Barron (tpb)]

Just logging that we see this affecting https://review.openstack.org/#/c/444314, where 'rpm -qa' for the gate-tripleo-ci-centos-7-nonha-multinode-oooq job doesn't show bridge-utils installed and the console log shows failure with '/bin/sh: brctl: command not found'.