potential for pacemaker version mismatch (BM vs.container) is a risk for OC deploy failures in gates

[Matt Young]

http://logs.openstack.org/80/567580/1/check/tripleo-ci-centos-7-containers-multinode/fb7bc13/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-05-11_02_47_34

this bug needs a better writeup/analysis, capturing the issue for now. this is causing gate failures.

[wes hayutin (weshayutin)]

based on the results from the jobs in https://review.openstack.org/#/c/567580/ this is resolved.

[Matt Young (halcyondude)]

The underlying issues are not resolved, flipping this back to triaged. The patch we landed just disables the container updates in the gates....

[Matt Young (halcyondude)]

Note, the bug attached that turned off container updates in gates was really targeted at a different specific issue...gates timing out attempting to update containers with deps from all the changes that piled in at 7.5 release of centos. That's a distinct issue from having a version mismatch *possible* between pacemaker inside container vs. in BM image. That change to CI is slated to be reverted when gates return to being stable - because the centos base images have been updated and the # of updates in the gate has returned to workable levels (in the allotted gate job max duration). That revert has not landed yet (https://review.openstack.org/#/c/568341).

Let's use this bug to track the underlying issue of the *potential for* pacemaker version mismatch.

[Matt Young (halcyondude)]

We appear to be hitting this again in gates...

http://logs.openstack.org/33/567833/2/check/tripleo-ci-centos-7-scenario003-multinode-oooq-container/5cfd5a9/logs/subnode-2/var/log/journal.txt.gz#_May_15_14_17_49 for https://review.openstack.org/#/c/568443/

[Matt Young (halcyondude)]

<trozet> myoung|ruck: yeah I did this workaround that I'm testing now:

https://gerrit.opnfv.org/gerrit/#/c/56981/26/lib/ansible/playbooks/prepare_overcloud_containers.yml

[Matt Young (halcyondude)]

Revert "temp workaround to bring ci gates back online"
https://review.openstack.org/#/c/568341

has merged. New CI feature work to detect/warn/prevent this general class of issue is tracked by:

RFE: detect and warn when package versions in bare metal vs. container don't match Edit
https://bugs.launchpad.net/tripleo/+bug/1771602