periodic ovb master jobs failing "Stderr: u'Cannot find device "br-ex" & error: Could not connect to cluster

[Marios Andreou]

periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039-master [1] , periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master [2] , periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master [3] failing - first error is related to network then pacemaker then many other things.

traces in [1][2][3] below like:

  | [2019/03/15 01:23:46 AM] [WARNING] Error in 'ip route add default via 2001:db8:fd00:1000::1 dev br-ex', restarting br-ex:
  | Unexpected error while running command.
  | Command: /sbin/ip route add default via 2001:db8:fd00:1000::1 dev br-ex
  | Exit code: 1
  | Stdout: u''
  | Stderr: u'Cannot find device "br-ex"\n'

then

  | "error: Could not connect to cluster (is it running?)",

  | "stderr: Error: unable to get cib",
  | "Error: unable to get cib",

[1] http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039-master/7cd376d/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz

[2] http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/e42d3f6/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz

[3] http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master/9452fa3/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz

[Marios Andreou (marios-b)]

As suspected this is no longer seen after we had a promotion (which didn't happen for > 2 weeks).

All three jobs have green runs [1] today - except fs 01 but that is failing on a different error we can file a new bug if that is needed.

Closing this as invalid thanks.

[1]
https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039-master
https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master
https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master