FS 01 train rhel8 overcloud deploy failed with failed to glob pattern /etc/rc0.d/[SK][0-9][0-9]network: No such file or directory

[chandan kumar]

FS 01 train RHEL8 job failed while deploying overcloud at while Write rc of NetworkConfig script task with following errors:

http://logs.rdoproject.org/openstack-periodic-latest-released/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-train/65661dd/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz

2019-12-09 06:33:25 | "[2019/12/09 06:32:55 AM] [INFO] adding interface: eth4",
2019-12-09 06:33:25 | "[2019/12/09 06:32:55 AM] [INFO] adding bridge: br-tenant",
2019-12-09 06:33:25 | "[2019/12/09 06:32:55 AM] [WARNING] ifcfg format supports max 2 resolvers.",
2019-12-09 06:33:25 | "[2019/12/09 06:32:55 AM] [INFO] adding interface: eth5",
2019-12-09 06:33:25 | "[2019/12/09 06:32:55 AM] [INFO] applying network configs...",
2019-12-09 06:33:25 | "[2019/12/09 06:32:55 AM] [INFO] Running ip route add 0.0.0.0/0 via 10.0.0.1 dev br-ex",
2019-12-09 06:33:25 | "[2019/12/09 06:32:55 AM] [WARNING] Error in 'ip route add 0.0.0.0/0 via 10.0.0.1 dev br-ex', restarting br-ex:",
2019-12-09 06:33:25 | "Unexpected error while running command.",
2019-12-09 06:33:25 | "Command: /sbin/ip route add 0.0.0.0/0 via 10.0.0.1 dev br-ex",
2019-12-09 06:33:25 | "Exit code: 1",
2019-12-09 06:33:25 | "Stdout: ''",
2019-12-09 06:33:25 | "Stderr: 'Cannot find device \"br-ex\"\\n'",

and

2019-12-09 06:33:25 | TASK [Ensure network service is enabled] ***************************************
2019-12-09 06:33:25 | Monday 09 December 2019 06:33:24 -0500 (0:00:00.228) 0:02:45.632 *******
2019-12-09 06:33:25 | fatal: [overcloud-controller-0]: FAILED! => {
2019-12-09 06:33:25 | "changed": false
2019-12-09 06:33:25 | }
2019-12-09 06:33:25 |
2019-12-09 06:33:25 | MSG:
2019-12-09 06:33:25 |
2019-12-09 06:33:25 | Unable to enable service network: network.service is not a native service, redirecting to systemd-sysv-install.
2019-12-09 06:33:25 | Executing: /usr/lib/systemd/systemd-sysv-install enable network
2019-12-09 06:33:25 | failed to glob pattern /etc/rc0.d/[SK][0-9][0-9]network: No such file or directory
2019-12-09 06:33:25 |
2019-12-09 06:33:25 | fatal: [overcloud-controller-1]: FAILED! => {
2019-12-09 06:33:25 | "changed": false
2019-12-09 06:33:25 | }
2019-12-09 06:33:25 |

It is something new and we are seeing in last 3 runs.

http://logs.rdoproject.org/openstack-periodic-latest-released/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-train/45a1c67/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz

http://logs.rdoproject.org/27/24027/1/check/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-train/54e2498/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz

As per error br-ex network are generally created by ovb. It needs more investigation why it is not getting created.

[Marios Andreou (marios-b)]

14:03 < marios|rover> chkumar|ruck: are you sure it isn't duplicate for https://bugs.launchpad.net/tripleo/+bug/1853028