Scenario003 failing on master branch with error={"ansible_loop_var": "item", "changed": false, "item": "standalone", "msg": "Specified network was not found."}

[Sandeep Yadav]

Description:

Scenario003 failing on master branch with error={"ansible_loop_var": "item", "changed": false, "item": "standalone", "msg": "Specified network was not found."}

Logs:-
https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario003-standalone-master/533b8c8/logs/undercloud/home/zuul/ansible.log.txt.gz

~~~
2021-05-30 10:14:19,278 p=48035 u=root n=ansible | 2021-05-30 10:14:19.277939 | fa163eff-fcc1-a32c-7420-000000000f79 | TASK | Create a neutron port for a new address
2021-05-30 10:14:21,287 p=48035 u=root n=ansible | 2021-05-30 10:14:21.286254 | fa163eff-fcc1-a32c-7420-000000000f79 | FATAL | Create a neutron port for a new address | undercloud | item=standalone | error={"ansible_loop_var": "item", "changed": false, "item": "standalone", "msg": "Specified network was not found."}
~~~

More examples:

https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario003-standalone-master/b1bb2a7/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz

Observations:-

In last good run, I don't see the failing task running:-
"TASK | Create a neutron port for a new address"

https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario003-standalone-master/f17e72e/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz

Above task comes from https://opendev.org/openstack/tripleo-heat-templates/src/branch/master/deployment/unbound/unbound-container-ansible.yaml#L139

I see one change in the above file: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/792727 merged recently which may be related.

[Rabi Mishra (rabi)]

This is broken by https://review.opendev.org/c/openstack/tripleo-heat-templates/+/786087 where the tasks were added and it merged yesterday.

I think the tasks should not be running with standalone.

[Brent Eagles (beagles)]

Also it was missed by CI because there were missing triggers. I've added them here: https://review.opendev.org/c/openstack/tripleo-ci/+/793964

I'll look into the required changes for this to work, we'll need this to work in order to support full designate functionality in standalone.

[Rabi Mishra (rabi)]

May be override ServiceNetMap so that it uses ctlplane for UnboundNetwork and PublicNetwork(?) for standalone (sc003) rather than external(?)

[Brent Eagles (beagles)]

We could reverse the tht patch or do something the like the following which removes the unbound resolver template from CI, adds the triggers to CI and attempts to re-add it. This unblocks the CI job and prevents changes to the unbound related code from messing up CI until it's fixed.

https://review.opendev.org/q/topic:%22fix-unbound-ci%22+(status:open%20OR%20status:merged)

[Rabi Mishra (rabi)]

Ignore my last comment. There is no network in standalone.

[Sandeep Yadav (sandeepyadav93)]

@brent

+1 if we can revert the tht patch to unblock ci, while we fix this properly.

[wes hayutin (weshayutin)]

+1 to revert

[Sandeep Yadav (sandeepyadav93)]

test project: https://review.rdoproject.org/r/c/testproject/+/32054 passes with depends-On https://review.opendev.org/c/openstack/tripleo-heat-templates/+/793968

~~~
periodic-tripleo-ci-centos-8-scenario003-standalone-master https://review.rdoproject.org/zuul/build/b615b1475c6549049c3eeac304ee8085 : SUCCESS in 1h 12m 46s
~~~