Master: Node provisioning failure with "ironic.common.exception.ConfigInvalid: Auth plugin requires parameters which were not given: auth_url"

[Sandeep Yadav]

Description:

All the ovb jobs in the master branch are failing on the node provisioning step with "ironic.common.exception.ConfigInvalid: Auth plugin requires parameters which were not given: auth_url"

The issue was first observed on 11th January as per build history:

https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-master

Snippet:

https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-ovb-1ctlr_2comp-featureset020-master/285c3c6/logs/undercloud/home/zuul/overcloud_node_provision.log.txt.gz

~~~
2023-01-11 02:18:14.025712 | fa163e97-70e4-8a0f-2319-000000000016 | FATAL | Provision instances | localhost | error={"changed": false, "logging": "Created port overcloud-novacompute-0-ctlplane (UUID 4fa52925-c8bd-4dba-a7af-a4ef0e81d878) for node baremetal-97750-0 (UUID 3cd8a1a2-8508-46be-a052-f099a821e901) with {'network_id': '7602daa0-524b-446a-a858-b545c73a201c', 'name': 'overcloud-novacompute-0-ctlplane'}
.
.
", "msg": "Node 3cd8a1a2-8508-46be-a052-f099a821e901 reached failure state "deploy failed"; the last error is Deploy step deploy.deploy failed: Auth plugin requires parameters which were not given: auth_url."}
2023-01-11 02:18:14.027849 | fa163e97-70e4-8a0f-2319-000000000016 | TIMING | Provision instances | localhost | 0:04:52.472853 | 282.40s
~~~

Ironic conductor logs:

https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-ovb-1ctlr_2comp-featureset020-master/285c3c6/logs/undercloud/var/log/containers/ironic/ironic-conductor.log.txt.gz
~~~
2023-01-11 02:18:11.455 2 ERROR ironic.conductor.task_manager [None req-42731e4c-e674-4a05-9e5f-263f881842dc admin - - - - -] Node 86688992-5617-476c-97e0-eacca27958af moved to provision state "deploy failed" from state "deploying"; target provision state is "active": ironic.common.exception.ConfigInvalid: Auth plugin requires parameters which were not given: auth_url

2023-01-11 02:18:11.477 2 ERROR ironic.conductor.task_manager [None req-a1238d06-8fac-45d6-83cd-28475b28eb06 admin - - - - -] Node 0e85a882-ecaa-42a1-b1ef-40a1fd004186 moved to provision state "deploy failed" from state "deploying"; target provision state is "active": ironic.common.exception.ConfigInvalid: Auth plugin requires parameters which were not given: auth_url
~~~

More examples:

https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-master/030742f/logs/undercloud/home/zuul/overcloud_node_provision.log.txt.gz

[Sandeep Yadav (sandeepyadav93)]

Hello,

Thanks to tkajinam, who suggested over irc to test patch[1] as a fix for this issue.

Takashi mentioned that they merged the dependent patch[2] few hours ago and that might have caused the incomplete configuration, which should be addressed by tht patch[1].

I am testing the tht fix with testproject[3]

[1] https://review.opendev.org/c/openstack/tripleo-heat-templates/+/868381
[2] https://review.opendev.org/868414
[3] https://review.rdoproject.org/r/c/testproject/+/38348/45/zuul.yaml

[Rabi Mishra (rabi)]

Yeah https://review.opendev.org/c/openstack/tripleo-heat-templates/+/868381 should fix the issue.

[Sandeep Yadav (sandeepyadav93)]

fix: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/868381 merged.