Master/wallaby/Victoria/Train clients component is failing on "Collect OpenStack Keystone domains infos" task with AttributeError: 'Munch' object has no attribute 'to_dict'

[Sandeep Yadav]

Description:-

Master/wallaby/Victoria/Train clients component is failing on "Collect OpenStack Keystone domains infos" task with AttributeError: 'Munch' object has no attribute 'to_dict'

Log snippet:-
~~~

2022-05-10 23:47:25.897586 | fa163e69-01d4-9892-edfa-000000001e82 | FATAL | Collect OpenStack Keystone domains infos | undercloud | error={"changed": false, "module_stderr": "Traceback (most recent call last):
  File "/usr/lib/python3.9/site-packages/munch/__init__.py", line 103, in __getattr__
    return object.__getattribute__(self, k)
AttributeError: 'Munch' object has no attribute 'to_dict'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3.9/site-packages/munch/__init__.py", line 106, in __getattr__
    return self[k]
KeyError: 'to_dict'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<stdin>", line 107, in <module>
  File "<stdin>", line 99, in _ansiballz_main
  File "<stdin>", line 47, in invoke_module
  File "/usr/lib64/python3.9/runpy.py", line 210, in run_module
    return _run_module_code(code, init_globals, run_name, mod_spec)
  File "/usr/lib64/python3.9/runpy.py", line 97, in _run_module_code
    _run_code(code, mod_globals, init_globals,
  File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/tmp/ansible_openstack.cloud.identity_domain_info_payload_sxkc7ld4/ansible_openstack.cloud.identity_domain_info_payload.zip/ansible_collections/openstack/cloud/plugins/modules/identity_domain_info.py", line 123, in <module>
  File "/tmp/ansible_openstack.cloud.identity_domain_info_payload_sxkc7ld4/ansible_openstack.cloud.identity_domain_info_payload.zip/ansible_collections/openstack/cloud/plugins/modules/identity_domain_info.py", line 119, in main
  File "/tmp/ansible_openstack.cloud.identity_domain_info_payload_sxkc7ld4/ansible_openstack.cloud.identity_domain_info_payload.zip/ansible_collections/openstack/cloud/plugins/module_utils/openstack.py", line 438, in __call__
  File "/tmp/ansible_openstack.cloud.identity_domain_info_payload_sxkc7ld4/ansible_openstack.cloud.identity_domain_info_payload.zip/ansible_collections/openstack/cloud/plugins/modules/identity_domain_info.py", line 113, in run
  File "/tmp/ansible_openstack.cloud.identity_domain_info_payload_sxkc7ld4/ansible_openstack.cloud.identity_domain_info_payload.zip/ansible_collections/openstack/cloud/plugins/modules/identity_domain_info.py", line 113, in <listcomp>
  File "/usr/lib/python3.9/site-packages/munch/__init__.py", line 108, in __getattr__
    raise AttributeError(k)
AttributeError: to_dict
", "module_stdout": "", "msg": "MODULE FAILURE
See stdout/stderr for the exact error", "rc": 1}
2022-05-10 23:47:25.898223 | fa163e69-01d4-9892-edfa-000000001e82 | TIMING | tripleo_keystone_resources : Collect OpenStack Keystone domains infos | undercloud | 0:17:52.228348 | 1.38s
~~~

ansible-collections-openstack rpm differs in last good run vs current run for all the branches:_

for master-

Earlier good known version:-
ansible-collections-openstack-1.7.2-0.20220504132830.c83e0e3.el9

Broken with:-
ansible-collections-openstack-1.7.2-0.20220510202938.80ef209.el9

Logs url:-

https://logserver.rdoproject.org/openstack-component-clients/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-undercloud-upgrade-clients-master/bbed24f/logs/undercloud/home/zuul/undercloud_install.log.txt.gz

https://logserver.rdoproject.org/openstack-component-clients/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-containers-multinode-clients-wallaby/50edb4c/logs/undercloud/home/zuul/undercloud_install.log.txt.gz

https://logserver.rdoproject.org/openstack-component-clients/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-containers-multinode-clients-victoria/c3d0e22/logs/undercloud/home/zuul/undercloud_install.log.txt.gz

https://logserver.rdoproject.org/openstack-component-clients/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-containers-multinode-clients-train/e45e2c5/logs/undercloud/home/zuul/undercloud_install.log.txt.gz

[Sandeep Yadav (sandeepyadav93)]

Looks like recent refactoring in identity_domain_info broke us.

[1] https://github.com/openstack/ansible-collections-openstack/commit/b31fdf8320af1a39ecee9277f90213a26b81a5b1

[Jakob Meng (jm1337)]

Patch to restrict Ansible OpenStack collection in RDO to stable releases:
https://review.rdoproject.org/r/c/rdoinfo/+/42734

[Jakob Meng (jm1337)]

Fixes all the way down to OpenStack Train:

  https://review.rdoproject.org/r/c/rdoinfo/+/42736,
  https://review.rdoproject.org/r/c/rdoinfo/+/42737,
  https://review.rdoproject.org/r/c/rdoinfo/+/42738,
  https://review.rdoproject.org/r/c/rdoinfo/+/42739,
  https://review.rdoproject.org/r/c/rdoinfo/+/42740,
  https://review.rdoproject.org/r/c/rdoinfo/+/42741

[Sandeep Yadav (sandeepyadav93)]

Jobs are back to green after pinning ansible-collection-openstack in rdo-info.

build history:-

https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-9-containers-multinode-clients-master&skip=0

https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-9-containers-multinode-clients-wallaby&skip=0

https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-containers-multinode-clients-victoria&skip=0

https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-containers-multinode-clients-train&skip=0