On CentOS Stream 9 container multinode job, during overcloud deploy, we are seeing following errors:
https://logserver.rdoproject.org/26/34926/10/check/periodic-tripleo-ci-centos-9-containers-multinode-master/013c609/logs/undercloud/home/zuul-worker/overcloud_deploy.log.txt.gz
```
Error: initializing source docker://registry.access.redhat.com/ubi9/pause:latest: reading manifest latest in registry.access.redhat.com/ubi9/pause: name unknown: Repo not found
2021-11-09 04:02:58 | 2021-11-09 04:02:58.898 98153 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud [-] Exception occured while running the command: subprocess.CalledProcessError: Command '['sudo', 'podman', 'play', 'kube', '/home/zuul-worker/overcloud-deploy/overcloud/heat-launcher/heat-pod.yaml']' returned non-zero exit status 125.
2021-11-09 04:02:58 | 2021-11-09 04:02:58.898 98153 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud Traceback (most recent call last):
2021-11-09 04:02:58 | 2021-11-09 04:02:58.898 98153 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud File "/usr/lib/python3.9/site-packages/tripleoclient/command.py", line 34, in run
2021-11-09 04:02:58 | 2021-11-09 04:02:58.898 98153 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud super(Command, self).run(parsed_args)
2021-11-09 04:02:58 | 2021-11-09 04:02:58.898 98153 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud File "/usr/lib/python3.9/site-packages/osc_lib/command/command.py", line 39, in run
2021-11-09 04:02:58 | 2021-11-09 04:02:58.898 98153 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud return super(Command, self).run(parsed_args)
2021-11-09 04:02:58 | 2021-11-09 04:02:58.898 98153 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud File "/usr/lib/python3.9/site-packages/cliff/command.py", line 186, in run
2021-11-09 04:02:58 | 2021-11-09 04:02:58.898 98153 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud return_code = self.take_action(parsed_args) or 0
2021-11-09 04:02:58 | 2021-11-09 04:02:58.898 98153 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud File "/usr/lib/python3.9/site-packages/tripleoclient/v1/overcloud_deploy.py", line 1161, in take_action
2021-11-09 04:02:58 | 2021-11-09 04:02:58.898 98153 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud self.setup_ephemeral_heat(parsed_args)
2021-11-09 04:02:58 | 2021-11-09 04:02:58.898 98153 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud File "/usr/lib/python3.9/site-packages/tripleoclient/v1/overcloud_deploy.py", line 627, in setup_ephemeral_heat
2021-11-09 04:02:58 | 2021-11-09 04:02:58.898 98153 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud self.orchestration_client = utils.launch_heat(self.heat_launcher)
2021-11-09 04:02:58 | 2021-11-09 04:02:58.898 98153 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud File "/usr/lib/python3.9/site-packages/tripleoclient/utils.py", line 2764, in launch_heat
2021-11-09 04:02:58 | 2021-11-09 04:02:58.898 98153 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud launcher.launch_heat()
2021-11-09 04:02:58 | 2021-11-09 04:02:58.898 98153 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud File "/usr/lib/python3.9/site-packages/tripleoclient/heat_launcher.py", line 499, in launch_heat
2021-11-09 04:02:58 | 2021-11-09 04:02:58.898 98153 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud subprocess.check_call([
2021-11-09 04:02:58 | 2021-11-09 04:02:58.898 98153 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud File "/usr/lib64/python3.9/subprocess.py", line 373, in check_call
2021-11-09 04:02:58 | 2021-11-09 04:02:58.898 98153 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud raise CalledProcessError(retcode, cmd)
2021-11-09 04:02:58 | 2021-11-09 04:02:58.898 98153 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud subprocess.CalledProcessError: Command '['sudo', 'podman', 'play', 'kube', '/home/zuul-worker/overcloud-deploy/overcloud/heat-launcher/heat-pod.yaml']' returned non-zero exit status 125.
```
If I try to pull the above container locally, registry.access.redhat.com/ubi9/pause:latest
We are not able to pull it.
Logging this bug to track it and Opened a bug on centos stream side: https://bugzilla.redhat.com/show_bug.cgi?id=2021980
Similar issue is reported here: https:/ /github. com/containers/ podman/ issues/ 11256