Failover of container registries fails

[Sagi (Sergey) Shnaidman]

When trying to pull containers from different registries, the failover fails:

2020-11-25 18:49:55.273277 | primary | MSG:
2020-11-25 18:49:55.273294 | primary |
2020-11-25 18:49:55.273311 | primary | The task includes an option with an undefined variable. The error was: 'dict object' has no attribute 'split'
2020-11-25 18:49:55.273343 | primary |
2020-11-25 18:49:55.273370 | primary | The error appears to be in '/home/zuul/workspace/.quickstart/usr/local/share/ansible/roles/container-build/tasks/non_tripleo_containers.yml': line 44, column 3, but may
2020-11-25 18:49:55.273396 | primary | be elsewhere in the file depending on the exact syntax problem.
2020-11-25 18:49:55.273414 | primary |
2020-11-25 18:49:55.273430 | primary | The offending line appears to be:
2020-11-25 18:49:55.273446 | primary |
2020-11-25 18:49:55.273461 | primary |
2020-11-25 18:49:55.273477 | primary | - name: Pull failed containers from RDO registry
2020-11-25 18:49:55.273493 | primary | ^ here
2020-11-25 18:49:55.273509 | primary |
2020-11-25 18:49:55.273675 | primary | ...ignoring

https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_936/734570/1/gate/tripleo-ci-centos-8-content-provider/93691f5/job-output.txt

From [container-build : List down missing containers] it's possible to see what are "items":

[undercloud] => (item={'cmd': ['podman', 'pull', 'quay.io/prometheus/prometheus:v2.7.2'], 'stdout': '2a68492b2466243c7c73692f575e04c091feebfeae94bb164c4cc811bed773b0', 'stderr': 'Trying to pull quay.io/prometheus/prometheus:v2.7.2...\nGetting image source signatures\nCopying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4\nCopying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4\nCopying blob sha256:65b1a901dcccc7c92e3b43591444a08b0b6ec104758a301c04a02dfb05500c67\nCopying blob sha256:57c14dd66db0390dbf6da578421c077f6de8e88edd0815b4caa94607ba5f4c09\nCopying blob sha256:6d73410cc7fa96bdea537862c4d160d29d252949b71ab67f000d0e7a7c27022c\nCopying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4\nCopying blob sha256:75c520aff8e8d376ed1b5d18fd8b8df5bd2e4a02a0154ceab9af9d5dfdea5f01\nCopying blob sha256:494d1a723657236b2a19ba8773d2058afc39579f2d5f760d9841e22746d84461\nCopying blob sha256:5f8f01ea2931bc86dba46415aca1f80f73c1ee67f18d34f4376ca1d365811bbd\nCopying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4\nCopying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4\nCopying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4\nCopying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4\nCopying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4\nCopying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4\nCopying blob sha256:c0fd0ac7829e8ad3f4d3e1a6bab933b2253440566b121e2cd2d5a790c9d3d09b\nCopying blob sha256:89c95bc388e90cb3fceb3a44f5f852533602db9ff54e9795e50326cfd96344a4\nCopying blob sha256:e51130820cb7f52e561a2f05abd624b0793bcc36accf3b2e5f5d2abdcb4fe6f2\nWriting manifest to image destination\nStoring signatures', 'rc': 0, 'start': '2020-11-25 18:49:38.170996', 'end': '2020-11-25 18:49:43.221096', 'delta': '0:00:05.050100', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'podman pull quay.io/prometheus/prometheus:v2.7.2', 'warn': False, '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['2a68492b2466243c7c73692f575e04c091feebfeae94bb164c4cc811bed773b0'], 'stderr_lines': ['Trying to pull quay.io/prometheus/prometheus:v2.7.2...', 'Getting image source signatures', 'Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4', 'Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4', 'Copying blob sha256:65b1a901dcccc7c92e3b43591444a08b0b6ec104758a301c04a02dfb05500c67', 'Copying blob sha256:57c14dd66db0390dbf6da578421c077f6de8e88edd0815b4caa94607ba5f4c09', 'Copying blob sha256:6d73410cc7fa96bdea537862c4d160d29d252949b71ab67f000d0e7a7c27022c', 'Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4', 'Copying blob sha256:75c520aff8e8d376ed1b5d18fd8b8df5bd2e4a02a0154ceab9af9d5dfdea5f01', 'Copying blob sha256:494d1a723657236b2a19ba8773d2058afc39579f2d5f760d9841e22746d84461', 'Copying blob sha256:5f8f01ea2931bc86dba46415aca1f80f73c1ee67f18d34f4376ca1d365811bbd', 'Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4', 'Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4', 'Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4', 'Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4', 'Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4', 'Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4', 'Copying blob sha256:c0fd0ac7829e8ad3f4d3e1a6bab933b2253440566b121e2cd2d5a790c9d3d09b', 'Copying blob sha256:89c95bc388e90cb3fceb3a44f5f852533602db9ff54e9795e50326cfd96344a4', 'Copying blob sha256:e51130820cb7f52e561a2f05abd624b0793bcc36accf3b2e5f5d2abdcb4fe6f2', 'Writing manifest to image destination', 'Storing signatures'], 'failed': False, 'item': 'quay.io/prometheus/prometheus:v2.7.2', 'ansible_loop_var': 'item'})

[wes hayutin (weshayutin)]

possible dupe of https://bugs.launchpad.net/tripleo/+bug/1903882