In Train/ussuri/victoria/master C8 integration line, all the ovb jobs are failing during overcloud deploy at step 3.
and in all these jobs iscsi-initiator-utils-6.2.1.2-1.gita8fcb37.el8.x86_64 is used which comes from CentOS Stream 8 base os repo.
https://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-train/2f3f5c6/logs/overcloud-controller-0/var/log/paunch.log.txt.gz
```
2021-04-05 07:01:10.121 71719 WARNING paunch [ ] Did not find container with "['podman', 'ps', '-a', '--filter', 'label=container_name=iscsid', '--format', '{{.Names}}']"
2021-04-05 07:01:19.025 71719 ERROR paunch [ ] systemctl failed
Traceback (most recent call last):
File "/usr/lib/python3.6/site-packages/paunch/utils/systemctl.py", line 32, in systemctl
subprocess.check_call(cmd)
File "/usr/lib64/python3.6/subprocess.py", line 311, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['systemctl', 'enable', '--now', 'tripleo_iscsid']' returned non-zero exit status 1.
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/python3.6/site-packages/paunch/utils/systemctl.py", line 75, in enable
systemctl(cmd, log)
File "/usr/lib/python3.6/site-packages/paunch/utils/systemctl.py", line 34, in systemctl
raise SystemctlException(str(err))
paunch.utils.systemctl.SystemctlException: Command '['systemctl', 'enable', '--now', 'tripleo_iscsid']' returned non-zero exit status 1.
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/python3.6/site-packages/paunch/utils/systemd.py", line 114, in service_create
systemctl.enable(service, now=True)
File "/usr/lib/python3.6/site-packages/tenacity/__init__.py", line 292, in wrapped_f
return self.call(f, *args, **kw)
File "/usr/lib/python3.6/site-packages/tenacity/__init__.py", line 358, in call
do = self.iter(retry_state=retry_state)
File "/usr/lib/python3.6/site-packages/tenacity/__init__.py", line 331, in iter
raise retry_exc.reraise()
File "/usr/lib/python3.6/site-packages/tenacity/__init__.py", line 167, in reraise
raise self.last_attempt.result()
File "/usr/lib64/python3.6/concurrent/futures/_base.py", line 425, in result
return self.__get_result()
File "/usr/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result
raise self._exception
File "/usr/lib/python3.6/site-packages/tenacity/__init__.py", line 361, in call
result = fn(*args, **kwargs)
File "/usr/lib/python3.6/site-packages/paunch/utils/systemctl.py", line 79, in enable
raise SystemctlException(str(err))
paunch.utils.systemctl.SystemctlException: Command '['systemctl', 'enable', '--now', 'tripleo_iscsid']' returned non-zero exit status 1.
```
Below is the other jobs:
* https://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset002-train/e0ef879/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz
https://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-train/c305b39/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz
https://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-train/017ad64/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz
Filing this bug to track the issue.
The same issue is coming on victoria also
https:/
````
: FATAL | Manage container systemd services and cleanup old systemd healthchecks for /var/lib/
```
https:/
https:/