Overcloud deployment fails "TASK | Manage container systemd services and cleanup old systemd healthchecks for /var/lib/tripleo-config/container-startup-config/step_3"

[Harald Jensås]

2021-05-10 12:39:14.906052 | fa163e4a-5d17-9ddd-d21f-000000004078 | TASK | Manage container systemd services and cleanup old systemd healthchecks for /var/lib/tripleo-config/container-startup-config/step_3
2021-05-10 12:39:56.512339 | fa163e4a-5d17-9ddd-d21f-000000004078 | FATAL | Manage container systemd services and cleanup old systemd healthchecks for /var/lib/tripleo-config/container-startup-config/step_3 | controller-0 | error={"ch
anged": false, "msg": "Service iscsid has not started yet"}

May 10 12:50:54 controller-0 systemd[1]: Starting iscsid container...
May 10 12:50:54 controller-0 kernel: overlayfs: unrecognized mount option "volatile" or missing value
May 10 12:50:54 controller-0 runuser[176015]: pam_unix(runuser:session): session opened for user rabbitmq by (uid=0)
May 10 12:50:54 controller-0 systemd[1]: Started libcontainer container 977118ea8f82a7c4e5be5a99e20d40553b92e95f9202570fdd0fc7b17316f87d.
May 10 12:50:55 controller-0 systemd[1]: libpod-977118ea8f82a7c4e5be5a99e20d40553b92e95f9202570fdd0fc7b17316f87d.scope: Succeeded.
May 10 12:50:55 controller-0 systemd[1]: Stopped libcontainer container 977118ea8f82a7c4e5be5a99e20d40553b92e95f9202570fdd0fc7b17316f87d.
May 10 12:50:55 controller-0 systemd[1]: libpod-977118ea8f82a7c4e5be5a99e20d40553b92e95f9202570fdd0fc7b17316f87d.scope: Consumed 34ms CPU time
May 10 12:50:55 controller-0 systemd[7828]: var-lib-containers-storage-overlay\x2dcontainers-977118ea8f82a7c4e5be5a99e20d40553b92e95f9202570fdd0fc7b17316f87d-userdata-shm.mount: Succeeded.
May 10 12:50:55 controller-0 systemd[149953]: var-lib-containers-storage-overlay\x2dcontainers-977118ea8f82a7c4e5be5a99e20d40553b92e95f9202570fdd0fc7b17316f87d-userdata-shm.mount: Succeeded.
May 10 12:50:55 controller-0 systemd[149953]: var-lib-containers-storage-overlay-75dece47ddc2822ff604823a2e6870978b0328dac7974c260ab0ff82434bbac9-merged.mount: Succeeded.
May 10 12:50:55 controller-0 systemd[7828]: var-lib-containers-storage-overlay-75dece47ddc2822ff604823a2e6870978b0328dac7974c260ab0ff82434bbac9-merged.mount: Succeeded.

May 10 12:50:55 controller-0 podman[175932]: Error: OCI runtime error: unable to start container "977118ea8f82a7c4e5be5a99e20d40553b92e95f9202570fdd0fc7b17316f87d": container_linux.go:370: starting container process caused: unknown capabil
ity "CAP_PERFMON"

May 10 12:50:55 controller-0 systemd[1]: tripleo_iscsid.service: Control process exited, code=exited status=125

It seems this is related to https://bugzilla.redhat.com/show_bug.cgi?id=1946982#c3