50-heat-config-docker-cmd failing while deploying overcloud with deployed servers

[venkata anil]

I am trying to install overcloud with deployed servers as explained in [1] with latest tripleo repos i.e

yum install -y https://trunk.rdoproject.org/centos7/current/python2-tripleo-repos-0.0.1-0.20190328140951.a7bc8dc.el7.noarch.rpm
sudo -E tripleo-repos current-tripleo-dev ceph
On both compute and controller nodes, os-refresh-config failing with below errors

Apr 01 23:04:00 compute-0.redhat.local os-collect-config[20681]: Command failed, will not cache new data. Command 'os-refresh-config' returned non-zero exit status 1
Apr 01 23:04:29 compute-0.redhat.local sudo[24229]: stack : TTY=pts/1 ; PWD=/home/stack ; USER=root ; COMMAND=/bin/journalctl -fa
Apr 01 23:04:29 compute-0.redhat.local sudo[24229]: pam_unix(sudo:session): session opened for user root by root(uid=0)
Apr 01 23:04:30 compute-0.redhat.local os-collect-config[20681]: [2019-04-01 23:04:30,854] (os-refresh-config) [INFO] Starting phase pre-configure
Apr 01 23:04:30 compute-0.redhat.local os-collect-config[20681]: dib-run-parts Mon Apr 1 23:04:30 UTC 2019 ----------------------- PROFILING -----------------------
Apr 01 23:04:30 compute-0.redhat.local os-collect-config[20681]: dib-run-parts Mon Apr 1 23:04:30 UTC 2019
Apr 01 23:04:30 compute-0.redhat.local os-collect-config[20681]: dib-run-parts Mon Apr 1 23:04:30 UTC 2019 Target: pre-configure.d
Apr 01 23:04:30 compute-0.redhat.local os-collect-config[20681]: dib-run-parts Mon Apr 1 23:04:30 UTC 2019
Apr 01 23:04:30 compute-0.redhat.local os-collect-config[20681]: dib-run-parts Mon Apr 1 23:04:30 UTC 2019 Script Seconds
Apr 01 23:04:30 compute-0.redhat.local os-collect-config[20681]: dib-run-parts Mon Apr 1 23:04:30 UTC 2019 --------------------------------------- ----------
Apr 01 23:04:30 compute-0.redhat.local os-collect-config[20681]: dib-run-parts Mon Apr 1 23:04:30 UTC 2019
Apr 01 23:04:30 compute-0.redhat.local os-collect-config[20681]: dib-run-parts Mon Apr 1 23:04:30 UTC 2019
Apr 01 23:04:30 compute-0.redhat.local os-collect-config[20681]: dib-run-parts Mon Apr 1 23:04:30 UTC 2019 --------------------- END PROFILING ---------------------
Apr 01 23:04:30 compute-0.redhat.local os-collect-config[20681]: [2019-04-01 23:04:30,897] (os-refresh-config) [INFO] Completed phase pre-configure
Apr 01 23:04:30 compute-0.redhat.local os-collect-config[20681]: [2019-04-01 23:04:30,897] (os-refresh-config) [INFO] Starting phase configure
Apr 01 23:04:30 compute-0.redhat.local os-collect-config[20681]: dib-run-parts Mon Apr 1 23:04:30 UTC 2019 Running /usr/libexec/os-refresh-config/configure.d/20-os-apply-config
Apr 01 23:04:31 compute-0.redhat.local os-collect-config[20681]: [2019/04/01 11:04:31 PM] [INFO] writing /var/run/heat-config/heat-config
Apr 01 23:04:31 compute-0.redhat.local os-collect-config[20681]: [2019/04/01 11:04:31 PM] [INFO] writing /etc/os-collect-config.conf
Apr 01 23:04:31 compute-0.redhat.local os-collect-config[20681]: [2019/04/01 11:04:31 PM] [INFO] success
Apr 01 23:04:31 compute-0.redhat.local os-collect-config[20681]: dib-run-parts Mon Apr 1 23:04:31 UTC 2019 20-os-apply-config completed
Apr 01 23:04:31 compute-0.redhat.local os-collect-config[20681]: dib-run-parts Mon Apr 1 23:04:31 UTC 2019 Running /usr/libexec/os-refresh-config/configure.d/50-heat-config-docker-cmd
Apr 01 23:04:31 compute-0.redhat.local os-collect-config[20681]: No handlers could be found for logger "paunch"
Apr 01 23:04:31 compute-0.redhat.local os-collect-config[20681]: Traceback (most recent call last):
Apr 01 23:04:31 compute-0.redhat.local os-collect-config[20681]: File "/usr/libexec/os-refresh-config/configure.d/50-heat-config-docker-cmd", line 62, in <module>
Apr 01 23:04:31 compute-0.redhat.local os-collect-config[20681]: sys.exit(main(sys.argv))
Apr 01 23:04:31 compute-0.redhat.local os-collect-config[20681]: File "/usr/libexec/os-refresh-config/configure.d/50-heat-config-docker-cmd", line 57, in main
Apr 01 23:04:31 compute-0.redhat.local os-collect-config[20681]: DOCKER_CMD
Apr 01 23:04:31 compute-0.redhat.local os-collect-config[20681]: File "/usr/lib/python2.7/site-packages/paunch/__init__.py", line 105, in cleanup
Apr 01 23:04:31 compute-0.redhat.local os-collect-config[20681]: r.delete_missing_configs(config_ids)
Apr 01 23:04:31 compute-0.redhat.local os-collect-config[20681]: File "/usr/lib/python2.7/site-packages/paunch/runner.py", line 160, in delete_missing_configs
Apr 01 23:04:31 compute-0.redhat.local os-collect-config[20681]: for conf_id in self.current_config_ids():
Apr 01 23:04:31 compute-0.redhat.local os-collect-config[20681]: File "/usr/lib/python2.7/site-packages/paunch/runner.py", line 73, in current_config_ids
Apr 01 23:04:31 compute-0.redhat.local os-collect-config[20681]: cmd_stdout, cmd_stderr, returncode = self.execute(cmd, self.log)
Apr 01 23:04:31 compute-0.redhat.local os-collect-config[20681]: File "/usr/lib/python2.7/site-packages/paunch/runner.py", line 44, in execute
Apr 01 23:04:31 compute-0.redhat.local os-collect-config[20681]: stderr=subprocess.PIPE)
Apr 01 23:04:31 compute-0.redhat.local os-collect-config[20681]: File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__
Apr 01 23:04:31 compute-0.redhat.local os-collect-config[20681]: errread, errwrite)
Apr 01 23:04:31 compute-0.redhat.local os-collect-config[20681]: File "/usr/lib64/python2.7/subprocess.py", line 1327, in _execute_child
Apr 01 23:04:31 compute-0.redhat.local os-collect-config[20681]: raise child_exception
Apr 01 23:04:31 compute-0.redhat.local os-collect-config[20681]: OSError: [Errno 2] No such file or directory
Apr 01 23:04:31 compute-0.redhat.local os-collect-config[20681]: [2019-04-01 23:04:31,273] (os-refresh-config) [ERROR] during configure phase. [Command '['dib-run-parts', '/usr/libexec/os-refresh-config/configure.d']' returned non-zero exit status 1]
Apr 01 23:04:31 compute-0.redhat.local os-collect-config[20681]: [2019-04-01 23:04:31,273] (os-refresh-config) [ERROR] Aborting...

[venkata anil (anil-venkata)]

By default HEAT_DOCKER_CMD is set docker [1] and to be replaced with podman

[1] https://github.com/openstack/heat-agents/blob/master/heat-config-docker-cmd/os-refresh-config/configure.d/50-heat-config-docker-cmd#L25

[venkata anil (anil-venkata)]

When I changed HEAT_DOCKER_CMD to podman, I don't see this error in my setup.

[Rabi Mishra (rabi)]

> By default HEAT_DOCKER_CMD is set docker [1] and to be replaced with podman

We don't have plan to default it to 'podman' in heat-agents.

May be that doc needs updating. Probably you should use https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/ansible_config_download.html#config-download-with-deployed-server instead.