Error deploying with ephemeral-heat resource resource_registry is empty

[Juan Badia Payno]

Deploying tripleo with tripleo-quickstart:

openstack overcloud deploy --stack overcloud \
   \
  --override-ansible-cfg /home/stack/custom_ansible.cfg \
  --templates /usr/share/openstack-tripleo-heat-templates \
  --libvirt-type qemu --timeout 90 -e /home/stack/cloud-names.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/deployed-server-environment.yaml -e /home/stack/overcloud-baremetal-deployed.yaml --deployed-server -e /home/stack/containers-prepare-parameter.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/podman.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/network-isolation.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/net-single-nic-with-vlans.yaml -e /home/stack/network-environment.yaml -e /home/stack/overcloud_storage_params.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/low-memory-usage.yaml -e /home/stack/enable-tls.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/ssl/tls-endpoints-public-ip.yaml -e /home/stack/inject-trust-anchor.yaml --validation-warnings-fatal -e /home/stack/overcloud-topology-config.yaml --heat-type pod -e /home/stack/overcloud-selinux-config.yaml -e /usr/share/openstack-tripleo-heat-templates/ci/environments/ovb-ha.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/cephadm/cephadm.yaml --disable-validations --disable-protected-resource-type

PLAY RECAP *********************************************************************
overcloud-controller-0 : ok=2 changed=1 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0
2021-10-06 14:05:54.891804 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Summary Information ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2021-10-06 14:05:54.892202 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Total Tasks: 2 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2021-10-06 14:05:54.892496 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Elapsed Time: 0:00:10.538923 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2021-10-06 14:05:54.892878 | UUID | Info | Host | Task Name | Run Time
2021-10-06 14:05:54.893252 | 00eddd1c-5cbf-6396-d573-00000000000b | SUMMARY | overcloud-controller-0 | Wait for provisioned nodes to boot | 10.26s
2021-10-06 14:05:54.893551 | 00eddd1c-5cbf-6396-d573-00000000000d | SUMMARY | overcloud-controller-0 | Find the growvols utility | 0.23s
2021-10-06 14:05:54.893860 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ End Summary Information ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2021-10-06 14:05:55.054 118732 INFO tripleoclient.utils.utils [-] Temporary directory [ /tmp/tripleo5z2p4f72 ] cleaned up
2021-10-06 14:05:55.054 118732 INFO tripleoclient.utils.utils [-] Ansible execution success. playbook: /usr/share/ansible/tripleo-playbooks/cli-overcloud-node-growvols.yaml
2021-10-06 14:05:55.055 118732 INFO tripleoclient.utils.utils [-] Temporary directory [ /tmp/tripleo0wksuvg1 ] cleaned up
2021-10-06 14:05:55.055 118732 INFO tripleoclient.utils.utils [-] Running Ansible playbook: /usr/share/ansible/tripleo-playbooks/cli-overcloud-node-growvols.yaml, Working directory: /tmp/tripleo2evqd2p9, Playbook directory: /usr/share/ansible/tripleo-playbooks
2021-10-06 14:05:55.055 118732 INFO tripleoclient.utils.utils [-] Running ansible with the following limit: Compute

PLAY [Overcloud Node Grow Volumes] *********************************************
2021-10-06 14:05:55.633820 | 00eddd1c-5cbf-3209-56be-00000000000b | TASK | Wait for provisioned nodes to boot
2021-10-06 14:06:05.888553 | 00eddd1c-5cbf-3209-56be-00000000000b | OK | Wait for provisioned nodes to boot | overcloud-novacompute-0
2021-10-06 14:06:05.889826 | 00eddd1c-5cbf-3209-56be-00000000000b | TIMING | Wait for provisioned nodes to boot | overcloud-novacompute-0 | 0:00:10.264741 | 10.26s
2021-10-06 14:06:05.892673 | 00eddd1c-5cbf-3209-56be-00000000000d | TASK | Find the growvols utility
2021-10-06 14:06:06.121380 | 00eddd1c-5cbf-3209-56be-00000000000d | CHANGED | Find the growvols utility | overcloud-novacompute-0
2021-10-06 14:06:06.122414 | 00eddd1c-5cbf-3209-56be-00000000000d | TIMING | Find the growvols utility | overcloud-novacompute-0 | 0:00:10.497330 | 0.23s

PLAY RECAP *********************************************************************
overcloud-novacompute-0 : ok=2 changed=1 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0
2021-10-06 14:06:06.154155 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Summary Information ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2021-10-06 14:06:06.154438 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Total Tasks: 2 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2021-10-06 14:06:06.154749 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Elapsed Time: 0:00:10.529672 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2021-10-06 14:06:06.155018 | UUID | Info | Host | Task Name | Run Time
2021-10-06 14:06:06.155301 | 00eddd1c-5cbf-3209-56be-00000000000b | SUMMARY | overcloud-novacompute-0 | Wait for provisioned nodes to boot | 10.26s
2021-10-06 14:06:06.155574 | 00eddd1c-5cbf-3209-56be-00000000000d | SUMMARY | overcloud-novacompute-0 | Find the growvols utility | 0.23s
2021-10-06 14:06:06.156377 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ End Summary Information ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2021-10-06 14:06:06.316 118732 INFO tripleoclient.utils.utils [-] Temporary directory [ /tmp/tripleoqmfyjakh ] cleaned up
2021-10-06 14:06:06.316 118732 INFO tripleoclient.utils.utils [-] Ansible execution success. playbook: /usr/share/ansible/tripleo-playbooks/cli-overcloud-node-growvols.yaml
2021-10-06 14:06:06.316 118732 INFO tripleoclient.utils.utils [-] Temporary directory [ /tmp/tripleo2evqd2p9 ] cleaned up
2021-10-06 14:06:06.317 118732 INFO tripleoclient.utils.utils [-] Running Ansible playbook: /usr/share/ansible/tripleo-playbooks/cli-overcloud-node-growvols.yaml, Working directory: /tmp/tripleort8glvdw, Playbook directory: /usr/share/ansible/tripleo-playbooks
2021-10-06 14:06:06.317 118732 INFO tripleoclient.utils.utils [-] Running ansible with the following limit: CephStorage

PLAY [Overcloud Node Grow Volumes] *********************************************
2021-10-06 14:06:06.889972 | 00eddd1c-5cbf-4713-2a19-00000000000b | TASK | Wait for provisioned nodes to boot
2021-10-06 14:06:17.136168 | 00eddd1c-5cbf-4713-2a19-00000000000b | OK | Wait for provisioned nodes to boot | overcloud-cephstorage-0
2021-10-06 14:06:17.137353 | 00eddd1c-5cbf-4713-2a19-00000000000b | TIMING | Wait for provisioned nodes to boot | overcloud-cephstorage-0 | 0:00:10.256004 | 10.25s
2021-10-06 14:06:17.140208 | 00eddd1c-5cbf-4713-2a19-00000000000d | TASK | Find the growvols utility
2021-10-06 14:06:17.368601 | 00eddd1c-5cbf-4713-2a19-00000000000d | CHANGED | Find the growvols utility | overcloud-cephstorage-0
2021-10-06 14:06:17.369647 | 00eddd1c-5cbf-4713-2a19-00000000000d | TIMING | Find the growvols utility | overcloud-cephstorage-0 | 0:00:10.488298 | 0.23s

PLAY RECAP *********************************************************************
overcloud-cephstorage-0 : ok=2 changed=1 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0
2021-10-06 14:06:17.404218 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Summary Information ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2021-10-06 14:06:17.404471 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Total Tasks: 2 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2021-10-06 14:06:17.404820 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Elapsed Time: 0:00:10.523478 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2021-10-06 14:06:17.405108 | UUID | Info | Host | Task Name | Run Time
2021-10-06 14:06:17.405373 | 00eddd1c-5cbf-4713-2a19-00000000000b | SUMMARY | overcloud-cephstorage-0 | Wait for provisioned nodes to boot | 10.25s
2021-10-06 14:06:17.405640 | 00eddd1c-5cbf-4713-2a19-00000000000d | SUMMARY | overcloud-cephstorage-0 | Find the growvols utility | 0.23s
2021-10-06 14:06:17.405970 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ End Summary Information ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2021-10-06 14:06:17.584 118732 INFO tripleoclient.utils.utils [-] Temporary directory [ /tmp/tripleoy3e9sf7k ] cleaned up
2021-10-06 14:06:17.584 118732 INFO tripleoclient.utils.utils [-] Ansible execution success. playbook: /usr/share/ansible/tripleo-playbooks/cli-overcloud-node-growvols.yaml
2021-10-06 14:06:17.585 118732 INFO tripleoclient.utils.utils [-] Temporary directory [ /tmp/tripleort8glvdw ] cleaned up
2021-10-06 14:06:17.590 118732 INFO tripleoclient.v1.overcloud_deploy.DeployOvercloud [-] Using ephemeral heat for stack operation
2021-10-06 14:06:18.146 118732 INFO tripleoclient.heat_launcher [-] Skipping container image pull.
2021-10-06 14:06:18.238 118732 INFO tripleoclient.heat_launcher [-] Checking that database is up
2021-10-06 14:06:18.498 118732 INFO tripleoclient.heat_launcher [-] Checking that message bus (rabbitmq) is up
2021-10-06 14:06:22.189 7 INFO migrate.versioning.api [-] 72 -> 73...
2021-10-06 14:06:22.290 7 INFO migrate.versioning.api [-] done
2021-10-06 14:06:22.290 7 INFO migrate.versioning.api [-] 73 -> 74...
2021-10-06 14:06:22.295 7 INFO migrate.versioning.api [-] done
2021-10-06 14:06:22.295 7 INFO migrate.versioning.api [-] 74 -> 75...
2021-10-06 14:06:22.298 7 INFO migrate.versioning.api [-] done
2021-10-06 14:06:22.299 7 INFO migrate.versioning.api [-] 75 -> 76...
2021-10-06 14:06:22.302 7 INFO migrate.versioning.api [-] done
2021-10-06 14:06:22.302 7 INFO migrate.versioning.api [-] 76 -> 77...
2021-10-06 14:06:22.306 7 INFO migrate.versioning.api [-] done
2021-10-06 14:06:22.306 7 INFO migrate.versioning.api [-] 77 -> 78...
2021-10-06 14:06:22.310 7 INFO migrate.versioning.api [-] done
2021-10-06 14:06:22.310 7 INFO migrate.versioning.api [-] 78 -> 79...
2021-10-06 14:06:22.352 7 INFO migrate.versioning.api [-] done
2021-10-06 14:06:22.352 7 INFO migrate.versioning.api [-] 79 -> 80...
2021-10-06 14:06:22.378 7 INFO migrate.versioning.api [-] done
2021-10-06 14:06:22.378 7 INFO migrate.versioning.api [-] 80 -> 81...
2021-10-06 14:06:22.381 7 INFO migrate.versioning.api [-] done
2021-10-06 14:06:22.381 7 INFO migrate.versioning.api [-] 81 -> 82...
2021-10-06 14:06:22.385 7 INFO migrate.versioning.api [-] done
2021-10-06 14:06:22.385 7 INFO migrate.versioning.api [-] 82 -> 83...
2021-10-06 14:06:22.389 7 INFO migrate.versioning.api [-] done
2021-10-06 14:06:22.389 7 INFO migrate.versioning.api [-] 83 -> 84...
2021-10-06 14:06:22.393 7 INFO migrate.versioning.api [-] done
2021-10-06 14:06:22.393 7 INFO migrate.versioning.api [-] 84 -> 85...
2021-10-06 14:06:22.397 7 INFO migrate.versioning.api [-] done
2021-10-06 14:06:22.397 7 INFO migrate.versioning.api [-] 85 -> 86...
2021-10-06 14:06:22.430 7 INFO migrate.versioning.api [-] done
Pod:
93eb80ff89defe09cd0af3485fa313b3a1eea76da8fa3874b73a6210f50e3839
Containers:
030edcd413faf7a2457bd0e1ef1f6173b5f1b45f67280d864c0706949825d788
0fbcd0a8006e3179f0ed35913d8204ba75b32d2957b1a1cd584d8c7b66042a07

2021-10-06 14:06:31.878 118732 INFO tripleoclient.v1.overcloud_deploy.DeployOvercloud [-] Processing templates in the directory /home/stack/overcloud-deploy/overcloud/tripleo-heat-templates
2021-10-06 14:06:33.409 118732 INFO tripleoclient.v1.overcloud_deploy.DeployOvercloud [-] Stopping ephemeral heat.
2021-10-06 14:06:33.494 118732 INFO tripleoclient.heat_launcher [-] Killing pod: ephemeral-heat
93eb80ff89defe09cd0af3485fa313b3a1eea76da8fa3874b73a6210f50e3839
2021-10-06 14:06:33.592 118732 INFO tripleoclient.heat_launcher [-] Killed pod: ephemeral-heat
2021-10-06 14:06:33.856 118732 INFO tripleoclient.heat_launcher [-] Starting back up of heat db
2021-10-06 14:06:34.038 118732 INFO tripleoclient.heat_launcher [-] Created tarfile /home/stack/overcloud-deploy/overcloud/heat-launcher/heat-db.sql-1633529177.590543.tar.bzip2
2021-10-06 14:06:34.038 118732 INFO tripleoclient.heat_launcher [-] Deleting /home/stack/overcloud-deploy/overcloud/heat-launcher/heat-db.sql
2021-10-06 14:06:34.474 118732 INFO tripleoclient.heat_launcher [-] Removing pod: ephemeral-heat
93eb80ff89defe09cd0af3485fa313b3a1eea76da8fa3874b73a6210f50e3839
2021-10-06 14:06:34.602 118732 INFO tripleoclient.heat_launcher [-] Created tarfile /home/stack/overcloud-deploy/overcloud/heat-launcher/log/heat-1633529177.590543.log-1633529177.590543.tar.bzip2
2021-10-06 14:06:34.603 118732 INFO tripleoclient.heat_launcher [-] Deleting /home/stack/overcloud-deploy/overcloud/heat-launcher/log/heat-1633529177.590543.log
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud [-] Exception occured while running the command: heatclient.exc.HTTPBadRequest: ERROR: Internal Error
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud Traceback (most recent call last):
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud File "/usr/lib/python3.6/site-packages/tripleoclient/command.py", line 34, in run
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud super(Command, self).run(parsed_args)
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud File "/usr/lib/python3.6/site-packages/osc_lib/command/command.py", line 39, in run
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud return super(Command, self).run(parsed_args)
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud File "/usr/lib/python3.6/site-packages/cliff/command.py", line 186, in run
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud return_code = self.take_action(parsed_args) or 0
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud File "/usr/lib/python3.6/site-packages/tripleoclient/v1/overcloud_deploy.py", line 1152, in take_action
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud user_tht_root, created_env_files)
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud File "/usr/lib/python3.6/site-packages/tripleoclient/v1/overcloud_deploy.py", line 414, in deploy_tripleo_heat_templates
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud deployment_options=deployment_options)
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud File "/usr/lib/python3.6/site-packages/tripleoclient/v1/overcloud_deploy.py", line 433, in _try_overcloud_deploy_with_compat_yaml
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud deployment_options=deployment_options)
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud File "/usr/lib/python3.6/site-packages/tripleoclient/v1/overcloud_deploy.py", line 240, in _heat_deploy
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud self.working_dir)
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud File "/usr/lib/python3.6/site-packages/tripleoclient/workflows/parameters.py", line 134, in check_deprecated_parameters
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud valid=True)
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud File "/usr/lib/python3.6/site-packages/tripleoclient/workflows/roles.py", line 49, in get_roles
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud files, env_files)
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud File "/usr/lib/python3.6/site-packages/tripleoclient/utils.py", line 1844, in build_stack_data
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud result = orchestration_client.stacks.validate(**fields)
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud File "/usr/lib/python3.6/site-packages/heatclient/v1/stacks.py", line 350, in validate
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud resp = self.client.post(url, **args)
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud File "/usr/lib/python3.6/site-packages/heatclient/common/http.py", line 292, in post
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud return self.client_request("POST", url, **kwargs)
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud File "/usr/lib/python3.6/site-packages/heatclient/common/http.py", line 282, in client_request
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud resp, body = self.json_request(method, url, **kwargs)
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud File "/usr/lib/python3.6/site-packages/heatclient/common/http.py", line 271, in json_request
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud resp = self._http_request(url, method, **kwargs)
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud File "/usr/lib/python3.6/site-packages/heatclient/common/http.py", line 234, in _http_request
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud raise exc.from_response(resp)
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud heatclient.exc.HTTPBadRequest: ERROR: Internal Error
2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud
2021-10-06 14:06:34.608 118732 ERROR openstack [-] ERROR: Internal Error: heatclient.exc.HTTPBadRequest: ERROR: Internal Error
2021-10-06 14:06:34.610 118732 INFO osc_lib.shell [-] END return value: 1
+ status_code=1

#####
## /home/stack/overcloud-deploy/overcloud/heat-launcher/log/heat-1633529177.590543.log
#####
version_negotiation.py:72
2021-10-06 14:06:33.103 1 INFO heat.common.wsgi [req-139a4205-1080-452b-87f7-34cc7aa83674 admin admin - - -] Processing request: POST /v1/admin/validate
2021-10-06 14:06:33.123 1 DEBUG heat.common.wsgi [req-139a4205-1080-452b-87f7-34cc7aa83674 admin admin - - -] Calling StackController.validate_template __call__ /usr/lib/python3.6/site-packages/heat/common/wsgi.py:888
2021-10-06 14:06:33.236 11 INFO heat.engine.service [req-139a4205-1080-452b-87f7-34cc7aa83674 admin admin - - -] validate_template
2021-10-06 14:06:33.382 11 ERROR oslo_messaging.rpc.server [req-139a4205-1080-452b-87f7-34cc7aa83674 admin admin - - -] Exception during message handling: ValueError: environment has empty section "resource_registry"
2021-10-06 14:06:33.382 11 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2021-10-06 14:06:33.382 11 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
2021-10-06 14:06:33.382 11 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message)
2021-10-06 14:06:33.382 11 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
2021-10-06 14:06:33.382 11 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args)
2021-10-06 14:06:33.382 11 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
2021-10-06 14:06:33.382 11 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args)
2021-10-06 14:06:33.382 11 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/osprofiler/profiler.py", line 160, in wrapper
2021-10-06 14:06:33.382 11 ERROR oslo_messaging.rpc.server result = f(*args, **kwargs)
2021-10-06 14:06:33.382 11 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/heat/common/context.py", line 410, in wrapped
2021-10-06 14:06:33.382 11 ERROR oslo_messaging.rpc.server return func(self, ctx, *args, **kwargs)
2021-10-06 14:06:33.382 11 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/heat/engine/service.py", line 1288, in validate_template
2021-10-06 14:06:33.382 11 ERROR oslo_messaging.rpc.server params, tmpl.all_param_schemata(files))
2021-10-06 14:06:33.382 11 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/heat/common/environment_util.py", line 165, in merge_environments
2021-10-06 14:06:33.382 11 ERROR oslo_messaging.rpc.server parsed_env = env_fmt.parse(raw_env)
2021-10-06 14:06:33.382 11 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/heat/common/environment_format.py", line 52, in parse
2021-10-06 14:06:33.382 11 ERROR oslo_messaging.rpc.server return validate(env)
2021-10-06 14:06:33.382 11 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/heat/common/environment_format.py", line 60, in validate
2021-10-06 14:06:33.382 11 ERROR oslo_messaging.rpc.server raise ValueError(_('environment has empty section "%s"') % param)
2021-10-06 14:06:33.382 11 ERROR oslo_messaging.rpc.server ValueError: environment has empty section "resource_registry"
2021-10-06 14:06:33.382 11 ERROR oslo_messaging.rpc.server
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi [req-139a4205-1080-452b-87f7-34cc7aa83674 admin admin - - -] Unexpected error occurred serving API: environment has empty section "resource_registry"
Traceback (most recent call last):

  File "/usr/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
    res = self.dispatcher.dispatch(message)

  File "/usr/lib/python3.6/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
    return self._do_dispatch(endpoint, method, ctxt, args)

  File "/usr/lib/python3.6/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
    result = func(ctxt, **new_args)

  File "/usr/lib/python3.6/site-packages/osprofiler/profiler.py", line 160, in wrapper
    result = f(*args, **kwargs)

  File "/usr/lib/python3.6/site-packages/heat/common/context.py", line 410, in wrapped
    return func(self, ctx, *args, **kwargs)

  File "/usr/lib/python3.6/site-packages/heat/engine/service.py", line 1288, in validate_template
    params, tmpl.all_param_schemata(files))

  File "/usr/lib/python3.6/site-packages/heat/common/environment_util.py", line 165, in merge_environments
    parsed_env = env_fmt.parse(raw_env)

  File "/usr/lib/python3.6/site-packages/heat/common/environment_format.py", line 52, in parse
    return validate(env)

  File "/usr/lib/python3.6/site-packages/heat/common/environment_format.py", line 60, in validate
    raise ValueError(_('environment has empty section "%s"') % param)

ValueError: environment has empty section "resource_registry"
: ValueError: environment has empty section "resource_registry"
Traceback (most recent call last):

  File "/usr/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
    res = self.dispatcher.dispatch(message)

  File "/usr/lib/python3.6/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
    return self._do_dispatch(endpoint, method, ctxt, args)

  File "/usr/lib/python3.6/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
    result = func(ctxt, **new_args)

  File "/usr/lib/python3.6/site-packages/osprofiler/profiler.py", line 160, in wrapper
    result = f(*args, **kwargs)

  File "/usr/lib/python3.6/site-packages/heat/common/context.py", line 410, in wrapped
    return func(self, ctx, *args, **kwargs)

  File "/usr/lib/python3.6/site-packages/heat/engine/service.py", line 1288, in validate_template
    params, tmpl.all_param_schemata(files))

  File "/usr/lib/python3.6/site-packages/heat/common/environment_util.py", line 165, in merge_environments
    parsed_env = env_fmt.parse(raw_env)

  File "/usr/lib/python3.6/site-packages/heat/common/environment_format.py", line 52, in parse
    return validate(env)

  File "/usr/lib/python3.6/site-packages/heat/common/environment_format.py", line 60, in validate
    raise ValueError(_('environment has empty section "%s"') % param)

ValueError: environment has empty section "resource_registry"
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi Traceback (most recent call last):
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi File "/usr/lib/python3.6/site-packages/heat/common/wsgi.py", line 891, in __call__
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi request, **action_args)
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi File "/usr/lib/python3.6/site-packages/heat/common/wsgi.py", line 964, in dispatch
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi return method(*args, **kwargs)
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi File "/usr/lib/python3.6/site-packages/heat/api/openstack/v1/util.py", line 46, in handle_stack_method
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi return handler(controller, req, **kwargs)
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi File "/usr/lib/python3.6/site-packages/heat/api/openstack/v1/stacks.py", line 653, in validate_template
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi ignorable_errors=ignorable_errors)
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi File "/usr/lib/python3.6/site-packages/heat/rpc/client.py", line 412, in validate_template
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi version='1.36')
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi File "/usr/lib/python3.6/site-packages/heat/rpc/client.py", line 89, in call
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi return client.call(ctxt, method, **kwargs)
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi File "/usr/lib/python3.6/site-packages/oslo_messaging/rpc/client.py", line 192, in call
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi retry=self.retry, transport_options=self.transport_options)
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi File "/usr/lib/python3.6/site-packages/oslo_messaging/transport.py", line 128, in _send
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi transport_options=transport_options)
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi File "/usr/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 682, in send
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi transport_options=transport_options)
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi File "/usr/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 672, in _send
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi raise result
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi ValueError: environment has empty section "resource_registry"
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi Traceback (most recent call last):
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi File "/usr/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi res = self.dispatcher.dispatch(message)
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi File "/usr/lib/python3.6/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi return self._do_dispatch(endpoint, method, ctxt, args)
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi File "/usr/lib/python3.6/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi result = func(ctxt, **new_args)
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi File "/usr/lib/python3.6/site-packages/osprofiler/profiler.py", line 160, in wrapper
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi result = f(*args, **kwargs)
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi File "/usr/lib/python3.6/site-packages/heat/common/context.py", line 410, in wrapped
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi return func(self, ctx, *args, **kwargs)
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi File "/usr/lib/python3.6/site-packages/heat/engine/service.py", line 1288, in validate_template
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi params, tmpl.all_param_schemata(files))
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi File "/usr/lib/python3.6/site-packages/heat/common/environment_util.py", line 165, in merge_environments
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi parsed_env = env_fmt.parse(raw_env)
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi File "/usr/lib/python3.6/site-packages/heat/common/environment_format.py", line 52, in parse
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi return validate(env)
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi File "/usr/lib/python3.6/site-packages/heat/common/environment_format.py", line 60, in validate
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi raise ValueError(_('environment has empty section "%s"') % param)
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi ValueError: environment has empty section "resource_registry"
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi
2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi
2021-10-06 14:06:33.408 1 INFO eventlet.wsgi.server [req-139a4205-1080-452b-87f7-34cc7aa83674 admin admin - - -] 10.255.255.1 - - [06/Oct/2021 14:06:33] "POST /v1/admin/validate?show_nested=True HTTP/1.1" 400 1774 0.369004

[Juan Badia Payno (jbadiapa)]

the steps to deploy the environment were:

./quickstart.sh -n -R master-tripleo-ci --tags none -T all --nodes config/nodes/1ctlr_1comp_1ceph.yml 127.0.0.2 2>&1 | tee ~/logs/cleaning.log

./quickstart.sh -n -X -R master-tripleo-ci --tags all -T none --nodes config/nodes/1ctlr_1comp_1ceph.yml -p quickstart.yml 127.0.0.2 2>&1 | tee ~/logs/provisioning.log

./quickstart.sh -n -R master-tripleo-ci --tags all -I -T none --nodes config/nodes/1ctlr_1comp_1ceph.yml -p quickstart-extras-undercloud.yml 127.0.0.2 2>&1 | tee ~/logs/undercloud.log

./quickstart.sh -R master-tripleo-ci --no-clone --tags all -I -T none --nodes config/nodes/1ctlr_1comp_1ceph.yml -p quickstart-extras-overcloud-prep.yml 127.0.0.2 2>&1 | tee ~/logs/pre-overcloud.log

./quickstart.sh -R master-tripleo-ci --no-clone --tags overcloud-scripts -I -T none --nodes config/nodes/1ctlr_1comp_1ceph.yml -p quickstart-extras-overcloud.yml 127.0.0.2 2>&1 | tee ~/logs/scripts-overcloud.log

[Rabi Mishra (rabi)]

minimal featureset which is used by default[1] had issues, now fixed with https://review.opendev.org/c/openstack/tripleo-quickstart/+/812423. Try with that patch.

[1] https://github.com/openstack/tripleo-quickstart/blob/master/quickstart.sh#L203

[Juan Badia Payno (jbadiapa)]

Thx, that fixed the patch.

Now only the following commands are needed but that's another thing:

openstack overcloud network provision -y -o overcloud-networks-deployed.yaml /usr/share/openstack-tripleo-heat-templates/ci/network_data.yaml

openstack overcloud network vip provision -y -o overcloud-vips-deployed.yaml --stack overcloud /usr/share/openstack-tripleo-heat-templates/ci/vip_data.yaml

openstack overcloud node provision -o overcloud-baremetal-deployed.yaml --stack overcloud overcloud_baremetal_deploy.yaml

[Juan Badia Payno (jbadiapa)]

This patch was fixed by https://review.opendev.org/c/openstack/tripleo-quickstart/+/812423 already merged.

[zenzop (zenzop)]

can you share logs please ? https://techzpod.com/ https://get-mobdrovip.com

[Juan Badia Payno (jbadiapa)]

(undercloud) [stack@undercloud ~]$ ./overcloud-deploy.sh
+ source /home/stack/stackrc
+++ set
+++ awk -F= '/^OS_/ {print $1}'
++ for key in $( set | awk -F= '/^OS_/ {print $1}' )
++ unset OS_CLOUD
++ export OS_CLOUD=undercloud
++ OS_CLOUD=undercloud
++ '[' -z 1 ']'
+ openstack overcloud deploy --stack overcloud --skip-nodes-and-networks --override-ansible-cfg /home/stack/custom_ansible.cfg --templates /usr/share/openstack-tripleo-heat-templates --libvirt-type qemu --timeout 90 -e /home/stack/cloud-names.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/deployed-server-environment.yaml -e /home/stack/overcloud-baremetal-deployed.yaml --deployed-server -e /home/stack/containers-prepare-parameter.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/podman.yaml --networks-file /usr/share/openstack-tripleo-heat-templates/network-data-samples/default-network-isolation.yaml -e /home/stack/overcloud-networks-deployed.yaml -e /home/stack/overcloud-vips-deployed.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/net-single-nic-with-vlans.yaml -e /home/stack/network-environment.yaml -e /home/stack/overcloud_storage_params.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/low-memory-usage.yaml -e /home/stack/enable-tls.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/ssl/tls-endpoints-public-ip.yaml -e /home/stack/inject-trust-anchor.yaml --validation-warnings-fatal -e /home/stack/overcloud-topology-config.yaml --heat-type pod -e /home/stack/overcloud-selinux-config.yaml -e /usr/share/openstack-tripleo-heat-templates/ci/environments/ovb-ha.yaml --disable-validations --disable-protected-resource-types
2021-10-07 13:02:38.948 6995 ERROR openstack [-] Error: The following files were not found: /home/stack/overcloud-baremetal-deployed.yaml, /home/stack/overcloud-networks-deployed.yaml, /home/stack/overcloud-vips-deployed.yaml: osc_lib.exceptions.CommandError: Error: The following files were not found: /home/stack/overcloud-baremetal-deployed.yaml, /home/stack/overcloud-networks-deployed.yaml, /home/stack/overcloud-vips-deployed.yaml
2021-10-07 13:02:38.948 6995 INFO osc_lib.shell [-] END return value: 1
+ status_code=1
+ exit 1

[Rabi Mishra (rabi)]

overcloud-deploy role should do those for you unless you're doing something wrong.

[1] https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/overcloud-deploy/tasks/deploy-overcloud.yml#L13-L54