periodic-tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset002-master job is failing bacuse it fails to create the heat resoucre (nova compute)

[Bhagyashri Shewale]

periodic-tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset002-master job is failing while overcloud deployment because it's fail to create the heat resource (nova compute)

Affected Pipeline and job:

https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset002-master

Error logs:

2020-05-08 10:53:55 | 2020-05-08 10:53:35Z [overcloud.ControllerServiceChain]: CREATE_COMPLETE state changedHeat Stack create failed.
2020-05-08 10:53:55 | Heat Stack create failed.
2020-05-08 10:53:55 |
2020-05-08 10:53:55 |
2020-05-08 10:53:55 | Stack overcloud/f87b728a-6fc2-4225-82bb-ea4125acdb6c CREATE_FAILED
2020-05-08 10:53:55 |
2020-05-08 10:53:55 | overcloud.Compute.0.NovaCompute:
2020-05-08 10:53:55 | resource_type: OS::TripleO::ComputeServer
2020-05-08 10:53:55 | physical_resource_id: 4bdb3a4e-824e-41ec-9e66-ed92960249ba
2020-05-08 10:53:55 | status: CREATE_FAILED
2020-05-08 10:53:55 | status_reason: |
2020-05-08 10:53:55 | ClientException: resources.NovaCompute: Unknown Error (HTTP 504)
2020-05-08 10:53:55 | + status_code=1
2020-05-08 10:53:55 | + openstack stack list
2020-05-08 10:53:55 | + grep -q overcloud
2020-05-08 10:54:07 | + openstack stack list
2020-05-08 10:54:07 | + grep -Eq '(CREATE|UPDATE)_COMPLETE'
2020-05-08 10:54:12 | + openstack stack failures list overcloud --long
2020-05-08 10:54:25 | ++ openstack stack resource list --nested-depth 5 overcloud
2020-05-08 10:54:25 | ++ grep FAILED
2020-05-08 10:54:25 | ++ cut -d '|' -f3
2020-05-08 10:54:25 | ++ grep 'StructuredDeployment '
2020-05-08 10:54:45 | + exit 1

logs from nova compute:

2020-05-08 10:32:48.317 7 ERROR oslo_messaging.rpc.server [req-7c23129f-ba0e-4636-aad1-7d96759dd781 6ad2e5fa105d44bebb0d6e50984225e8 ba38456729334f71a1260daf34d88696 - default default] Exception during message handling: NotImplementedError
2020-05-08 10:32:48.317 7 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2020-05-08 10:32:48.317 7 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
2020-05-08 10:32:48.317 7 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message)
2020-05-08 10:32:48.317 7 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/oslo_messaging/rpc/dispatcher.py", line 276, in dispatch
2020-05-08 10:32:48.317 7 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args)
2020-05-08 10:32:48.317 7 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/oslo_messaging/rpc/dispatcher.py", line 196, in _do_dispatch
2020-05-08 10:32:48.317 7 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args)
2020-05-08 10:32:48.317 7 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/nova/exception_wrapper.py", line 79, in wrapped
2020-05-08 10:32:48.317 7 ERROR oslo_messaging.rpc.server function_name, call_dict, binary, tb)
2020-05-08 10:32:48.317 7 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2020-05-08 10:32:48.317 7 ERROR oslo_messaging.rpc.server self.force_reraise()
2020-05-08 10:32:48.317 7 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2020-05-08 10:32:48.317 7 ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb)
2020-05-08 10:32:48.317 7 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/six.py", line 703, in reraise
2020-05-08 10:32:48.317 7 ERROR oslo_messaging.rpc.server raise value
2020-05-08 10:32:48.317 7 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/nova/exception_wrapper.py", line 69, in wrapped
2020-05-08 10:32:48.317 7 ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw)
2020-05-08 10:32:48.317 7 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/nova/compute/manager.py", line 6266, in get_host_uptime
2020-05-08 10:32:48.317 7 ERROR oslo_messaging.rpc.server return self.driver.get_host_uptime()
2020-05-08 10:32:48.317 7 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/nova/virt/driver.py", line 1460, in get_host_uptime
2020-05-08 10:32:48.317 7 ERROR oslo_messaging.rpc.server raise NotImplementedError()
2020-05-08 10:32:48.317 7 ERROR oslo_messaging.rpc.server NotImplementedError

References:

[1]: https://logserver.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset002-master/7611a6d/job-output.txt

[2]: https://logserver.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset002-master/7611a6d/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz

[3]: https://logserver.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset002-master/7611a6d/logs/undercloud/var/log/containers/nova/nova-compute.log.txt.gz

[4]: https://logserver.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset002-master/7611a6d/logs/undercloud/var/log/containers/heat/heat-engine.log.txt.gz

[chandan kumar (chkumar246)]

based on this https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-master&job_name=periodic-tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset002-master%09 the jobs were passing, the previous failure might be an infra hiccup.

I am closing this bug. If we still the issue, please reopen it again.