Comment 7 for bug 1767076

Revision history for this message
yatin (yatinkarel) wrote :

Failed again:- https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-pike-upload/165/

<<< Nova devs have taken a look at this. nova-compute cannot create a resource provider in placement API, <<< which suggests a network or keystone issue is the root cause.

Looking at the logs it seems when nova tries to register resource provider, keystone is down as httpd is restarting that time:-
nova:- https://logs.rdoproject.org/openstack-periodic-24hr/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-pike-upload/7dadafb/overcloud-novacompute-0/var/log/nova/nova-compute.log.txt.gz#_2018-04-25_05_40_03_852

Apache Starting:- https://logs.rdoproject.org/openstack-periodic-24hr/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-pike-upload/7dadafb/overcloud-controller-0/var/log/journal.txt.gz#_Apr_25_05_39_49

Apache Started:- https://logs.rdoproject.org/openstack-periodic-24hr/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-pike-upload/7dadafb/overcloud-controller-0/var/log/journal.txt.gz#_Apr_25_05_40_15

The apache start request is by gnocchi. So need to find why this started happening recently.

@owalsh, Also isn't there a retry mechanism in nova to register placement resource? How many time it tries and what's the timeout for this try?
Workaround can be:- restarting nova-compute or starting nova-compute when keystone/apache is responding.