kolla-ansible

nova compute fails in kolla-kubernetes when placement is configured

Bug #1663961 reported by Serguei Bezverkhi
10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
kolla-ansible
Fix Released
Critical
Steven Dake
kolla-ansible ocata-rc1 "rc1"

Bug Description

In kolla kubebrbetes with 3.0.2 images nova compute fails when placement is configured.

2017-02-11 15:22:55.142 7 ERROR nova.compute.manager [req-af520302-3881-4ef3-862a-82632bd40375 - - - - -] Error updating resources for node centos-7-2-node-osic-cloud1-s3500-7240623-421494.
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager Traceback (most recent call last):
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 6412, in update_available_resource_for_node
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager rt.update_available_resource(context)
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 524, in update_available_resource
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager self._update_available_resource(context, resources)
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 271, in inner
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager return f(*args, **kwargs)
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 548, in _update_available_resource
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager self._init_compute_node(context, resources)
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 420, in _init_compute_node
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager self.scheduler_client.update_resource_stats(self.compute_node)
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/scheduler/client/__init__.py", line 60, in update_resource_stats
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager self.reportclient.update_resource_stats(compute_node)
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/scheduler/client/__init__.py", line 37, in __run_method
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager return getattr(self.instance, __name)(*args, **kwargs)
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/scheduler/client/report.py", line 343, in update_resource_stats
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager compute_node.hypervisor_hostname)
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/scheduler/client/report.py", line 205, in _ensure_resource_provider
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager rp = self._get_resource_provider(uuid)
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/scheduler/client/report.py", line 44, in wrapper
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager return f(self, *a, **k)
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/scheduler/client/report.py", line 118, in _get_resource_provider
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager resp = self.get("/resource_providers/%s" % uuid)
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/scheduler/client/report.py", line 83, in get
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager endpoint_filter=self.ks_filter, raise_exc=False)
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 673, in get
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager return self.request(url, 'GET', **kwargs)
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/positional/__init__.py", line 101, in inner
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager return wrapped(*args, **kwargs)
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 462, in request
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager auth_headers = self.get_auth_headers(auth)
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 733, in get_auth_headers
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager return auth.get_headers(self, **kwargs)
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/keystoneauth1/plugin.py", line 90, in get_headers
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager token = self.get_token(session)
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/base.py", line 90, in get_token
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager return self.get_access(session).auth_token
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/base.py", line 136, in get_access
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager self.auth_ref = self.get_auth_ref(session)
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/generic/base.py", line 181, in get_auth_ref
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager return self._plugin.get_auth_ref(session, **kwargs)
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/v3/base.py", line 167, in get_auth_ref
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager authenticated=False, log=False, **rkwargs)
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 681, in post
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager return self.request(url, 'POST', **kwargs)
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/positional/__init__.py", line 101, in inner
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager return wrapped(*args, **kwargs)
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 570, in request
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager raise exceptions.from_response(resp, method, url)
2017-02-11 15:22:55.142 7 ERROR nova.compute.manager Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-6665bcb9-54c0-4f34-a6b1-acd92a6f44a7)

Revision history for this message
Steven Dake (sdake) wrote :

gate jobs of kolla-kubernetes without the placement api settings:
https://review.openstack.org/#/c/432721/

All should be green.

Changed in kolla-ansible:
status: New → Confirmed
importance: Undecided → Critical
milestone: none → ocata-rc1
assignee: nobody → Steven Dake (sdake)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla-ansible (master)

Fix proposed to branch: master
Review: https://review.openstack.org/432725

Changed in kolla-ansible:
status: Confirmed → In Progress
Steven Dake (sdake)
summary: - nova compute fails when placement is configured
+ nova compute fails in kolla-kubernetes when placement is configured
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla-ansible (master)

Reviewed: https://review.openstack.org/432725
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=6cb4507267e0a368a69c0ba1d02a6e16301ddf43
Submitter: Jenkins
Branch: master

commit 6cb4507267e0a368a69c0ba1d02a6e16301ddf43
Author: Steven Dake <email address hidden>
Date: Sat Feb 11 23:28:35 2017 -0700

    Fixes problem with kolla-kubernetes 3.0.2 images

    The kolla-kubernetes deliverable uses Newton images, however,
    the kolla-ansible 4.0.0 deliverable is targeted at Ocata. In
    Ocata, nova requires the placement API implementation. This
    change is transitory until genconfig is no longer required
    for kolla-kubernetes to operate.

    Change-Id: I1c192a01d91b4f507bafadb53b6abb1efdcdb46c
    Closes-Bug: #1663961

Changed in kolla-ansible:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla-ansible 4.0.0.0rc1

This issue was fixed in the openstack/kolla-ansible 4.0.0.0rc1 release candidate.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.