lxd driver broken due to upstream changes in nova

Bug #1716411 reported by Logan V
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack-Ansible
Fix Released
High
Jean-Philippe Evrard
nova-lxd
Fix Committed
Undecided
Unassigned

Bug Description

In openstack-ansible we began seeing failures on our nova-lxd test due to: http://logs.openstack.org/75/500575/2/check/gate-openstack-ansible-os_nova-ansible-func_lxd-ubuntu-xenial/605dfde/logs/host/nova/nova-compute.log.txt.gz#_2017-09-08_23_17_17_074 several days ago. It seems like the 'max_mem_kb' along with several other attributes were removed here https://review.openstack.org/#/c/471146/ which has broken the lxd driver.

Tags: uosci
Revision history for this message
Logan V (loganv) wrote :
Download full text (3.3 KiB)

The full error from nova-compute:

2017-09-08 23:17:17.049 3076 INFO nova.compute.manager [req-6b68864b-5c95-486f-bb34-8b622248b540 c2309143b5b149fbaf4982c3ef164ffc b6117674a71049a98abd8133409db57f - default default] [instance: a9548264-c743-4abb-a739-c5aa372472ee] Took 13.36 seconds to spawn the instance on the hypervisor.
2017-09-08 23:17:17.050 3076 DEBUG nova.compute.manager [req-6b68864b-5c95-486f-bb34-8b622248b540 c2309143b5b149fbaf4982c3ef164ffc b6117674a71049a98abd8133409db57f - default default] [instance: a9548264-c743-4abb-a739-c5aa372472ee] Checking state _get_power_state /openstack/venvs/nova-testing/local/lib/python2.7/site-packages/nova/compute/manager.py:1160
2017-09-08 23:17:17.074 3076 ERROR nova.compute.manager [req-6b68864b-5c95-486f-bb34-8b622248b540 c2309143b5b149fbaf4982c3ef164ffc b6117674a71049a98abd8133409db57f - default default] [instance: a9548264-c743-4abb-a739-c5aa372472ee] Unexpected build failure, not rescheduling build.: TypeError: __init__() got an unexpected keyword argument 'max_mem_kb'
2017-09-08 23:17:17.074 3076 ERROR nova.compute.manager [instance: a9548264-c743-4abb-a739-c5aa372472ee] Traceback (most recent call last):
2017-09-08 23:17:17.074 3076 ERROR nova.compute.manager [instance: a9548264-c743-4abb-a739-c5aa372472ee] File "/openstack/venvs/nova-testing/local/lib/python2.7/site-packages/nova/compute/manager.py", line 1826, in _do_build_and_run_instance
2017-09-08 23:17:17.074 3076 ERROR nova.compute.manager [instance: a9548264-c743-4abb-a739-c5aa372472ee] filter_properties)
2017-09-08 23:17:17.074 3076 ERROR nova.compute.manager [instance: a9548264-c743-4abb-a739-c5aa372472ee] File "/openstack/venvs/nova-testing/local/lib/python2.7/site-packages/nova/compute/manager.py", line 2077, in _build_and_run_instance
2017-09-08 23:17:17.074 3076 ERROR nova.compute.manager [instance: a9548264-c743-4abb-a739-c5aa372472ee] self._update_instance_after_spawn(context, instance)
2017-09-08 23:17:17.074 3076 ERROR nova.compute.manager [instance: a9548264-c743-4abb-a739-c5aa372472ee] File "/openstack/venvs/nova-testing/local/lib/python2.7/site-packages/nova/compute/manager.py", line 1589, in _update_instance_after_spawn
2017-09-08 23:17:17.074 3076 ERROR nova.compute.manager [instance: a9548264-c743-4abb-a739-c5aa372472ee] instance.power_state = self._get_power_state(context, instance)
2017-09-08 23:17:17.074 3076 ERROR nova.compute.manager [instance: a9548264-c743-4abb-a739-c5aa372472ee] File "/openstack/venvs/nova-testing/local/lib/python2.7/site-packages/nova/compute/manager.py", line 1162, in _get_power_state
2017-09-08 23:17:17.074 3076 ERROR nova.compute.manager [instance: a9548264-c743-4abb-a739-c5aa372472ee] return self.driver.get_info(instance).state
2017-09-08 23:17:17.074 3076 ERROR nova.compute.manager [instance: a9548264-c743-4abb-a739-c5aa372472ee] File "/openstack/venvs/nova-testing/local/lib/python2.7/site-packages/nova/virt/lxd/driver.py", line 476, in get_info
2017-09-08 23:17:17.074 3076 ERROR nova.compute.manager [instance: a9548264-c743-4abb-a739-c5aa372472ee] cpu_time_ns=0)
2017-09-08 23:17:17.074 3076 ERROR nova.compute.manager [instance: a9548264-c743-4abb-a739-c5a...

Read more...

Ryan Beisner (1chb1n)
tags: added: uosci
Revision history for this message
Logan V (loganv) wrote :
Revision history for this message
Jean-Philippe Evrard (jean-philippe-evrard) wrote :

See also: https://bugs.launchpad.net/openstack-ansible/+bug/1720535

We need to bump the nova-lxd sha and those rootwrap files.

Changed in openstack-ansible:
status: New → Confirmed
importance: Undecided → High
assignee: nobody → Jean-Philippe Evrard (jean-philippe-evrard)
Changed in nova-lxd:
status: New → Fix Committed
Changed in openstack-ansible:
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to openstack-ansible-os_nova (master)

Reviewed: https://review.openstack.org/512044
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_nova/commit/?id=b21acaf0c89379e020be8dc30d87d397889e16f7
Submitter: Zuul
Branch: master

commit b21acaf0c89379e020be8dc30d87d397889e16f7
Author: Jean-Philippe Evrard <email address hidden>
Date: Sat Oct 14 21:46:11 2017 +0100

    Update paste, policy and rootwrap configurations 2017-10-14

    This also updated the nova-lxd filters.

    Change-Id: I9674b3c159adf4a8caa39a98d9d6090a6e2ce754
    Closes-Bug: #1716411

Changed in openstack-ansible:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/openstack-ansible-os_nova 17.0.0.0b2

This issue was fixed in the openstack/openstack-ansible-os_nova 17.0.0.0b2 development milestone.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.