Nova boot from volume functionallity stop working

Bug #1411525 reported by Boris Pavlovic
14
This bug affects 2 people
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
Fix Released
Undecided
Boris Pavlovic
Rally
Fix Released
Critical
Boris Pavlovic

Bug Description

Rally benchmarks related to booting from volume functionality stopped working.

Like:
NovaServers.boot_server_from_volume

We are getting such errors:

Resource <Server: rally_novaserver_fygmxtgijxuuxtmc> has ERROR status: No valid host was found. There are not enough hosts available.

All patches in Rally are facing it. For example this one: https://review.openstack.org/#/c/147394/

description: updated
Changed in rally:
status: New → Triaged
importance: Undecided → Critical
description: updated
Changed in nova:
assignee: nobody → Boris Pavlovic (boris-42)
status: New → In Progress
Revision history for this message
Boris Pavlovic (boris-42) wrote :

Patch that reverts change that introduce this bug:

https://review.openstack.org/#/c/147751/

Changed in rally:
assignee: nobody → Boris Pavlovic (boris-42)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to rally (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/147769

Revision history for this message
John Garbutt (johngarbutt) wrote :

This seems to turn up in the logs:

2015-01-15 22:27:03.301 25240 ERROR nova.compute.manager [-] [instance: b7c0d211-c6d8-45d1-b720-dcfe6806f320] Instance failed to spawn
2015-01-15 22:27:03.301 25240 TRACE nova.compute.manager [instance: b7c0d211-c6d8-45d1-b720-dcfe6806f320] Traceback (most recent call last):
2015-01-15 22:27:03.301 25240 TRACE nova.compute.manager [instance: b7c0d211-c6d8-45d1-b720-dcfe6806f320] File "/opt/stack/new/nova/nova/compute/manager.py", line 2290, in _build_resources
2015-01-15 22:27:03.301 25240 TRACE nova.compute.manager [instance: b7c0d211-c6d8-45d1-b720-dcfe6806f320] yield resources
2015-01-15 22:27:03.301 25240 TRACE nova.compute.manager [instance: b7c0d211-c6d8-45d1-b720-dcfe6806f320] File "/opt/stack/new/nova/nova/compute/manager.py", line 2160, in _build_and_run_instance
2015-01-15 22:27:03.301 25240 TRACE nova.compute.manager [instance: b7c0d211-c6d8-45d1-b720-dcfe6806f320] flavor=flavor)
2015-01-15 22:27:03.301 25240 TRACE nova.compute.manager [instance: b7c0d211-c6d8-45d1-b720-dcfe6806f320] File "/opt/stack/new/nova/nova/virt/libvirt/driver.py", line 2396, in spawn
2015-01-15 22:27:03.301 25240 TRACE nova.compute.manager [instance: b7c0d211-c6d8-45d1-b720-dcfe6806f320] flavor=flavor)
2015-01-15 22:27:03.301 25240 TRACE nova.compute.manager [instance: b7c0d211-c6d8-45d1-b720-dcfe6806f320] File "/opt/stack/new/nova/nova/virt/libvirt/driver.py", line 4086, in _get_guest_xml
2015-01-15 22:27:03.301 25240 TRACE nova.compute.manager [instance: b7c0d211-c6d8-45d1-b720-dcfe6806f320] context, flavor=flavor)
2015-01-15 22:27:03.301 25240 TRACE nova.compute.manager [instance: b7c0d211-c6d8-45d1-b720-dcfe6806f320] File "/opt/stack/new/nova/nova/virt/libvirt/driver.py", line 3935, in _get_guest_config
2015-01-15 22:27:03.301 25240 TRACE nova.compute.manager [instance: b7c0d211-c6d8-45d1-b720-dcfe6806f320] flavor)
2015-01-15 22:27:03.301 25240 TRACE nova.compute.manager [instance: b7c0d211-c6d8-45d1-b720-dcfe6806f320] File "/opt/stack/new/nova/nova/virt/libvirt/driver.py", line 3271, in _get_guest_storage_config
2015-01-15 22:27:03.301 25240 TRACE nova.compute.manager [instance: b7c0d211-c6d8-45d1-b720-dcfe6806f320] vol.save(nova_context.get_admin_context())
2015-01-15 22:27:03.301 25240 TRACE nova.compute.manager [instance: b7c0d211-c6d8-45d1-b720-dcfe6806f320] TypeError: save() takes exactly 1 argument (2 given)
2015-01-15 22:27:03.301 25240 TRACE nova.compute.manager [instance: b7c0d211-c6d8-45d1-b720-dcfe6806f320]

Revision history for this message
John Garbutt (johngarbutt) wrote :
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to rally (master)

Reviewed: https://review.openstack.org/147769
Committed: https://git.openstack.org/cgit/stackforge/rally/commit/?id=abd734ab65b4ef01a4139dbd8eae22167d61d428
Submitter: Jenkins
Branch: master

commit abd734ab65b4ef01a4139dbd8eae22167d61d428
Author: Boris Pavlovic <email address hidden>
Date: Fri Jan 16 10:21:43 2015 +0300

    Unblock Rally gates cause by nova bug 1411525

    Remove SLA checks from failing benchmarks

    Change-Id: I81ad3bb01db59fb3ecf5ee855c9ca22bb6d34bc3
    Related-Bug: #1411525

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to nova (master)

Reviewed: https://review.openstack.org/147751
Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=3111d4558cc5c0709591ebd9c6ed49a162b4f510
Submitter: Jenkins
Branch: master

commit 3111d4558cc5c0709591ebd9c6ed49a162b4f510
Author: Boris Pavlovic <email address hidden>
Date: Fri Jan 16 08:34:34 2015 +0300

    Revert "initialize objects with context in block device"

    This breaks nova boot VM from functionallity

    As well it breaks Rally gates so I think it is critical cause
    it is blocking work on Rally.

    As well this was not tested by tempest. Cause this is disabled
    in gates

    This reverts commit 570c98cb9e9e7327477d92c52bfdc0a28ab7f88e.

    Closes-bug: #1411525
    Change-Id: I5ecc165621c803726c1c8bbcd69a12d84e6a05a2

Changed in nova:
status: In Progress → Fix Committed
Changed in rally:
status: Triaged → Fix Released
Thierry Carrez (ttx)
Changed in nova:
milestone: none → kilo-2
status: Fix Committed → Fix Released
Thierry Carrez (ttx)
Changed in nova:
milestone: kilo-2 → 2015.1.0
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.