Instances stuck in spawning state due to Nova logging deadlock

Bug #1279296 reported by Anastasiia Naboikina
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Triaged
High
Roman Vyalov

Bug Description

Steps to reproduce:
1. Install Fuel iso on kvm.
2. Create new cluster with the following configuration:
- centos multinode;
- nova-network flat;
- enable ceph for volumes;
- enable ceph for ephemeral storage;
3. Add the following nodes:
- controller;
- compute + ceph;
- compute + ceph;
4. Deploy cluster - wait until deployment is successful;
5. Check all services are running;
6. Go to Horizon;
7. Create new instance

Expected result:
Instance is created and is in active state;

Actual result:
Instance goes to spawning state which never ends;
The longest time it was in spawning state was 20 hours and spawning was not interrupted by timeout. Instance got stuck into this state right after getting network on compute.
In fact instance was not created at all - it couldn`t receive network. virsh list --all on compute-node where instance should`ve been located shows no vms at all. virsh net-list --all shows only default network which is inactive.

The following errors found in libvirt logs on compute:
2014-02-11 13:51:34.828+0000: 16498: info : libvirt version: 0.10.2, package: 19.el6 (Unknown, 2013-10-31-17:11:50, obs-worker-6.osci.lan)
2014-02-11 13:51:34.828+0000: 16498: error : virNetDevBridgeCreate:224 : Unable to create bridge virbr0: File exists
2014-02-11 13:51:34.898+0000: 16498: error : virNWFilterSnoopLeaseFileRefresh:1903 : open("/var/run/libvirt/network/nwfilter.ltmp"): No such file or directory
2014-02-11 13:51:34.963+0000: 16498: warning : virSecurityManagerNew:148 : Configured security driver "none" disables default policy to create confined guests
2014-02-11 14:06:32.882+0000: 16486: error : virNetSocketReadWire:1184 : End of file while reading data: Input/output error

Reproduced on iso 108, iso fuel-stop_reset_ui_11.iso, iso fuel-stop_reset_ui_friday.iso.

Tags: iso library
Revision history for this message
Anastasiia Naboikina (anaboikina) wrote :
Revision history for this message
Vladimir Kuklin (vkuklin) wrote :

This bug is actually a duplicate of https://bugs.launchpad.net/nova/+bug/1276268 . Ticket for cherry-pick created for OSCI team https://mirantis.jira.com/browse/OSCI-1071

summary: - Instances stuck in spawning state due to libvirt invalid networks
- configuration
+ Instances stuck in spawning state due to Nova logging deadlock
Revision history for this message
Mike Scherbakov (mihgen) wrote :

Patch was accepted to stable/havana. Roman - waiting for you to update package then, please set to Fix Committed once mirrors are updated.

Changed in fuel:
status: New → Triaged
assignee: nobody → Roman Vyalov (r0mikiam)
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.