nova compute doesn't work

Bug #1490326 reported by Steven Dake
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
kolla
Fix Released
Critical
Steven Dake

Bug Description

/sys:/sys needs a host bindmount:

2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde] Traceback (most recent call last):
2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2132, in _build_resources
2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde] yield resources
2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2002, in _build_and_run_instance
2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde] block_device_info=block_device_info)
2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2455, in spawn
2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde] block_device_info=block_device_info)
2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4529, in _create_domain_and_network
2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde] xml, pause=pause, power_on=power_on)
2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4459, in _create_domain
2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde] guest.launch(pause=pause)
2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/guest.py", line 141, in launch
2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde] self._encoded_xml, errors='ignore')
2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde] File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 195, in __exit__
2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde] six.reraise(self.type_, self.value, self.tb)
2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/guest.py", line 136, in launch
2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde] return self._domain.createWithFlags(flags)
2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde] File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 183, in doit
2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde] result = proxy_call(self._autowrap, f, *args, **kwargs)
2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde] File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 141, in proxy_call
2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde] rv = execute(f, *args, **kwargs)
2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde] File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 122, in execute
2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde] six.reraise(c, e, tb)
2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde] File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 80, in tworker
2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde] rv = meth(*args, **kwargs)
2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde] File "/usr/lib64/python2.7/site-packages/libvirt.py", line 996, in createWithFlags
2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde] if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self)
2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde] libvirtError: Unable to read from '/sys/fs/cgroup/cpuset/system.slice/docker-3dfde50ad0353202f3340a387a762b17efbdac14918d3a720e3df1af98c8d04d.scope/cpuset.cpus': No such file or directory
2015-08-30 18:54:16.984 1 ERROR nova.compute.manager [instance: e33c7ff8-c823-420b-b9fe-36ade0f1efde]

Steven Dake (sdake)
Changed in kolla:
status: New → Confirmed
importance: Undecided → Critical
assignee: nobody → Steven Dake (sdake)
milestone: none → liberty-3
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla (master)

Fix proposed to branch: master
Review: https://review.openstack.org/218683

Changed in kolla:
status: Confirmed → In Progress
Revision history for this message
Steven Dake (sdake) wrote :

To reproduce:
run init-runonce
run neutron net-list
run nova boot cirros --image cirros --flavor m1.small --nic net-id=f2430fd9-d519-4dff-a071-6e31f9d38dbd

where f243... is equivalent to the demo-net's net id.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla (master)

Reviewed: https://review.openstack.org/218683
Committed: https://git.openstack.org/cgit/stackforge/kolla/commit/?id=e2d35ad054be6cfa395b04616c543e48d98e7e57
Submitter: Jenkins
Branch: master

commit e2d35ad054be6cfa395b04616c543e48d98e7e57
Author: Steven Dake <email address hidden>
Date: Sun Aug 30 12:46:30 2015 -0700

    nova-libvirt requires a /sys/fs/cgroup bindmount

    Nova-compute is curerntly generating a backtrace when trying to nova
    boot a VM. The backtrace is described in the bug log. Bind-mounting
    /sys/fs/cgroup:/sys/fs/cgroup in the libvirt container resolves the
    problem.

    Change-Id: I5a56b61fd260728fb76e19bcbdf403b80a4ec5a6
    Closes-Bug: #1490326

Changed in kolla:
status: In Progress → Fix Committed
Sam Yaple (s8m)
Changed in kolla:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.