Unable to Spawn Instances Using Grizzly Packages

[Daneyon Hansen]

My Compute Nodes (running COE) are unable to spawn Instances:

2013-05-03 01:15:48.171 ERROR nova.compute.manager [req-86151cbd-84dd-43ac-9381-a1efff0af554 260b0776c38248b585d69d3350f0788f 049b3030e36b41bc84f36445c1ff2104] [instance: c1141185-cec3-4b5a-a881-83ec775edf77] Error: ['Traceback (most recent call last):\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 834, in _run_instance\n set_access_ip=set_access_ip)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1093, in _spawn\n LOG.exception(_(\'Instance failed to spawn\'), instance=instance)\n', ' File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__\n self.gen.next()\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1089, in _spawn\n block_device_info)\n', ' File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 1520, in spawn\n block_device_info)\n', ' File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2435, in _create_domain_and_network\n domain = self._create_domain(xml, instance=instance)\n', ' File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2396, in _create_domain\n domain.createWithFlags(launch_flags)\n', ' File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 187, in doit\n result = proxy_call(self._autowrap, f, *args, **kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 147, in proxy_call\n rv = execute(f,*args,**kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 76, in tworker\n rv = meth(*args,**kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/libvirt.py", line 581, in createWithFlags\n if ret == -1: raise libvirtError (\'virDomainCreateWithFlags() failed\', dom=self)\n', 'libvirtError: Unable to read from monitor: Connection reset by peer\n']

[Daneyon Hansen (danehans)]

Note: This is when I moved Control Nodes to upstream and had Compute Nodes running COE Grizzly.

[Daneyon Hansen (danehans)]

Here are the results when trying to spawn instances when Compute and Control Nodes are running COE Grizzly:

2013-05-02 18:37:30.790 11574 INFO nova.service [-] Child 11909 exited with status 2
2013-05-02 18:37:30.793 11574 INFO nova.service [-] Started child 11910
2013-05-02 18:37:30.797 11910 ERROR nova.service [-] Unhandled exception
2013-05-02 18:37:30.797 11910 TRACE nova.service Traceback (most recent call last):
2013-05-02 18:37:30.797 11910 TRACE nova.service File "/usr/lib/python2.7/dist-packages/nova/service.py", line 307, in _start_child
2013-05-02 18:37:30.797 11910 TRACE nova.service self._child_process(wrap.server)
2013-05-02 18:37:30.797 11910 TRACE nova.service File "/usr/lib/python2.7/dist-packages/nova/service.py", line 284, in _child_process
2013-05-02 18:37:30.797 11910 TRACE nova.service launcher.run_server(server)
2013-05-02 18:37:30.797 11910 TRACE nova.service File "/usr/lib/python2.7/dist-packages/nova/service.py", line 148, in run_server
2013-05-02 18:37:30.797 11910 TRACE nova.service server.wait()
2013-05-02 18:37:30.797 11910 TRACE nova.service File "/usr/lib/python2.7/dist-packages/nova/service.py", line 666, in wait
2013-05-02 18:37:30.797 11910 TRACE nova.service self.server.wait()
2013-05-02 18:37:30.797 11910 TRACE nova.service File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 223, in wait
2013-05-02 18:37:30.797 11910 TRACE nova.service self._server.wait()
2013-05-02 18:37:30.797 11910 TRACE nova.service File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 166, in wait
2013-05-02 18:37:30.797 11910 TRACE nova.service return self._exit_event.wait()
2013-05-02 18:37:30.797 11910 TRACE nova.service File "/usr/lib/python2.7/dist-packages/eventlet/event.py", line 116, in wait
2013-05-02 18:37:30.797 11910 TRACE nova.service return hubs.get_hub().switch()
2013-05-02 18:37:30.797 11910 TRACE nova.service File "/usr/lib/python2.7/dist-packages/eventlet/hubs/hub.py", line 177, in switch
2013-05-02 18:37:30.797 11910 TRACE nova.service return self.greenlet.switch()
2013-05-02 18:37:30.797 11910 TRACE nova.service File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 192, in main
2013-05-02 18:37:30.797 11910 TRACE nova.service result = function(*args, **kwargs)
2013-05-02 18:37:30.797 11910 TRACE nova.service TypeError: server() got an unexpected keyword argument 'url_length_limit'
2013-05-02 18:37:30.797 11910 TRACE nova.service
2013-05-02 18:37:30.800 11910 INFO nova.wsgi [-] Stopping WSGI server.

root@control01:~# nova boot --image cirros --flavor m1.tiny --nic net-id=434273dd-bbac-4186-ba4e-fff4f435f924 c3
+-------------------------------------+--------------------------------------+
| Property | Value |
+-------------------------------------+--------------------------------------+
| OS-EXT-STS:task_state | scheduling |
| image | cirros |
| OS-EXT-STS:vm_state | building |
| OS-EXT-SRV-ATTR:instance_name | instanc...

[Mark T. Voelker (mvoelker)]

We've had a couple of folks able to spin up instances now, so this may have gone away with some of the other changes that have been merged of late. We'll test shortly to find out.

[Mark T. Voelker (mvoelker)]

This has been dealt with in subsequent versions of the packages...we have various folks spinning up instances fine now.