Launch an Instance failed due to Error in Network Setup

Bug #1590551 reported by jjosescu
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
quantum-gateway (Juju Charms Collection)
New
Undecided
Unassigned

Bug Description

I was doing OpenStack Juno installation. This is the error I encountered while launching an Instance. I have checked out for other log files. Everything seems working fine. Even I am facing some difficulty in terminating an Instance from the DashBoard. Eventhough it states as if "Success: Termination of Instance", dash board is not getting updated. I have crosschecked my configuration files many times. I don't think it's wrong. I am ready to upload my configuration files if you feel so.

17da2ad] Starting instance...
2016-06-08 13:24:55.319 5315 AUDIT nova.compute.claims [req-6487f0e0-f0d6-4823-9258-74a52b3f0ccb 41fe61a3933c4eec867acc7d2a637fd7 8bcaf4aeb644442884311b6396633883] [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] Attempting claim: memory 128 MB, disk 1 GB, VCPUs 1
2016-06-08 13:24:55.321 5315 AUDIT nova.compute.claims [req-6487f0e0-f0d6-4823-9258-74a52b3f0ccb 41fe61a3933c4eec867acc7d2a637fd7 8bcaf4aeb644442884311b6396633883] [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] Total memory: 1589 MB, used: 896.00 MB
2016-06-08 13:24:55.323 5315 AUDIT nova.compute.claims [req-6487f0e0-f0d6-4823-9258-74a52b3f0ccb 41fe61a3933c4eec867acc7d2a637fd7 8bcaf4aeb644442884311b6396633883] [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] memory limit: 2383.50 MB, free: 1487.50 MB
2016-06-08 13:24:55.325 5315 AUDIT nova.compute.claims [req-6487f0e0-f0d6-4823-9258-74a52b3f0ccb 41fe61a3933c4eec867acc7d2a637fd7 8bcaf4aeb644442884311b6396633883] [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] Total disk: 14 GB, used: 3.00 GB
2016-06-08 13:24:55.325 5315 AUDIT nova.compute.claims [req-6487f0e0-f0d6-4823-9258-74a52b3f0ccb 41fe61a3933c4eec867acc7d2a637fd7 8bcaf4aeb644442884311b6396633883] [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] disk limit not specified, defaulting to unlimited
2016-06-08 13:24:55.326 5315 AUDIT nova.compute.claims [req-6487f0e0-f0d6-4823-9258-74a52b3f0ccb 41fe61a3933c4eec867acc7d2a637fd7 8bcaf4aeb644442884311b6396633883] [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] Total CPUs: 1 VCPUs, used: 3.00 VCPUs
2016-06-08 13:24:55.326 5315 AUDIT nova.compute.claims [req-6487f0e0-f0d6-4823-9258-74a52b3f0ccb 41fe61a3933c4eec867acc7d2a637fd7 8bcaf4aeb644442884311b6396633883] [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] CPUs limit not specified, defaulting to unlimited
2016-06-08 13:24:55.327 5315 AUDIT nova.compute.claims [req-6487f0e0-f0d6-4823-9258-74a52b3f0ccb 41fe61a3933c4eec867acc7d2a637fd7 8bcaf4aeb644442884311b6396633883] [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] Claim successful
2016-06-08 13:24:55.853 5315 ERROR nova.compute.manager [-] Instance failed network setup after 1 attempt(s)
2016-06-08 13:24:55.853 5315 TRACE nova.compute.manager Traceback (most recent call last):
2016-06-08 13:24:55.853 5315 TRACE nova.compute.manager File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1587, in _allocate_network_async
2016-06-08 13:24:55.853 5315 TRACE nova.compute.manager dhcp_options=dhcp_options)
2016-06-08 13:24:55.853 5315 TRACE nova.compute.manager File "/usr/lib/python2.7/dist-packages/nova/network/neutronv2/api.py", line 260, in allocate_for_instance
2016-06-08 13:24:55.853 5315 TRACE nova.compute.manager net_ids)
2016-06-08 13:24:55.853 5315 TRACE nova.compute.manager File "/usr/lib/python2.7/dist-packages/nova/network/neutronv2/api.py", line 125, in _get_available_networks
2016-06-08 13:24:55.853 5315 TRACE nova.compute.manager nets = neutron.list_networks(**search_opts).get('networks', [])
2016-06-08 13:24:55.853 5315 TRACE nova.compute.manager File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 111, in with_params
2016-06-08 13:24:55.853 5315 TRACE nova.compute.manager ret = self.function(instance, *args, **kwargs)
2016-06-08 13:24:55.853 5315 TRACE nova.compute.manager File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 333, in list_networks
2016-06-08 13:24:55.853 5315 TRACE nova.compute.manager **_params)
2016-06-08 13:24:55.853 5315 TRACE nova.compute.manager File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1250, in list
2016-06-08 13:24:55.853 5315 TRACE nova.compute.manager for r in self._pagination(collection, path, **params):
2016-06-08 13:24:55.853 5315 TRACE nova.compute.manager File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1263, in _pagination
2016-06-08 13:24:55.853 5315 TRACE nova.compute.manager res = self.get(path, params=params)
2016-06-08 13:24:55.853 5315 TRACE nova.compute.manager File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1236, in get
2016-06-08 13:24:55.853 5315 TRACE nova.compute.manager headers=headers, params=params)
2016-06-08 13:24:55.853 5315 TRACE nova.compute.manager File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1228, in retry_request
2016-06-08 13:24:55.853 5315 TRACE nova.compute.manager raise exceptions.ConnectionFailed(reason=_("Maximum attempts reached"))
2016-06-08 13:24:55.853 5315 TRACE nova.compute.manager ConnectionFailed: Connection to neutron failed: Maximum attempts reached
2016-06-08 13:24:55.853 5315 TRACE nova.compute.manager
2016-06-08 13:24:56.297 5315 INFO nova.virt.libvirt.driver [req-6487f0e0-f0d6-4823-9258-74a52b3f0ccb 41fe61a3933c4eec867acc7d2a637fd7 8bcaf4aeb644442884311b6396633883] [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] Creating image
2016-06-08 13:24:56.863 5315 WARNING nova.virt.disk.vfs.guestfs [req-6487f0e0-f0d6-4823-9258-74a52b3f0ccb 41fe61a3933c4eec867acc7d2a637fd7 8bcaf4aeb644442884311b6396633883] Failed to close augeas aug_close: call launch before using this function
(in guestfish, don't forget to use the 'run' command)
2016-06-08 13:24:56.884 5315 ERROR nova.compute.manager [req-6487f0e0-f0d6-4823-9258-74a52b3f0ccb 41fe61a3933c4eec867acc7d2a637fd7 8bcaf4aeb644442884311b6396633883] [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] Instance failed to spawn
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] Traceback (most recent call last):
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1803, in _spawn
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] block_device_info)
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2370, in spawn
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] write_to_disk=True)
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3559, in to_xml
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] network_info_str = str(network_info)
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/nova/network/model.py", line 424, in __str__
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] return self._sync_wrapper(fn, *args, **kwargs)
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/nova/network/model.py", line 407, in _sync_wrapper
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] self.wait()
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/nova/network/model.py", line 439, in wait
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] self[:] = self._gt.wait()
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 168, in wait
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] return self._exit_event.wait()
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/eventlet/event.py", line 120, in wait
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] current.throw(*self._exc)
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 194, in main
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] result = function(*args, **kwargs)
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1587, in _allocate_network_async
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] dhcp_options=dhcp_options)
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/nova/network/neutronv2/api.py", line 260, in allocate_for_instance
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] net_ids)
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/nova/network/neutronv2/api.py", line 125, in _get_available_networks
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] nets = neutron.list_networks(**search_opts).get('networks', [])
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 111, in with_params
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] ret = self.function(instance, *args, **kwargs)
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 333, in list_networks
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] **_params)
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1250, in list
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] for r in self._pagination(collection, path, **params):
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1263, in _pagination
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] res = self.get(path, params=params)
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1236, in get
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] headers=headers, params=params)
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1228, in retry_request
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] raise exceptions.ConnectionFailed(reason=_("Maximum attempts reached"))
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] ConnectionFailed: Connection to neutron failed: Maximum attempts reached
2016-06-08 13:24:56.884 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad]
2016-06-08 13:24:57.013 5315 AUDIT nova.compute.manager [req-6487f0e0-f0d6-4823-9258-74a52b3f0ccb 41fe61a3933c4eec867acc7d2a637fd7 8bcaf4aeb644442884311b6396633883] [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] Terminating instance
2016-06-08 13:24:57.033 5315 ERROR nova.virt.libvirt.driver [-] [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] During wait destroy, instance disappeared.
2016-06-08 13:24:57.203 5315 INFO nova.virt.libvirt.driver [req-6487f0e0-f0d6-4823-9258-74a52b3f0ccb 41fe61a3933c4eec867acc7d2a637fd7 8bcaf4aeb644442884311b6396633883] [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] Deleting instance files /var/lib/nova/instances/542d1183-efe0-4dc6-b6d1-5260f17da2ad
2016-06-08 13:24:57.211 5315 INFO nova.virt.libvirt.driver [req-6487f0e0-f0d6-4823-9258-74a52b3f0ccb 41fe61a3933c4eec867acc7d2a637fd7 8bcaf4aeb644442884311b6396633883] [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] Deletion of /var/lib/nova/instances/542d1183-efe0-4dc6-b6d1-5260f17da2ad complete
2016-06-08 13:24:57.318 5315 ERROR nova.compute.manager [req-6487f0e0-f0d6-4823-9258-74a52b3f0ccb 41fe61a3933c4eec867acc7d2a637fd7 8bcaf4aeb644442884311b6396633883] [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] Failed to deallocate network for instance.
2016-06-08 13:24:57.424 5315 ERROR nova.compute.manager [req-6487f0e0-f0d6-4823-9258-74a52b3f0ccb 41fe61a3933c4eec867acc7d2a637fd7 8bcaf4aeb644442884311b6396633883] [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] Error: Connection to neutron failed: Maximum attempts reached
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] Traceback (most recent call last):
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1388, in _build_instance
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] set_access_ip=set_access_ip)
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 414, in decorated_function
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] return function(self, context, *args, **kwargs)
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1806, in _spawn
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] LOG.exception(_('Instance failed to spawn'), instance=instance)
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] six.reraise(self.type_, self.value, self.tb)
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1803, in _spawn
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] block_device_info)
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2370, in spawn
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] write_to_disk=True)
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3559, in to_xml
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] network_info_str = str(network_info)
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/nova/network/model.py", line 424, in __str__
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] return self._sync_wrapper(fn, *args, **kwargs)
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/nova/network/model.py", line 407, in _sync_wrapper
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] self.wait()
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/nova/network/model.py", line 439, in wait
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] self[:] = self._gt.wait()
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 168, in wait
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] return self._exit_event.wait()
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/eventlet/event.py", line 120, in wait
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] current.throw(*self._exc)
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 194, in main
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] result = function(*args, **kwargs)
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1587, in _allocate_network_async
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] dhcp_options=dhcp_options)
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/nova/network/neutronv2/api.py", line 260, in allocate_for_instance
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] net_ids)
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/nova/network/neutronv2/api.py", line 125, in _get_available_networks
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] nets = neutron.list_networks(**search_opts).get('networks', [])
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 111, in with_params
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] ret = self.function(instance, *args, **kwargs)
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 333, in list_networks
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] **_params)
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1250, in list
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] for r in self._pagination(collection, path, **params):
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1263, in _pagination
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] res = self.get(path, params=params)
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1236, in get
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] headers=headers, params=params)
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1228, in retry_request
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] raise exceptions.ConnectionFailed(reason=_("Maximum attempts reached"))
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad] ConnectionFailed: Connection to neutron failed: Maximum attempts reached
2016-06-08 13:24:57.424 5315 TRACE nova.compute.manager [instance: 542d1183-efe0-4dc6-b6d1-5260f17da2ad]
2016-06-08 13:24:57.923 5315 ERROR oslo.messaging.rpc.dispatcher [-] Exception during message handling: Connection to neutron failed: Maximum attempts reached
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last):
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher incoming.message))
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher return self._do_dispatch(endpoint, method, ctxt, args)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher result = getattr(endpoint, method)(ctxt, **new_args)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/server.py", line 139, in inner
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher return func(*args, **kwargs)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 88, in wrapped
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher payload)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 71, in wrapped
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher return f(self, context, *args, **kw)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 295, in decorated_function
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher LOG.warning(msg, e, instance_uuid=instance_uuid)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 272, in decorated_function
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher return function(self, context, *args, **kwargs)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 348, in decorated_function
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher function(self, context, *args, **kwargs)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 324, in decorated_function
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher e, sys.exc_info())
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 311, in decorated_function
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher return function(self, context, *args, **kwargs)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2187, in run_instance
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher do_run_instance()
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/openstack/common/lockutils.py", line 249, in inner
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher return f(*args, **kwargs)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2186, in do_run_instance
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher legacy_bdm_in_spec)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1284, in _run_instance
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher notify("error", fault=e) # notify that build failed
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1268, in _run_instance
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher instance, image_meta, legacy_bdm_in_spec)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1432, in _build_instance
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher filter_properties, bdms, legacy_bdm_in_spec)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1478, in _reschedule_or_error
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher self._log_original_error(exc_info, instance_uuid)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1473, in _reschedule_or_error
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher bdms, requested_networks)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2253, in _shutdown_instance
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher self._try_deallocate_network(context, instance, requested_networks)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2198, in _try_deallocate_network
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher self._set_instance_error_state(context, instance['uuid'])
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2193, in _try_deallocate_network
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher self._deallocate_network(context, instance, requested_networks)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1858, in _deallocate_network
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher context, instance, requested_networks=requested_networks)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/network/neutronv2/api.py", line 411, in deallocate_for_instance
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher data = neutron.list_ports(**search_opts)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 111, in with_params
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher ret = self.function(instance, *args, **kwargs)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 306, in list_ports
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher **_params)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1250, in list
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher for r in self._pagination(collection, path, **params):
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1263, in _pagination
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher res = self.get(path, params=params)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1236, in get
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher headers=headers, params=params)
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1228, in retry_request
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher raise exceptions.ConnectionFailed(reason=_("Maximum attempts reached"))
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher ConnectionFailed: Connection to neutron failed: Maximum attempts reached
2016-06-08 13:24:57.923 5315 TRACE oslo.messaging.rpc.dispatcher
2016-06-08 13:24:57.930 5315 ERROR oslo.messaging._drivers.common [-] Returning exception Connection to neutron failed: Maximum attempts reached to caller
2016-06-08 13:24:57.930 5315 ERROR oslo.messaging._drivers.common [-] ['Traceback (most recent call last):\n', ' File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply\n incoming.message))\n', ' File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch\n return self._do_dispatch(endpoint, method, ctxt, args)\n', ' File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch\n result = getattr(endpoint, method)(ctxt, **new_args)\n', ' File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/server.py", line 139, in inner\n return func(*args, **kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 88, in wrapped\n payload)\n', ' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__\n six.reraise(self.type_, self.value, self.tb)\n', ' File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 71, in wrapped\n return f(self, context, *args, **kw)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 295, in decorated_function\n LOG.warning(msg, e, instance_uuid=instance_uuid)\n', ' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__\n six.reraise(self.type_, self.value, self.tb)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 272, in decorated_function\n return function(self, context, *args, **kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 348, in decorated_function\n function(self, context, *args, **kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 324, in decorated_function\n e, sys.exc_info())\n', ' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__\n six.reraise(self.type_, self.value, self.tb)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 311, in decorated_function\n return function(self, context, *args, **kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2187, in run_instance\n do_run_instance()\n', ' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/lockutils.py", line 249, in inner\n return f(*args, **kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2186, in do_run_instance\n legacy_bdm_in_spec)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1284, in _run_instance\n notify("error", fault=e) # notify that build failed\n', ' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__\n six.reraise(self.type_, self.value, self.tb)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1268, in _run_instance\n instance, image_meta, legacy_bdm_in_spec)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1432, in _build_instance\n filter_properties, bdms, legacy_bdm_in_spec)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1478, in _reschedule_or_error\n self._log_original_error(exc_info, instance_uuid)\n', ' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__\n six.reraise(self.type_, self.value, self.tb)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1473, in _reschedule_or_error\n bdms, requested_networks)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2253, in _shutdown_instance\n self._try_deallocate_network(context, instance, requested_networks)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2198, in _try_deallocate_network\n self._set_instance_error_state(context, instance[\'uuid\'])\n', ' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__\n six.reraise(self.type_, self.value, self.tb)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2193, in _try_deallocate_network\n self._deallocate_network(context, instance, requested_networks)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1858, in _deallocate_network\n context, instance, requested_networks=requested_networks)\n', ' File "/usr/lib/python2.7/dist-packages/nova/network/neutronv2/api.py", line 411, in deallocate_for_instance\n data = neutron.list_ports(**search_opts)\n', ' File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 111, in with_params\n ret = self.function(instance, *args, **kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 306, in list_ports\n **_params)\n', ' File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1250, in list\n for r in self._pagination(collection, path, **params):\n', ' File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1263, in _pagination\n res = self.get(path, params=params)\n', ' File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1236, in get\n headers=headers, params=params)\n', ' File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1228, in retry_request\n raise exceptions.ConnectionFailed(reason=_("Maximum attempts reached"))\n', 'ConnectionFailed: Connection to neutron failed: Maximum attempts reached\n']

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.