while continuously booting and deleting 10 vms, boot/delete fails randomly
Affects | Status | Importance | Assigned to | Milestone | ||
---|---|---|---|---|---|---|
Juniper Openstack | Status tracked in Trunk | |||||
R3.0 |
Won't Fix
|
High
|
Hampapur Ajay | |||
Trunk |
In Progress
|
High
|
Hampapur Ajay |
Bug Description
R3.0 2714 Ubuntu 14.04 Kilo multi-node setup
===========
while :
do
nova boot --nic net-id=
nova list | grep vn1-servers | awk '{print $2}' | xargs -L1 nova delete
done
2016-02-23 10:45:21.821 19882 ERROR nova.api.openstack [req-836c1e85-
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack Traceback (most recent call last):
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack return req.get_
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack application, catch_exc_
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack app_iter = application(
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack return resp(environ, start_response)
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack return self._call_app(env, start_response)
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack return self._app(env, _fake_start_
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack return resp(environ, start_response)
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack return resp(environ, start_response)
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack response = self.app(environ, start_response)
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack return resp(environ, start_response)
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack resp = self.call_func(req, *args, **self.kwargs)
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack return self.func(req, *args, **kwargs)
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack content_type, body, accept)
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack action_result = self.dispatch(meth, request, action_args)
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack return method(req=request, **action_args)
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack self._handle_
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack six.reraise(
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack check_server_
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack rv = f(*args, **kwargs)
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack check_server_
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack auto_disk_config, reservation_id, max_count)
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack requested_networks, max_count)
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack max_count)
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack ports = neutron.
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack ret = self.function(
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack **_params)
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack for r in self._paginatio
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack res = self.get(path, params=params)
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack headers=headers, params=params)
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack headers=headers, params=params)
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack self._handle_
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack exception_
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack File "/usr/lib/
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack status_
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack PortNotFoundClient: Port 01d6c6d6-
2016-02-23 10:45:21.821 19882 TRACE nova.api.openstack
2016-02-23 10:45:21.964 19882 INFO nova.api.openstack [req-836c1e85-
no longer affects: | juniperopenstack/r3.1 |
Corresponding nova-api log for delete :
2016-02-23 10:50:14.473 2792 ERROR nova.network. neutronv2. api [req-8441dee4- 9f0c-40a1- 84fa-8ade648caf d8 ba0a7bd4bede42e aaf3c4f4f47936d a3 6412d041dd49437 488453a7df596df f3 - - -] Unable to clear device ID for port 'None' neutronv2. api Traceback (most recent call last): neutronv2. api File "/usr/lib/ python2. 7/dist- packages/ nova/network/ neutronv2/ api.py" , line 366, in _unbind_ports neutronv2. api port_client. update_ port(port_ id, port_req_body) neutronv2. api File "/usr/lib/ python2. 7/dist- packages/ neutronclient/ v2_0/client. py", line 99, in with_params neutronv2. api ret = self.function( instance, *args, **kwargs) neutronv2. api File "/usr/lib/ python2. 7/dist- packages/ neutronclient/ v2_0/client. py", line 520, in update_port neutronv2. api return self.put( self.port_ path % (port), body=body) neutronv2. api File "/usr/lib/ python2. 7/dist- packages/ neutronclient/ v2_0/client. py", line 299, in put neutronv2. api headers=headers, params=params) neutronv2. api File "/usr/lib/ python2. 7/dist- packages/ neutronclient/ v2_0/client. py", line 267, in retry_request neutronv2. api headers=headers, params=params) neutronv2. api File "/usr/lib/ python2. 7/dist- packages/ neutronclient/ v2_0/client. py", line 208, in do_request neutronv2. api self._handle_ fault_response( status_ code, replybody) neutronv2. api File "/usr/lib/ python2. 7/dist- packages/ neutronclient/ v2_0/client. py", line 182, in _handle_ fault_response neutronv2. api exception_ handler_ v20(status_ code, des_error_body) neutronv2. api File "/usr/lib/ python2. 7/dist- packages/ neutronclient/ v2_0/client. py", line 80, in exception_ handler_ v20 neutronv2. api message=message) neutronv2. api NeutronClientEx ception: 404 Not Found neutronv2. api neutronv2. api The resource could not be found. neutronv2. api neutronv2. api neutronv2. api manager [req-b4f3e9a6- 479a-42b7- b5e8-242fabc959 d3 ba0a7bd4bede42e aaf3c4f4f47936d a3 6412d041dd49437 488453a7df596df f3 - - -] [instance: 3966ce8e- b294-42ba- 8b49-e2b0928b9f 73] Terminating instance
2016-02-23 10:50:14.473 2792 TRACE nova.network.
2016-02-23 10:50:14.473 2792 TRACE nova.network.
2016-02-23 10:50:14.473 2792 TRACE nova.network.
2016-02-23 10:50:14.473 2792 TRACE nova.network.
2016-02-23 10:50:14.473 2792 TRACE nova.network.
2016-02-23 10:50:14.473 2792 TRACE nova.network.
2016-02-23 10:50:14.473 2792 TRACE nova.network.
2016-02-23 10:50:14.473 2792 TRACE nova.network.
2016-02-23 10:50:14.473 2792 TRACE nova.network.
2016-02-23 10:50:14.473 2792 TRACE nova.network.
2016-02-23 10:50:14.473 2792 TRACE nova.network.
2016-02-23 10:50:14.473 2792 TRACE nova.network.
2016-02-23 10:50:14.473 2792 TRACE nova.network.
2016-02-23 10:50:14.473 2792 TRACE nova.network.
2016-02-23 10:50:14.473 2792 TRACE nova.network.
2016-02-23 10:50:14.473 2792 TRACE nova.network.
2016-02-23 10:50:14.473 2792 TRACE nova.network.
2016-02-23 10:50:14.473 2792 TRACE nova.network.
2016-02-23 10:50:14.473 2792 TRACE nova.network.
2016-02-23 10:50:14.473 2792 TRACE nova.network.
2016-02-23 10:50:14.473 2792 TRACE nova.network.
2016-02-23 10:50:14.473 2792 TRACE nova.network.
2016-02-23 10:50:14.473 2792 TRACE nova.network.
2016-02-23 10:50:14.806 2792 INFO nova.compute.
2016-02-23 10...