Rally test boot_and_delete_server_with_secgroups fails
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
OpenStack Compute (nova) |
Fix Released
|
Low
|
Radoslav Gerganov | ||
Queens |
Fix Committed
|
Low
|
Radoslav Gerganov |
Bug Description
When running rally scenarios the test fails with PortNotFoundClient exception.
From the logs we see the following:
Failure:
-------
▼ 11 GetResourceFailure Failed to get the resource <Server: s_rally_
Traceback (most recent call last):
File "/usr/local/
getattr(
File "/usr/local/
self.
File "/usr/local/
check_
File "/usr/local/
resource = update_
File "/usr/local/
raise exceptions.
GetResourceFailure: Failed to get the resource <Server: s_rally_
Neutron:
-------
port-creation:
2018-04-22 09:18:31.984 32139 DEBUG vmware_
.
.
2018-04-22 09:18:32.278 32139 INFO neutron.wsgi [req-7f2bece2-
port-deletion:
2018-04-22 09:18:55.552 32135 INFO neutron.wsgi [req-774309da-
Nova:
----
2018-04-22 09:18:55.539 19221 DEBUG oslo_concurrenc
ired by "nova.context.
2018-04-22 09:18:55.541 19221 DEBUG oslo_concurrenc
ased by "nova.context.
2018-04-22 09:18:55.662 19221 DEBUG nova.policy [req-824643af-
ailed with credentials {'service_roles': [], 'user_id': u'8d478ca1fa274
ce_project_
2018-04-22 09:18:55.774 19225 DEBUG neutronclient.
1954b052-
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack [req-a9471015-
could not be found.
Neutron server returns request_ids: ['req-35436010-
Neutron server returns request_ids: ['req-35436010-
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack Traceback (most recent call last):
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack return req.get_
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack application, catch_exc_
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack app_iter = application(
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack resp = self.call_func(req, *args, **self.kwargs)
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack return self.func(req, *args, **kwargs)
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack self._log_req(req, res, start)
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack self.force_
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack six.reraise(
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack res = req.get_
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack application, catch_exc_
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack app_iter = application(
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack return resp(environ, start_response)
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack resp = self.call_func(req, *args, **self.kwargs)
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack return self.func(req, *args, **kwargs)
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack return request.
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack application, catch_exc_
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack app_iter = application(
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack resp = self.call_func(req, *args, **self.kwargs)
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack return self.func(req, *args, **kwargs)
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack response = req.get_
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack application, catch_exc_
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack app_iter = application(
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack return resp(environ, start_response)
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack return resp(environ, start_response)
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack response = self.app(environ, start_response)
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack return resp(environ, start_response)
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack resp = self.call_func(req, *args, **self.kwargs)
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack return self.func(req, *args, **kwargs)
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack content_type, body, accept)
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack request, action_args)
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack **action_args)
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack return self._show(req, resp_obj)
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack self._extend_
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack servers))
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack ports = self._get_
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack ports.extend(
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack ret = obj(*args, **kwargs)
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack **_params)
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack ret = obj(*args, **kwargs)
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack for r in self._paginatio
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack res = self.get(path, params=params)
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack ret = obj(*args, **kwargs)
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack headers=headers, params=params)
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack ret = obj(*args, **kwargs)
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack headers=headers, params=params)
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack ret = obj(*args, **kwargs)
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack self._handle_
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack ret = obj(*args, **kwargs)
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack exception_
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack File "/usr/lib/
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack request_
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack PortNotFoundClient: Port 1954b052-
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack Neutron server returns request_ids: ['req-35436010-
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack
2018-04-22 09:18:55.819 19225 INFO nova.api.openstack [req-a9471015-
2018-04-22 09:18:55.822 19225 DEBUG nova.api.
At a deeper looks we see:
After looking more into the logs and the flow, here are the relevant log lines that explain the issue, and indicate this is an exception not being handled in Nova (see here https:/
Port ID: 1954b052-
Nova instance UUID: 3e714b48-
Neutron logs
=============
Port deletion:
2018-04-22 09:18:55.552 32135 INFO neutron.wsgi [req-774309da-
GET ports failure:
2018-04-22 09:18:55.770 31303 INFO neutron.wsgi [req-35436010-
Nova log
========
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack PortNotFoundClient: Port 1954b052-
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack Neutron server returns request_ids: ['req-35436010-
2018-04-22 09:18:55.778 19225 ERROR nova.api.openstack
2018-04-22 09:18:55.819 19225 INFO nova.api.openstack [req-a9471015-
If there is a exception in self._get_
The problem is discovered in stable queens
Changed in nova: | |
importance: | Undecided → Low |
tags: | added: api neutron |
tags: | added: queens-backport-potential |
Fix proposed to branch: master /review. openstack. org/565183
Review: https:/