Intermittent failure in n-api connecting to neutron to list ports after TLS was enabled in CI
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
devstack |
Fix Released
|
Medium
|
Unassigned |
Bug Description
Seen here:
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack [req-c1bbc78f-
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack Traceback (most recent call last):
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/opt/stack/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack return req.get_
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/usr/local/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack application, catch_exc_
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/usr/local/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack app_iter = application(
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/usr/local/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack return resp(environ, start_response)
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/usr/local/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack resp = self.call_func(req, *args, **self.kwargs)
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/usr/local/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack return self.func(req, *args, **kwargs)
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/usr/local/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack response = req.get_
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/usr/local/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack application, catch_exc_
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/usr/local/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack app_iter = application(
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/usr/local/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack return resp(environ, start_response)
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/usr/local/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack return resp(environ, start_response)
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/usr/local/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack response = self.app(environ, start_response)
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/usr/local/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack return resp(environ, start_response)
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/usr/local/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack resp = self.call_func(req, *args, **self.kwargs)
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/usr/local/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack return self.func(req, *args, **kwargs)
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/opt/stack/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack content_type, body, accept)
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/opt/stack/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack request, action_args)
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/opt/stack/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack **action_args)
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/opt/stack/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack return self._show(req, resp_obj)
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/opt/stack/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack self._extend_
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/opt/stack/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack servers))
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/opt/stack/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack ports = self._get_
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/opt/stack/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack ports.extend(
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/opt/stack/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack ret = obj(*args, **kwargs)
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/usr/local/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack **_params)
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/opt/stack/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack ret = obj(*args, **kwargs)
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/usr/local/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack for r in self._paginatio
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/usr/local/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack res = self.get(path, params=params)
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/opt/stack/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack ret = obj(*args, **kwargs)
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/usr/local/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack headers=headers, params=params)
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/opt/stack/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack ret = obj(*args, **kwargs)
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/usr/local/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack headers=headers, params=params)
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/opt/stack/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack ret = obj(*args, **kwargs)
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/usr/local/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack resp, replybody = self.httpclient
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/usr/local/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack return self.request(url, method, **kwargs)
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/usr/local/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack resp = super(SessionCl
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/usr/local/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack return self.session.
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/usr/local/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack return wrapped(*args, **kwargs)
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/usr/local/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack resp = send(**kwargs)
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack File "/usr/local/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack raise exceptions.
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack ConnectFailure: Unable to establish connection to https:/
2016-10-05 14:35:04.333 18048 ERROR nova.api.openstack
According to logstash this started happening around 9/27, which lines up with when TLS was enabled in ocata (master) branch jobs:
https:/
So I assume those are related.
Changed in nova: | |
status: | New → Confirmed |
importance: | Undecided → Medium |
tags: | added: tls |
Changed in devstack: | |
status: | Confirmed → Fix Released |
Also failing in n-cpu:
http:// logs.openstack. org/10/ 331810/ 5/gate/ gate-tempest- dsvm-neutron- full-ubuntu- xenial/ 49cb6d7/ logs/screen- n-cpu.txt. gz?level= TRACE#_ 2016-10- 11_20_51_ 11_229