Random proxy error when creating tokens in CI runs

Bug #1653856 reported by Matt Riedemann
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack-Gate
Confirmed
Undecided
Unassigned

Bug Description

Seen here:

http://logs.openstack.org/45/140045/51/check/gate-tempest-dsvm-neutron-linuxbridge-ubuntu-xenial/e8dc13e/logs/tempest.txt.gz#_2017-01-03_22_58_01_052

2017-01-03 22:58:01.052 13466 INFO tempest.lib.common.rest_client [-] Request (FloatingIPsBulkAdminTestJSON:setUpClass): 502 POST https://10.18.19.168:5000/v2.0/tokens
2017-01-03 22:58:01.052 13466 DEBUG tempest.lib.common.rest_client [-] Request - Headers: {'Accept': 'application/json', 'Content-Type': 'application/json'}
        Body: <omitted>
    Response - Headers: {'date': 'Tue, 03 Jan 2017 22:58:01 GMT', 'server': 'Apache/2.4.18 (Ubuntu)', 'status': '502', 'content-length': '482', 'connection': 'close', 'content-type': 'text/html; charset=iso-8859-1', 'content-location': 'https://10.18.19.168:5000/v2.0/tokens'}
        Body: <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>502 Proxy Error</title>
</head><body>
<h1>Proxy Error</h1>
<p>The proxy server received an invalid
response from an upstream server.<br />
The proxy server could not handle the request <em><a href="/v2.0/tokens">POST&nbsp;/v2.0/tokens</a></em>.<p>
Reason: <strong>Error reading from remote server</strong></p></p>
<hr>
<address>Apache/2.4.18 (Ubuntu) Server at 10.18.19.168 Port 5000</address>
</body></html>
 _log_request_full tempest/lib/common/rest_client.py:431

http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22Request%5C%22%20AND%20message%3A%5C%22502%20POST%5C%22%20AND%20message%3A%5C%225000%2Fv2.0%2Ftokens%5C%22%20AND%20tags%3A%5C%22tempest.txt%5C%22&from=7d

Matt Riedemann (mriedem)
Changed in openstack-gate:
status: New → Confirmed
Revision history for this message
Jordan Pittier (jordan-pittier) wrote :

I've seen several related gate failure. What I have seen in the logs is "Unable to establish connection to XXXX: ('Connection aborted.', BadStatusLine("''",))" [1] It doesn"t only happen with token creation.

It feels (no proof) the errors started poping while we added HTTPS everywhere.

[1] http://logs.openstack.org/55/416155/1/gate/gate-tempest-dsvm-neutron-full-ubuntu-xenial/a363ecd/logs/screen-n-cpu.txt.gz?level=ERROR#_2017-01-04_11_46_43_515

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.