CI / SSL: 504 Gateway Time-out
Bug #1666072 reported by
Emilien Macchi
This bug affects 1 person
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Ceilometer |
Fix Released
|
Medium
|
gordon chung | ||
tripleo |
Fix Released
|
Critical
|
Unassigned |
Bug Description
Something is blocking promotion jobs. The pingtest doesn't work anymore, it fails to reach OpenStack endpoints:
http://
Packaging diff between a job that worked and another that fails:
https:/
I've been investigating certificates but they're good (until Nov 7th 2017 by the way).
I've seen some errors with heat-agents in logs.
It could be related to https:/
Changed in tripleo: | |
milestone: | ongoing → ocata-rc2 |
Changed in tripleo: | |
assignee: | nobody → Sagi (Sergey) Shnaidman (sshnaidm) |
tags: | removed: alert promotion-blocker |
Changed in tripleo: | |
status: | Triaged → Fix Released |
no longer affects: | gnocchi |
Changed in ceilometer: | |
assignee: | nobody → gordon chung (chungg) |
status: | New → In Progress |
Changed in ceilometer: | |
importance: | Undecided → Medium |
Changed in tripleo: | |
assignee: | nobody → Emilien Macchi (emilienm) |
status: | Triaged → In Progress |
Changed in tripleo: | |
status: | In Progress → Fix Released |
tags: | removed: alert |
To post a comment you must log in.
I see in journal of controller also os-collect-config errors, although it could be red herring:
http:// logs.openstack. org/15/ 359215/ 62/check- tripleo/ gate-tripleo- ci-centos- 7-ovb-nonha/ 136beee/ /logs/overcloud -controller- 0/var/log/ messages
Feb 19 11:04:50.201420 overcloud- controller- 0 os-collect- config[ 2462]: [2017-02-19 11:04:50,200] (heat-config) [INFO] controller- 0 os-collect- config[ 2462]: [2017-02-19 11:04:50,201] (heat-config) [ERROR] Error running heat-config-notify. [1] controller- 0 os-collect- config[ 2462]: [2017-02-19 11:04:50,201] (heat-config) [ERROR] [2017-02-19 11:04:50,137] (heat-config- notify) [DEBUG] Signaling to https:/ /192.168. 24.2:138 75f8c60dff83495 8a5ed63d1598514 21/copy_ ssh_key- 20852643- f7e2-4212- a31a-4e578176dd d5/c2bb6901- fe07-4c82- 94a8-98922d4cf6 d3?temp_ url_sig= e35fcb8bd1f5596 ba4a095f38b7b4e cf01fb1871& temp_url_ expires= 148752027 controller- 0 os-collect- config[ 2462]: Traceback (most recent call last): controller- 0 os-collect- config[ 2462]: File "/usr/bin/ heat-config- notify" , line 163, in <module> controller- 0 os-collect- config[ 2462]: sys.exit( main(sys. argv, sys.stdin)) controller- 0 os-collect- config[ 2462]: File "/usr/bin/ heat-config- notify" , line 110, in main controller- 0 os-collect- config[ 2462]: headers= {'content- type': 'application/ json'}) controller- 0 os-collect- config[ 2462]: File "/usr/lib/ python2. 7/site- packages/ requests/ api.py" , line 123, in put controller- 0 os-collect- config[ 2462]: return request('put', url, data=data, **kwargs) controller- 0 os-collect- config[ 2462]: File "/usr/lib/ python2. 7/site- packages/ requests/ api.py" , line 56, in request controller- 0 os-collect- config[ 2462]: return session. request( method= method, url=url, **kwargs) controller- 0 os-collect- config[ 2462]: File "/usr/lib/ python2. 7/site- packages/ requests/ sessions. py", line 475, in request controller- 0 os-collect- config[ 2462]: resp = self.send(prep, **send_kwargs) controller- 0 os-collect- config[ 2462]: File "/usr/lib/ python2. 7/site- packages/ requests/ sessions. py", line 596, in send controller- 0 os-collect- config[ 2462]: r = adapter. send(request, **kwargs) controller- 0 os-collect- config[ 2462]: File "/usr/lib/ python2. 7/site- packages/ requests/ adapters. py", line 497, in send controller- 0 os-collect- config[ 2462]: raise SSLError(e, request=request) controller- 0 os-collect- config[ 2462]: requests. exceptions. SSLError: [SSL: CERTIFICATE_ VERIFY_ FAILED] certificate verify failed (_ssl.c:579)
Feb 19 11:04:50.201965 overcloud-
Feb 19 11:04:50.202294 overcloud-
08/v1/AUTH_
8 via PUT
Feb 19 11:04:50.202651 overcloud-
Feb 19 11:04:50.202973 overcloud-
Feb 19 11:04:50.203291 overcloud-
Feb 19 11:04:50.203626 overcloud-
Feb 19 11:04:50.203941 overcloud-
Feb 19 11:04:50.204245 overcloud-
Feb 19 11:04:50.204546 overcloud-
Feb 19 11:04:50.204869 overcloud-
Feb 19 11:04:50.205154 overcloud-
Feb 19 11:04:50.205458 overcloud-
Feb 19 11:04:50.205776 overcloud-
Feb 19 11:04:50.206058 overcloud-
Feb 19 11:04:50.206347 overcloud-
Feb 19 11:04:50.206697 overcloud-
Feb 19 11:04:50.206998 overcloud-
Feb 19 11:04:50.207336 overcloud-