Multiple post_failure on master periodic pipeline
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
tripleo |
Fix Released
|
Critical
|
wes hayutin |
Bug Description
We are seeing multiple post failures on master periodic pipeline
Below is the list of jobs which got impacted:
* periodic-
* periodic-
* periodic-
* periodic-
* periodic-
* periodic-
* periodic-
It can be visible in check jobs also.
https:/
At this time 2020-01-30T00:42:19 we have following failures:
* tripleo-
* tripleo-
* tripleo-
* tripleo-
* tripleo-
* tripleo-
* tripleo-
The post playbook got failed. There might be multiple reasons associated with that.
May be the RDO log server got fulled as there is some recent change in ansible-
gzip format.
It needs to be investigated.
tags: | added: promotion-blocker |
Changed in tripleo: | |
assignee: | nobody → wes hayutin (weshayutin) |
status: | Confirmed → In Progress |
The disk in logs.rdoproject.org is full again. I'm freeing up some space, and running the pruner script.
Could you check if all tripleo jobs have gone back to compressing logs? Yesterday we had more than 100GB available, and then usage went up again. You can check https:/ /review. rdoproject. org/grafana/ ?panelId= 52240&fullscree n&orgId= 1&var-datasourc e=default& var-server= logs.rdoproject .org.rdocloud& var-inter= $__auto_ interval_ inter&from= now-24h& to=now for details.