Outage on trunk.rdoprojects.org is causing all the CI jobs to fail

Bug #1842448 reported by Gabriele Cerami
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Fix Released
Critical
Gabriele Cerami

Bug Description

The instances that distribute dlrn repo and hashes went down on the weekend.

As an effect all the jobs failed to download and install dlrn repositories locally, and proceed with the rest of the tests.

The outage has since been resolved, but problem remain in the propagation of the correct DNS entries to point to the correct IPs.

As a result jobs are still experiencing problems when trying to download repositories for a specific hash.

summary: - outage to trunk.rdoprojects.org is causing all the CI jobs to fail
+ Outage on trunk.rdoprojects.org is causing all the CI jobs to fail
tags: added: promotion-blocker
Revision history for this message
Gabriele Cerami (gcerami) wrote :

The rebuilding outlined a mismatch between the data in the db backups and the latest db scheme. Dlrn API wasn't working correctly as a result.
Javier updated the schema and reloaded services.

wes hayutin (weshayutin)
Changed in tripleo:
status: In Progress → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.