CI promoter script needs improvement

Bug #1722552 reported by Gabriele Cerami on 2017-10-10
10
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
High
Gabriele Cerami

Bug Description

list of containers to promote should be taken dynamically

At the moment, the list of containers to promote is written on a static txt file, downloaded manually from a container build job run.
We should fetch the list of containers dynamically, inspecting the logs of the last passed container build job that use the hash we're promoting.
This needs modifications to the promoter script and the container push script, possible mainly after implementing the two other cards https://trello.com/c/OFCAG1ue and https://trello.com/c/50k8DmyT
And we also need to ensure such a list is written in the containers build job, since change https://review.rdoproject.org/r/9328 is removing the creation of such file

Promoter script configuration file should implement subsections

Promoter script would need at least:
- verbose mode, right now it logs only on a file
- extend dry_run to containers and qcow promotion

Improve promoter script debugging

INI files usually contain sections, keys and value. This is somewhat limiting, and in the promoter script for example, known sections are removed, so that the remaining sections can all be considered tags names.
We should use subsections instead, which are not in the standard configparser implementation, but are easy to implement, and render the configuration more extendable.
Ex.
[main]
user:

[promote_from:tripleo-ci-testing]
current-tripleo

[jobs_required:current-tripleo]
job1
job2
job3

container-push in promoter script should consider the release of the promotion while running

at the moment:
- any release without a container registry associated will fail will fail the push script (not too bad, but logs will be flooded with error)
- a single static list of container is being used. I expect the list to diverge from release to release in the future

Tags: ci Edit Tag help
Changed in tripleo:
milestone: none → queens-1
description: updated
Changed in tripleo:
importance: Undecided → Medium
status: New → Triaged
milestone: queens-1 → queens-2
wes hayutin (weshayutin) on 2017-10-17
Changed in tripleo:
assignee: nobody → Gabriele Cerami (gcerami)
importance: Medium → High
Gabriele Cerami (gcerami) wrote :

pushed https://review.rdoproject.org/r/10209, WIP at the moment. testing in promoter server

Changed in tripleo:
status: Triaged → In Progress
Changed in tripleo:
milestone: queens-2 → queens-3
Changed in tripleo:
milestone: queens-3 → queens-rc1
Changed in tripleo:
milestone: queens-rc1 → rocky-1
Changed in tripleo:
milestone: rocky-1 → rocky-2
Changed in tripleo:
milestone: rocky-2 → rocky-3
Changed in tripleo:
milestone: rocky-3 → rocky-rc1
Changed in tripleo:
milestone: rocky-rc1 → stein-1
Changed in tripleo:
milestone: stein-1 → stein-2
Changed in tripleo:
milestone: stein-2 → stein-3
Changed in tripleo:
milestone: stein-3 → stein-rc1
Changed in tripleo:
milestone: stein-rc1 → train-1
Changed in tripleo:
milestone: train-1 → train-2
Changed in tripleo:
milestone: train-2 → train-3
Changed in tripleo:
milestone: train-3 → ussuri-1
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers