Upgrade problem exists from W->master where we go from runc to crun. Any changes to containers configs/systemd files causes the containers to be recreated/restarted and it hangs

Bug #1945439 reported by Bogdan Dobrelya
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Incomplete
Critical
Unassigned

Bug Description

There is an upgrade problem that exists from W->master where we go from runc to crun. Any changes to containers configs/systemd files causes the containers to be recreated/restarted and it hangs

Changed in tripleo:
status: New → Triaged
importance: Undecided → Critical
Revision history for this message
Bogdan Dobrelya (bogdando) wrote :

IIUC, downstream there is no such issue, since there is only FFU paths remained? And since FFU goes from scratch - clean OS upgrade, what's the point to keep non-FFU upgrade jobs blocking upstream?

tags: added: ci
tags: added: alert
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tripleo-ci (master)

Fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/tripleo-ci/+/811720

Changed in tripleo:
status: Triaged → In Progress
Revision history for this message
Bogdan Dobrelya (bogdando) wrote :

requires a stable reproducer (it might be related to neutron/virtlogd wrappers only)

Changed in tripleo:
status: In Progress → Incomplete
Revision history for this message
Bogdan Dobrelya (bogdando) wrote :

also we should not drop the UC upgrade job, since it will be useful for catching regressions like that

tags: removed: alert ci
Revision history for this message
Michele Baldessari (michele) wrote :

https://review.opendev.org/c/openstack/tripleo-ansible/+/806481 is prolly what we want to start with, so at least we make sure we cannot change the runtime depending on what rpms get pulled in. (i.e. if crun is installed later podman version will use it as a default runtime)

Revision history for this message
Marios Andreou (marios-b) wrote :

@Bogdan - especially the undercloud upgrade we need to keep running.
For the FFU case, the undercloud is upgraded through 3 consecutive versions, i.e. we run undercloud upgrade 3 times. So the point to point upgrade needs to keep working in this case especially. Unless that has completely changed ;) but I'd ask the upgrades team to sign off on it - I think there will just have to be some workaround for this upgrade in particular where the runtime changes.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on tripleo-ci (master)

Change abandoned by "Bogdan Dobrelya <email address hidden>" on branch: master
Review: https://review.opendev.org/c/openstack/tripleo-ci/+/811720

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.