Comment 14 for bug 1266711

Revision history for this message
Jeremy Stanley (fungi) wrote :

The trigger for this was an inadvertent upgrade to libvirt 1.11 on all the slaves. When we determined that http://git.openstack.org/cgit/openstack-infra/config/commit/?id=bdcc115 was broken and reverted it with http://git.openstack.org/cgit/openstack-infra/config/commit/?id=f7b9581 (back in late September), we neglected to remove the /etc/apt/sources.list.d/cloudarchive.list file it left behind. This went unnoticed because unattended-upgrade job does not upgrade from unofficial repositories unless explicitly whitelisted, so it wasn't until early this morning when we approved http://git.openstack.org/cgit/openstack-infra/config/commit/?id=0385b96 that apt-get ended up pulling libvirt-dev and its dependencies from Ubuntu Cloud Archive rather than main that this came to light.

The ensuing mayhem was resolved by merging http://git.openstack.org/cgit/openstack-infra/config/commit/?id=7282ca4 and then using salt.run to execute the following on all precise.* slaves:

    rm -f /etc/apt/sources.list.d/cloudarchive.list
    apt-get update
    apt-get install -y --force-yes \
        libvirt-bin=0.9.8-2ubuntu17.16 \
        libvirt-dev=0.9.8-2ubuntu17.16 \
        libvirt0=0.9.8-2ubuntu17.16 \
        libxenstore3.0=4.1.5-0ubuntu0.12.04.2 \
        libxen-dev=4.1.5-0ubuntu0.12.04.2

Since then, subsequent unit tests are back to using old libvirt in CI and passing normally.