[SRU] dpkg eror processing package nova-compute

[Annie Melen]

[Impact]

Hello!
I've encountered the bug while installing Nova on compute nodes:

...
Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu5~cloud0) ...
Setting up qemu-kvm (1:2.11+dfsg-1ubuntu5~cloud0) ...
Setting up qemu-utils (1:2.11+dfsg-1ubuntu5~cloud0) ...
Setting up python-keystone (2:13.0.0-0ubuntu1~cloud0) ...
Processing triggers for initramfs-tools (0.122ubuntu8.11) ...
update-initramfs: Generating /boot/initrd.img-4.4.0-116-generic
Setting up nova-compute-libvirt (2:17.0.1-0ubuntu1~cloud0) ...
adduser: The user `nova' does not exist.
dpkg: error processing package nova-compute-libvirt (--configure):
 subprocess installed post-installation script returned error exit status 1
dpkg: dependency problems prevent configuration of nova-compute-kvm:
 nova-compute-kvm depends on nova-compute-libvirt (= 2:17.0.1-0ubuntu1~cloud0); however:
  Package nova-compute-libvirt is not configured yet.

dpkg: error processing package nova-compute-kvm (--configure):
 dependency problems - leaving unconfigured
Setting up python-os-brick (2.3.0-0ubuntu1~cloud0) ...
No apport report written because the error message indicates its a followup error from a previous failure.
Setting up python-nova (2:17.0.1-0ubuntu1~cloud0) ...
Setting up nova-common (2:17.0.1-0ubuntu1~cloud0) ...
Setting up nova-compute (2:17.0.1-0ubuntu1~cloud0) ...
Processing triggers for libc-bin (2.23-0ubuntu10) ...
Processing triggers for systemd (229-4ubuntu21.2) ...
Processing triggers for ureadahead (0.100.0-19) ...
Processing triggers for dbus (1.10.6-1ubuntu3.3) ...
Errors were encountered while processing:
 nova-compute-libvirt
 nova-compute-kvm
...

Installation failed when executing 'post-installation script'.
After some investigation I've found out that if I've create 'nova' user BEFORE running package installation, it's will be succeded.

[Test Case]

Steps to reproduce
------------------
1. Prepare the node for installing nova-compute packages
2. Run 'apt-get install nova-compute'

Expected result
------------------
Nova-compute installed successfully without errors

Actual result
------------------
Installation failed with dpkg error

Workaround
------------------
1. Create system user: add to /etc/passwd
   nova:x:64060:64060::/var/lib/nova:/bin/false
2. Create system group: add to /etc/group
   nova:x:64060:
3. Run 'apt-get install nova-compute'

My Environment
------------------
Ubuntu 16.04.4 LTS, 4.4.0-116-generic
Openstack Queens Release
Nova 17.0.1-0ubuntu1

[Regression Potential]
Should be very low. This is a very minor dependency chain to prevent a dependency circular loop.

[jichenjc (jichenjc)]

this is not a nova issue, please file this kind of bug against dpkg/ubuntu install ...

[Corey Bryant (corey.bryant)]

Hi Annie,

Thanks for reporting this. I wasn't able to recreate the issue that you hit. Here are my results: https://paste.ubuntu.com/p/wN5Z6txBxn/.

Is there anything different in your environment that you're aware of? Following are the contents of the postinst script. If you're still able to recreate this and can these commands manually you may find which command is failing.

https://paste.ubuntu.com/p/f95Fg9wTDh/

For now I'm going to mark this as Incomplete until we can get more details for how to recreate.

Thanks,
Corey

[Corey Bryant (corey.bryant)]

Please feel free to move back to "New" if more details are added to the bug for how to recreate.

[Annie Melen (anniemelen)]

Hi, Corey!

Yes, I still can recreate this issue and installation again failed with error. I have Ubuntu 16.04.4 LTS, 4.4.0-119-generic, with minimal scope of services. The full log is attached.

[Corey Bryant (corey.bryant)]

(Note: There was a paste failure with my last comment so I've hidden that.)

Hi Annie,

I can't confirm that your package is coming from a Canonical or Ubuntu supported archive.

Your log has the following:

nova-compute:
  Installed: (none)
  Candidate: 2:17.0.1-0ubuntu1~cloud0
  Version table:
     2:17.0.1-0ubuntu1~cloud0 500
        500 http://172.31.200.12/cloud_archive/x86_64 xenial-proposed/queens/main amd64 Packages
     2:13.1.4-0ubuntu4.2 500
        500 http://172.31.200.12/ubuntu/x86_64 xenial-updates/main amd64 Packages
     2:13.0.0-0ubuntu2 500
        500 http://172.31.200.12/ubuntu/x86_64 xenial/main amd64 Packages

Whereas when I add the queens-proposed cloud archive to xenial I see:

nova-compute:
  Installed: (none)
  Candidate: 2:17.0.4-0ubuntu1~cloud0
  Version table:
     2:17.0.4-0ubuntu1~cloud0 500
        500 http://ubuntu-cloud.archive.canonical.com/ubuntu xenial-proposed/queens/main amd64 Packages
     2:13.1.4-0ubuntu4.2 500
        500 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 Packages
     2:13.0.0-0ubuntu2 500
        500 http://archive.ubuntu.com/ubuntu xenial/main amd64 Packages

If you still see problems using the standard Ubuntu archive for xenial with the Queens cloud archive [1] on top of it, please move this bug back to New status.

[1] sudo add-apt-repository cloud-archive:queens-proposed && sudo apt update

Thanks,
Corey

[Corey Bryant (corey.bryant)]

I was able to install nova-compute=2:17.0.4-0ubuntu1~cloud0 successfully.

[Annie Melen (anniemelen)]

Hi, Corey!

Thank you for respond. I'd replaced local repositories with official cloud-archive you provided, but the result is still the same...

Log is attached.

[Corey Bryant (corey.bryant)]

Annie,

Thank you for being persistent and ensuring you can recreate this on official repositories.

This looks to be a bug in our nova package. There is a dependency ordering problem that is surfacing in your case. I'm surprised this doesn't surface more often.

The dependency chain in the debian/control file for nova is defined as:

nova-compute -> nova-compute-kvm -> nova-compute-libvirt -> nova-compute -> nova-common

which means that nova-common must get installed before nova-compute, and nova-compute must get installed before nova-compute-libvirt.

However, there is also a circular dependency in there that I believe is causing issues:

nova-compute -> nova-common
nova-compute -> nova-compute-kvm # circular dependency - see above chain

Let me see if I can safely remove the circular dependency.

Thanks,
Corey

[Corey Bryant (corey.bryant)]

For now I'm going to triage this as medium. As a work-around you should be able to install nova-common prior to installing nova-compute.

apt install nova-common
apt install nova-compute

Thanks,
Corey

[Annie Melen (anniemelen)]

Corey,

I can confirm that your workaround is succeeded (tested with versions 17.0.3 and 17.0.4; 4.4.0-124-generic).

Regars,
Annie

[Corey Bryant (corey.bryant)]

Thanks for confirming. I have an updated package for xenial-queens in the following ppa:

add-apt-repository ppa:corey.bryant/xenial-queens

That will also need the queens cloud-archive enabled:

add-apt-repository cloud-archive:queens

If you're able to test that out it would be very helpful. This should fix the original error you were hitting, without having to install nova-common first.

Thanks,
Corey

[Annie Melen (anniemelen)]

...
Setting up nova-compute-libvirt (2:17.0.5-0ubuntu2~ubuntu16.04.1~ppa201806271055) ...
Adding user `nova' to group `libvirt' ...
Adding user nova to group libvirt
Done.
...

Installation had been finished without errors. It's finally working!

Regars,
Annie

[Corey Bryant (corey.bryant)]

Thanks for testing!

[Launchpad Janitor (janitor)]

This bug was fixed in the package nova - 2:18.0.0~b2-0ubuntu2

---------------
nova (2:18.0.0~b2-0ubuntu2) cosmic; urgency=medium

  * d/control: Drop circular dependencies. nova-compute depends on
    nova-compute-* packages. nova-compute-* packages shouldn't depend
    on nova-compute. nova-compute-* should however depend on nova-common.
    (LP: #1761140).

 -- Corey Bryant <email address hidden> Wed, 27 Jun 2018 10:40:01 -0400

[Corey Bryant (corey.bryant)]

Hello Annie, or anyone else affected,

Accepted nova into pike-proposed. The package will build now and be available in the Ubuntu Cloud Archive in a few hours, and then in the -proposed repository.

Please help us by testing this new package. To enable the -proposed repository:

  sudo add-apt-repository cloud-archive:pike-proposed
  sudo apt-get update

Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-pike-needed to verification-pike-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-pike-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

[Corey Bryant (corey.bryant)]

Hello Annie, or anyone else affected,

Accepted nova into ocata-proposed. The package will build now and be available in the Ubuntu Cloud Archive in a few hours, and then in the -proposed repository.

Please help us by testing this new package. To enable the -proposed repository:

  sudo add-apt-repository cloud-archive:ocata-proposed
  sudo apt-get update

Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-ocata-needed to verification-ocata-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-ocata-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

[Corey Bryant (corey.bryant)]

This is awaiting SRU team review for bionic and xenial. Once it is accepted into bionic-proposed and xenial-proposed we can accept it into queens-proposed and mitaka-proposed.

[Łukasz Zemczak (sil2100)]

There's already an existing nova SRU in bionic-proposed that needs to either go out first or - if it can't without this bug fixed, then please re-upload the fix with the source package built with -vVERSION to include both the -proposed and new version in the .changes file. Thanks!

[Corey Bryant (corey.bryant)]

I'd like to get the version in bionic-proposed verified and promoted and then we can get the new version of nova for this bug into -proposed. Thanks Lukasz!

[Corey Bryant (corey.bryant)]

This fix is combined with the Pike stable release update. Typically we'd hold off until later releases are fix released, however we need to get the Pike stable release out.

Marking this as verification-done for Pike: https://paste.ubuntu.com/p/jV6fhwHgWJ/

[Corey Bryant (corey.bryant)]

The verification of the Stable Release Update for nova has completed successfully and the package has now been released to -updates. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

[Corey Bryant (corey.bryant)]

This bug was fixed in the package nova - 2:16.1.4-0ubuntu1~cloud1
---------------

 nova (2:16.1.4-0ubuntu1~cloud1) xenial-pike; urgency=medium
 .
   * d/control: Drop circular dependencies. nova-compute depends on
     nova-compute-* packages. nova-compute-* packages shouldn't depend
     on nova-compute. nova-compute-* should however depend on nova-common.
     (LP: #1761140).

[Corey Bryant (corey.bryant)]

This fix is also combined with the Ocata stable release update. Typically we'd
hold off until later releases are fix released, however we need to get
the Ocata stable release out.

Marking this as verification-done for Ocata. nova-compute, nova-compute-libvirt, and nova-compute-vmware all installed successfully from ocata-proposed.

Note that tempest regression tests were also run successfully with this update for both Ocata and Pike.

[Corey Bryant (corey.bryant)]

The verification of the Stable Release Update for nova has completed successfully and the package has now been released to -updates. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

[Corey Bryant (corey.bryant)]

This bug was fixed in the package nova - 2:15.1.3-0ubuntu1~cloud1
---------------

 nova (2:15.1.3-0ubuntu1~cloud1) xenial-ocata; urgency=medium
 .
   * d/control: Drop circular dependencies. nova-compute depends on
     nova-compute-* packages. nova-compute-* packages shouldn't depend
     on nova-compute. nova-compute-* should however depend on nova-common.
     (LP: #1761140).

[Łukasz Zemczak (sil2100)]

Hello Annie, or anyone else affected,

Accepted nova into bionic-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/nova/2:17.0.5-0ubuntu2 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed.Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-bionic to verification-done-bionic. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-bionic. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

[Łukasz Zemczak (sil2100)]

Hello Annie, or anyone else affected,

Accepted nova into xenial-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/nova/2:13.1.4-0ubuntu4.3 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed.Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-xenial to verification-done-xenial. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-xenial. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

[Corey Bryant (corey.bryant)]

Hello Annie, or anyone else affected,

Accepted nova into queens-proposed. The package will build now and be available in the Ubuntu Cloud Archive in a few hours, and then in the -proposed repository.

Please help us by testing this new package. To enable the -proposed repository:

  sudo add-apt-repository cloud-archive:queens-proposed
  sudo apt-get update

Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-queens-needed to verification-queens-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-queens-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

[Corey Bryant (corey.bryant)]

Hello Annie, or anyone else affected,

Accepted nova into mitaka-proposed. The package will build now and be available in the Ubuntu Cloud Archive in a few hours, and then in the -proposed repository.

Please help us by testing this new package. To enable the -proposed repository:

  sudo add-apt-repository cloud-archive:mitaka-proposed
  sudo apt-get update

Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-mitaka-needed to verification-mitaka-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-mitaka-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

[Corey Bryant (corey.bryant)]

Regression testing successful on xenial-mitaka-proposed. Tempest results:

======
Totals
======
Ran: 102 tests in 772.8356 sec.
 - Passed: 94
 - Skipped: 8
 - Expected Fail: 0
 - Unexpected Success: 0
 - Failed: 0
Sum of execute time for each test: 451.2166 sec.

[Corey Bryant (corey.bryant)]

Correction, the last comment should say trusty-mitaka-proposed.

[Corey Bryant (corey.bryant)]

Verified successfully on bionic-proposed:

root@b1:~# sudo apt install nova-compute
...
root@b1:~# apt policy nova-compute
nova-compute:
  Installed: 2:17.0.5-0ubuntu2
  Candidate: 2:17.0.5-0ubuntu2
  Version table:
 *** 2:17.0.5-0ubuntu2 500
        500 http://archive.ubuntu.com/ubuntu bionic-proposed/main amd64 Packages
        100 /var/lib/dpkg/status
     2:17.0.5-0ubuntu1 500
        500 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages
     2:17.0.1-0ubuntu1 500
        500 http://archive.ubuntu.com/ubuntu bionic/main amd64 Packages

[Corey Bryant (corey.bryant)]

Verified successfully on xenial-proposed:

root@x1:~# sudo apt install nova-compute
...
root@x1:~# apt policy nova-compute
nova-compute:
  Installed: 2:13.1.4-0ubuntu4.3
  Candidate: 2:13.1.4-0ubuntu4.3
  Version table:
 *** 2:13.1.4-0ubuntu4.3 500
        500 http://archive.ubuntu.com/ubuntu xenial-proposed/main amd64 Packages
        100 /var/lib/dpkg/status
     2:13.1.4-0ubuntu4.2 500
        500 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 Packages
     2:13.0.0-0ubuntu2 500
        500 http://archive.ubuntu.com/ubuntu xenial/main amd64 Packages

[Corey Bryant (corey.bryant)]

Verified successfully on queens-proposed:

root@x1:~# sudo apt install nova-compute --yes
...
root@x1:~# apt policy nova-compute
nova-compute:
  Installed: 2:17.0.5-0ubuntu2~cloud0
  Candidate: 2:17.0.5-0ubuntu2~cloud0
  Version table:
 *** 2:17.0.5-0ubuntu2~cloud0 500
        500 http://ubuntu-cloud.archive.canonical.com/ubuntu xenial-proposed/queens/main amd64 Packages
        100 /var/lib/dpkg/status
     2:13.1.4-0ubuntu4.2 500
        500 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 Packages
     2:13.0.0-0ubuntu2 500
        500 http://archive.ubuntu.com/ubuntu xenial/main amd64 Packages

[Launchpad Janitor (janitor)]

This bug was fixed in the package nova - 2:13.1.4-0ubuntu4.3

---------------
nova (2:13.1.4-0ubuntu4.3) xenial; urgency=medium

  * d/control: Drop circular dependencies. nova-compute depends on
    nova-compute-* packages. nova-compute-* packages shouldn't depend
    on nova-compute. nova-compute-* should however depend on nova-common.
    (LP: #1761140).

 -- Corey Bryant <email address hidden> Wed, 27 Jun 2018 10:57:19 -0400

[Launchpad Janitor (janitor)]

This bug was fixed in the package nova - 2:17.0.5-0ubuntu2

---------------
nova (2:17.0.5-0ubuntu2) bionic; urgency=medium

  * d/control: Drop circular dependencies. nova-compute depends on
    nova-compute-* packages. nova-compute-* packages shouldn't depend
    on nova-compute. nova-compute-* should however depend on nova-common.
    (LP: #1761140).

 -- Corey Bryant <email address hidden> Wed, 27 Jun 2018 10:47:50 -0400

[Corey Bryant (corey.bryant)]

The verification of the Stable Release Update for nova has completed successfully and the package has now been released to -updates. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

[Corey Bryant (corey.bryant)]

This bug was fixed in the package nova - 2:13.1.4-0ubuntu4.3~cloud0
---------------

 nova (2:13.1.4-0ubuntu4.3~cloud0) trusty-mitaka; urgency=medium
 .
   * New update for the Ubuntu Cloud Archive.
 .
 nova (2:13.1.4-0ubuntu4.3) xenial; urgency=medium
 .
   * d/control: Drop circular dependencies. nova-compute depends on
     nova-compute-* packages. nova-compute-* packages shouldn't depend
     on nova-compute. nova-compute-* should however depend on nova-common.
     (LP: #1761140).