ceph 15.2.3-0ubuntu0.20.04.2 collides with ceph-deploy 2.0.1-0ubuntu1

[Pascal Ernster]

[Impact]
Not possible to install ceph and ceph-deploy binary packages due to conflicting manpage.

[Test Case]
sudo apt install ceph-base ceph-deploy
[error as in original bug report]

[Regression Discussion]
The fix simply drops the ceph-deploy manpage from the ceph-base binary package.

[Original Bug Report]
On an Ubuntu 20.04 installation with the focal-proposed repos enabled and both the ceph/ceph-base/ceph-* packages (which are in main) and the ceph-deploy package (which is in universe) installed, the upgrade from ceph 15.2.3-0ubuntu0.20.04.1 to ceph 15.2.3-0ubuntu0.20.04.2 breaks with the following error message:

dpkg: error processing archive /var/cache/apt/archives/ceph-base_15.2.3-0ubuntu0.20.04.2_amd64.deb (--unpack):
 trying to overwrite '/usr/share/man/man8/ceph-deploy.8.gz', which is also in package ceph-deploy 2.0.1-0ubuntu1

I wasn't even able to solve this by trying to uninstall/purge ceph-deploy using apt-get or aptitude - instead, I had to resort to

dpkg --remove --force-remove-reinstreq ceph-deploy

I think this is a bug in ceph 15.2.3-0ubuntu0.20.04.2, more specifically in the packaging of ceph-base 15.2.3-0ubuntu0.20.04.2, which probably shouldn't contain the man page for ceph-deploy since it doesn't seem to contain any other ceph-deploy files either.

[Launchpad Janitor (janitor)]

Status changed to 'Confirmed' because the bug affects multiple users.

[Rgpublic (rgpublic)]

Umm, could stuff like that get a little bit more priority perhaps? It's a total nightmare that Ubuntu Server is actually shipping with broken Ceph packages that can't even be installed easily.

[James Page (james-page)]

I've pushed this to the git repo for focal, groovy and hirsute branches.

We have a set of security related updates to get through the SRU process and then this will be next.

[Eric Desrochers (slashd)]

Thanks @James

[Launchpad Janitor (janitor)]

This bug was fixed in the package ceph - 16.2.1-0ubuntu1

---------------
ceph (16.2.1-0ubuntu1) impish; urgency=medium

  [ Chris MacNaughton ]
  * d/ceph-base.install: Remove ceph-deploy man page installation
    (LP: #1892448).

  [ James Page ]
  * SECURITY UPDATE: New upstream point release (LP: #1925322):
    - CVE-2021-20288
  * d/rules: remove temporary build objects after install to avoid
    running out of disk space during package builds.
  * d/p/bug1925347.patch: Cherry pick fix to revert ProtectClock
    permissions change in systemd configurations which prevents the
    ceph-osd process from starting (LP: #1925347).

 -- James Page <email address hidden> Tue, 04 May 2021 19:21:24 +0100

[Łukasz Zemczak (sil2100)]

This bug is included in the ceph debian/changelog - can we get the SRU information filled in for it? Only then we can properly evaluate and review.

[James Page (james-page)]

@sil2100

apologies I'd not spotted this bug was SRU incomplete - I've included require details.

[Brian Murray (brian-murray)]

Hello Pascal, or anyone else affected,

Accepted ceph into hirsute-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/ceph/16.2.4-0ubuntu0.21.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-hirsute to verification-done-hirsute. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-hirsute. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

[Pascal Ernster (hardfalcon)]

Hi, I'm not really following this bug report anymore, and I won't test this, but thanks for (most likely) fixing the issue.

On a more general note, a question to Canonical: Why does a commercial distro even bother to have things like "-proposed" repos or a bug tracker if it takes 9-10 months to fix an issue *this* trivial in a supposedly supported package, in the most current supposedly supported distro release? And why should people even bother to write bug reports at all? Other people manage to conceive and give birth to a child during the timespan it takes Canonical to simply delete a file.

[Eric Desrochers (slashd)]

The packages for 'riscv64' and 'amd64' arches are still building as we speak.

* riscv64: Currently building
https://launchpad.net/ubuntu/+source/ceph/16.2.4-0ubuntu0.21.04.1/+build/21630681

* amd64: Currently building
https://launchpad.net/ubuntu/+source/ceph/16.2.4-0ubuntu0.21.04.1/+build/21630677

[Eric Desrochers (slashd)]

Any idea when G/F will follow ?

[Eric Desrochers (slashd)]

[VERIFICATION HIRSUTE]

Installation of both ceph and ceph-deploy went fine with the proposed packages (version: 16.2.4-0ubuntu0.21.04.1). They are now co-installable:

# dpkg
ii ceph 16.2.4-0ubuntu0.21.04.1 amd64 distributed storage and file system
ii ceph-base 16.2.4-0ubuntu0.21.04.1 amd64 common ceph daemon libraries and management tools
ii ceph-common 16.2.4-0ubuntu0.21.04.1 amd64 common utilities to mount and interact with a ceph storage cluster
ii ceph-deploy 2.0.1-0ubuntu1 all Ceph cluster deployment and configuration over ssh

# ceph-deploy:
/usr/lib/python3/dist-packages/ceph_deploy/util/pkg_managers.py
/usr/share/man
/usr/share/man/man8
/usr/share/man/man8/ceph-deploy.8.gz

# ceph-base:
/usr/share/man
/usr/share/man/man8
/usr/share/man/man8/ceph-create-keys.8.gz
/usr/share/man/man8/ceph-kvstore-tool.8.gz
/usr/share/man/man8/ceph-run.8.gz
/usr/share/man/man8/crushtool.8.gz
/usr/share/man/man8/monmaptool.8.gz
/usr/share/man/man8/osdmaptool.8.gz

[Norbert (nrbrtx)]

Still broken of focal:

```
$ apt-get install ceph-base ceph-deploy
...
Unpacking ceph-deploy (2.0.1-0ubuntu1) ...
dpkg: error processing archive /tmp/apt-dpkg-install-ZP1daC/27-ceph-deploy_2.0.1-0ubuntu1_all.deb (--unpack):
 trying to overwrite '/usr/share/man/man8/ceph-deploy.8.gz', which is also in package ceph-base 15.2.11-0ubuntu0.20.04.2
dmesg: read kernel buffer failed: Operation not permitted
                                                         Selecting previously unselected package ceph-mds.
Preparing to unpack .../28-ceph-mds_15.2.11-0ubuntu0.20.04.2_amd64.deb ...
Unpacking ceph-mds (15.2.11-0ubuntu0.20.04.2) ...
Selecting previously unselected package ibverbs-providers:amd64.
Preparing to unpack .../29-ibverbs-providers_28.0-1ubuntu1_amd64.deb ...
Unpacking ibverbs-providers:amd64 (28.0-1ubuntu1) ...
Errors were encountered while processing:
 /tmp/apt-dpkg-install-ZP1daC/27-ceph-deploy_2.0.1-0ubuntu1_all.deb
E: Sub-process /usr/bin/dpkg returned an error code (1)

```

Seen on https://askubuntu.com/q/1345687/66509 .

[Robert Sander (gurubert)]

ceph-deploy does not work with Ceph >= 15 any more. Why do you want to install both?

[Eric Desrochers (slashd)]

Norbert (nrbrtx), only 'hirsute' has been fixed for now.

Groovy and Focal will follow soon.

As soon as G/F will turn to 'Fix Committed' it will implies that the new pkgs will be found in $release-proposed to the verification phase.

'Fix released' will mark the end of the SRU, meaning the pkg will be copied over to $release-updates.

Regards,
Eric

[Eric Desrochers (slashd)]

Hi Robert Sander (gurubert),

From where are you taking this information ? Could you please share more ?

- Eric

[Eric Desrochers (slashd)]

Does this doesn't work with Ceph >=15 situation an intentional decision or a bug/something broken ?

[Eric Desrochers (slashd)]

So far, I do see official documentations about Ceph octopus (v15) and ceph-deploy:
https://docs.ceph.com/en/octopus/install/ceph-deploy/

So I am confused about your comment.

- Eric

[Robert Sander (gurubert)]

ceph-deploy has been written in Python and was never ported to Python 3. It is unsupported on Ceph version >= 15: https://docs.ceph.com/en/octopus/install/

[Eric Desrochers (slashd)]

For bug documentation purposes:

"
Important ceph-deploy is no longer actively maintained. It is not tested on versions of Ceph newer than Nautilus. It does not support RHEL8, CentOS 8, or newer operating systems.
"

[Eric Desrochers (slashd)]

I have reported a separate bug for it (LP: #1932057).

[Launchpad Janitor (janitor)]

This bug was fixed in the package ceph - 16.2.4-0ubuntu0.21.04.1

---------------
ceph (16.2.4-0ubuntu0.21.04.1) hirsute; urgency=medium

  [ Chris MacNaughton ]
  * d/ceph-base.install: Remove ceph-deploy man page installation
    (LP: #1892448).

  [ James Page ]
  * SECURITY UPDATE: New upstream release (LP: #1928645):
    - CVE-2021-3509: Dashboard XSS via token cookie.
    - CVE-2021-3531: Swift API denial of service.
    - CVE-2021-3531: HTTP header injects via CORS in RGW.
    - d/p/bug1925347.patch: Drop, included in release.

 -- James Page <email address hidden> Thu, 27 May 2021 06:18:16 +0100

[Brian Murray (brian-murray)]

The verification of the Stable Release Update for ceph has completed successfully and the package is now being released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

[James Page (james-page)]

Groovy EOL'ed so marking task as a won't fix.

[James Page (james-page)]

Update for focal uploaded to the UNAPPROVED queue for SRU team review.

[Robie Basak (racb)]

Hello Pascal, or anyone else affected,

Accepted ceph into focal-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/ceph/15.2.13-0ubuntu0.20.04.2 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-focal to verification-done-focal. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-focal. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

[Eric Desrochers (slashd)]

@james

I just marked Bionic as affected as well.
Bionic/ceph will also require the fix.

[James Page (james-page)]

This does not impact Ubuntu 18.04 packaging - the earliest release with the inclusion of the ceph-deploy manpage was focal.

The packages from focal will be automatically backported for the Ussuri UCA for 18.04.

[James Page (james-page)]

This update is in the UCA bionic-ussuri/proposed pocket.

[Chris MacNaughton (chris.macnaughton)]

[VERIFICATION FOCAL]

Installation of both ceph and ceph-deploy went fine with the proposed packages (version: 15.2.13-0ubuntu0.20.04.2). They are now co-installable:

# dpkg -l | grep ceph
ii ceph-base 15.2.13-0ubuntu0.20.04.2 amd64 common ceph daemon libraries and management tools
ii ceph-common 15.2.13-0ubuntu0.20.04.2 amd64 common utilities to mount and interact with a ceph storage cluster
ii ceph-deploy 2.0.1-0ubuntu1 all Ceph cluster deployment and configuration over ssh

[Chris MacNaughton (chris.macnaughton)]

[VERIFICATION BIONIC-USSURI]

Installation of both ceph and ceph-deploy went fine with the proposed packages (version: 15.2.13-0ubuntu0.20.04.2~cloud0). They are now co-installable:

# dpkg -l | grep ceph
ii ceph-base 15.2.13-0ubuntu0.20.04.2~cloud0 amd64 common ceph daemon libraries and management tools
ii ceph-common 15.2.13-0ubuntu0.20.04.2~cloud0 amd64 common utilities to mount and interact with a ceph storage cluster
ii ceph-deploy 2.0.1-0ubuntu1~cloud1 all Ceph cluster deployment and configuration over ssh

[Launchpad Janitor (janitor)]

This bug was fixed in the package ceph - 15.2.13-0ubuntu0.20.04.2

---------------
ceph (15.2.13-0ubuntu0.20.04.2) focal; urgency=medium

  [ Chris MacNaughton ]
  * d/ceph-base.install: Remove ceph-deploy man page installation
    (LP: #1892448).

 -- James Page <email address hidden> Mon, 26 Jul 2021 11:25:32 +0100

[Chris MacNaughton (chris.macnaughton)]

The verification of the Stable Release Update for ceph has completed successfully and the package has now been released to -updates. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

[Chris MacNaughton (chris.macnaughton)]

This bug was fixed in the package ceph - 15.2.13-0ubuntu0.20.04.2~cloud0
---------------

 ceph (15.2.13-0ubuntu0.20.04.2~cloud0) bionic-ussuri; urgency=medium
 .
   * New update for the Ubuntu Cloud Archive.
 .
 ceph (15.2.13-0ubuntu0.20.04.2) focal; urgency=medium
 .
   [ Chris MacNaughton ]
   * d/ceph-base.install: Remove ceph-deploy man page installation
     (LP: #1892448).