Can't create incremental backups when using python3 and newer Ceph versions.

Bug #1838691 reported by Sofia Enriquez
22
This bug affects 5 people
Affects Status Importance Assigned to Milestone
Cinder
Fix Released
Undecided
Sofia Enriquez
Ubuntu Cloud Archive
Fix Released
High
Unassigned
Rocky
Fix Released
High
Unassigned
Stein
Fix Released
Undecided
Unassigned
Train
Fix Released
High
Unassigned
cinder (Ubuntu)
Fix Released
High
Unassigned
Disco
Won't Fix
High
Unassigned
Eoan
Fix Released
High
Unassigned

Bug Description

During the incremental backups creation, unexpectedly the '_cleanup_incomplete_backup_operations' method is called aborting the backup:

DEBUG cinder.backup.drivers.ceph Volume file is RBD: attempting incremental backup. backup /usr/lib/python3.6/site-packages/cinder/backup/drivers/ceph.py:955

INFO cinder.service [-] Starting cinder-backup node (version 14.0.1)

DEBUG oslo_concurrency.lockutils Lock "cleanup_incomplete_backups_1" acquired by "cinder.backup.manager.BackupManager._cleanup_incomplete_backup_operations" :: waited 0.001s inner /usr/lib/python3.6/site-packages/oslo_concurrency/lockutils.py:327

INFO cinder.backup.manager Cleaning up incomplete backup operations.

This happens when using ceph mimic with Python 3.x. The connections with Librbd[1] suddenly abort connections before accessing the data. [2]

How to reproduce:

>>> import rbd
>>> import rados
>>> cluster = rados.Rados(conffile='/etc/ceph/ceph.conf')
>>> cluster.connect()
>>> ioctx = cluster.open_ioctx('backups')
>>> image = rbd.Image(ioctx, 'volume-2d2c563d-c567-431a-9b25-ea06af83c598.backup.base')
>>> snaps = image.list_snaps()
>>> image.close()
>>> list(snaps)
Aborted (core dumped)

Expected output: snapshots list
>>> list(snaps)
[{'id': 4, 'size': 1073741824, 'name': 'backup.0dbaab38-595e-4e8a-8ecd-7ab60a879903.snap.1563912753.3520913', 'namespace': 0}, {'id': 5, 'size': 1073741824, 'name': 'backup.c9aaaf88-9ce1-4502-aa23-1dddfb1d45bb.snap.1564609930.8021717', 'namespace': 0}]

Actual output: core dumped

[1] https://docs.ceph.com/docs/giant/rbd/librbdpy/
[2] https://opendev.org/openstack/cinder/src/branch/master/cinder/backup/drivers/ceph.py#L649

Changed in cinder:
assignee: nobody → Sofia Enriquez (lsofia-enriquez)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to cinder (master)

Fix proposed to branch: master
Review: https://review.opendev.org/674152

Changed in cinder:
status: New → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on cinder (master)

Change abandoned by Sofia Enriquez (<email address hidden>) on branch: master
Review: https://review.opendev.org/674152
Reason: I just discovered this fix was already published. Moving to https://review.opendev.org/#/c/625396/.

Revision history for this message
Sofia Enriquez (lsofia-enriquez) wrote :

Ceph upstream bug report : https://tracker.ceph.com/issues/41076

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to cinder (master)

Reviewed: https://review.opendev.org/625396
Committed: https://git.openstack.org/cgit/openstack/cinder/commit/?id=76569672599eda764f946ad6ee2ce0bdaddad36b
Submitter: Zuul
Branch: master

commit 76569672599eda764f946ad6ee2ce0bdaddad36b
Author: Sven Wegener <email address hidden>
Date: Fri Dec 14 12:56:49 2018 +0100

    Fix ceph: only close rbd image after snapshot iteration is finished

    list_snaps() returns an iterator object that requires resources from the
    Image object. Closing the Image object deallocates these resources.

    On Ceph mimic, which contains changes to the functions being invoked,
    iterating over the snapshots of a closed image results in the following
    assertion being triggered:

    cinder-backup[29383]: /build/ceph-13.2.2/src/common/Mutex.cc: In function 'void Mutex::Lock(bool)' thread 7f35a4812700 time 2018-12-14 10:10:49.843120
    cinder-backup[29383]: /build/ceph-13.2.2/src/common/Mutex.cc: 110: FAILED assert(r == 0)
    cinder-backup[29383]: ceph version 13.2.2 (02899bfda814146b021136e9d8e80eba494e1126) mimic (stable)
    cinder-backup[29383]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x102) [0x7f35903440f2]
    cinder-backup[29383]: 2: (()+0x3162b7) [0x7f35903442b7]
    cinder-backup[29383]: 3: (Mutex::Lock(bool)+0x1de) [0x7f359031901e]
    cinder-backup[29383]: 4: (()+0x8f452) [0x7f358dafc452]
    cinder-backup[29383]: 5: (()+0x11280d) [0x7f358db7f80d]
    cinder-backup[29383]: 6: (rbd_snap_get_namespace_type()+0x29) [0x7f358dacf549]

    The lock being tried to acquire and the object that contained it have
    already been destroyed by closing the image. The assertion terminates
    the cinder-backup service via SIGABRT.

    On Ceph luminous we've seen occasional segfaults of the cinder-backup
    service, which might have the same underlying cause.

    Closes-Bug: #1838691

    Change-Id: If6043d82cc57d9247a290816d90b95cdf719eaac
    Signed-off-by: Sven Wegener <email address hidden>

Changed in cinder:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to cinder (stable/stein)

Fix proposed to branch: stable/stein
Review: https://review.opendev.org/676195

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to cinder (stable/rocky)

Fix proposed to branch: stable/rocky
Review: https://review.opendev.org/676211

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to cinder (stable/queens)

Fix proposed to branch: stable/queens
Review: https://review.opendev.org/676272

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to cinder (stable/pike)

Fix proposed to branch: stable/pike
Review: https://review.opendev.org/676273

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to cinder (stable/ocata)

Fix proposed to branch: stable/ocata
Review: https://review.opendev.org/676274

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to cinder (stable/stein)

Reviewed: https://review.opendev.org/676195
Committed: https://git.openstack.org/cgit/openstack/cinder/commit/?id=e78b220f448c7eb0de35aafd1d49b00547384d41
Submitter: Zuul
Branch: stable/stein

commit e78b220f448c7eb0de35aafd1d49b00547384d41
Author: Sven Wegener <email address hidden>
Date: Fri Dec 14 12:56:49 2018 +0100

    Fix ceph: only close rbd image after snapshot iteration is finished

    list_snaps() returns an iterator object that requires resources from the
    Image object. Closing the Image object deallocates these resources.

    On Ceph mimic, which contains changes to the functions being invoked,
    iterating over the snapshots of a closed image results in the following
    assertion being triggered:

    cinder-backup[29383]: /build/ceph-13.2.2/src/common/Mutex.cc: In function 'void Mutex::Lock(bool)' thread 7f35a4812700 time 2018-12-14 10:10:49.843120
    cinder-backup[29383]: /build/ceph-13.2.2/src/common/Mutex.cc: 110: FAILED assert(r == 0)
    cinder-backup[29383]: ceph version 13.2.2 (02899bfda814146b021136e9d8e80eba494e1126) mimic (stable)
    cinder-backup[29383]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x102) [0x7f35903440f2]
    cinder-backup[29383]: 2: (()+0x3162b7) [0x7f35903442b7]
    cinder-backup[29383]: 3: (Mutex::Lock(bool)+0x1de) [0x7f359031901e]
    cinder-backup[29383]: 4: (()+0x8f452) [0x7f358dafc452]
    cinder-backup[29383]: 5: (()+0x11280d) [0x7f358db7f80d]
    cinder-backup[29383]: 6: (rbd_snap_get_namespace_type()+0x29) [0x7f358dacf549]

    The lock being tried to acquire and the object that contained it have
    already been destroyed by closing the image. The assertion terminates
    the cinder-backup service via SIGABRT.

    On Ceph luminous we've seen occasional segfaults of the cinder-backup
    service, which might have the same underlying cause.

    Closes-Bug: #1838691

    Change-Id: If6043d82cc57d9247a290816d90b95cdf719eaac
    Signed-off-by: Sven Wegener <email address hidden>
    (cherry picked from commit 76569672599eda764f946ad6ee2ce0bdaddad36b)

tags: added: in-stable-stein
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to cinder (stable/rocky)

Reviewed: https://review.opendev.org/676211
Committed: https://git.openstack.org/cgit/openstack/cinder/commit/?id=57b127459189e39e993426f8e401e288f6394d4b
Submitter: Zuul
Branch: stable/rocky

commit 57b127459189e39e993426f8e401e288f6394d4b
Author: Sven Wegener <email address hidden>
Date: Fri Dec 14 12:56:49 2018 +0100

    Fix ceph: only close rbd image after snapshot iteration is finished

    list_snaps() returns an iterator object that requires resources from the
    Image object. Closing the Image object deallocates these resources.

    On Ceph mimic, which contains changes to the functions being invoked,
    iterating over the snapshots of a closed image results in the following
    assertion being triggered:

    cinder-backup[29383]: /build/ceph-13.2.2/src/common/Mutex.cc: In function 'void Mutex::Lock(bool)' thread 7f35a4812700 time 2018-12-14 10:10:49.843120
    cinder-backup[29383]: /build/ceph-13.2.2/src/common/Mutex.cc: 110: FAILED assert(r == 0)
    cinder-backup[29383]: ceph version 13.2.2 (02899bfda814146b021136e9d8e80eba494e1126) mimic (stable)
    cinder-backup[29383]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x102) [0x7f35903440f2]
    cinder-backup[29383]: 2: (()+0x3162b7) [0x7f35903442b7]
    cinder-backup[29383]: 3: (Mutex::Lock(bool)+0x1de) [0x7f359031901e]
    cinder-backup[29383]: 4: (()+0x8f452) [0x7f358dafc452]
    cinder-backup[29383]: 5: (()+0x11280d) [0x7f358db7f80d]
    cinder-backup[29383]: 6: (rbd_snap_get_namespace_type()+0x29) [0x7f358dacf549]

    The lock being tried to acquire and the object that contained it have
    already been destroyed by closing the image. The assertion terminates
    the cinder-backup service via SIGABRT.

    On Ceph luminous we've seen occasional segfaults of the cinder-backup
    service, which might have the same underlying cause.

    Closes-Bug: #1838691

    Change-Id: If6043d82cc57d9247a290816d90b95cdf719eaac
    Signed-off-by: Sven Wegener <email address hidden>
    (cherry picked from commit 76569672599eda764f946ad6ee2ce0bdaddad36b)
    (cherry picked from commit e78b220f448c7eb0de35aafd1d49b00547384d41)

tags: added: in-stable-rocky
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/cinder 15.0.0.0rc1

This issue was fixed in the openstack/cinder 15.0.0.0rc1 release candidate.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/cinder 14.0.2

This issue was fixed in the openstack/cinder 14.0.2 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/cinder 13.0.7

This issue was fixed in the openstack/cinder 13.0.7 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to cinder (stable/queens)

Reviewed: https://review.opendev.org/676272
Committed: https://git.openstack.org/cgit/openstack/cinder/commit/?id=9e5d33ac244e8dce31ff6d2c7119ee4bd53a9908
Submitter: Zuul
Branch: stable/queens

commit 9e5d33ac244e8dce31ff6d2c7119ee4bd53a9908
Author: Sven Wegener <email address hidden>
Date: Fri Dec 14 12:56:49 2018 +0100

    Fix ceph: only close rbd image after snapshot iteration is finished

    list_snaps() returns an iterator object that requires resources from the
    Image object. Closing the Image object deallocates these resources.

    On Ceph mimic, which contains changes to the functions being invoked,
    iterating over the snapshots of a closed image results in the following
    assertion being triggered:

    cinder-backup[29383]: /build/ceph-13.2.2/src/common/Mutex.cc: In function 'void Mutex::Lock(bool)' thread 7f35a4812700 time 2018-12-14 10:10:49.843120
    cinder-backup[29383]: /build/ceph-13.2.2/src/common/Mutex.cc: 110: FAILED assert(r == 0)
    cinder-backup[29383]: ceph version 13.2.2 (02899bfda814146b021136e9d8e80eba494e1126) mimic (stable)
    cinder-backup[29383]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x102) [0x7f35903440f2]
    cinder-backup[29383]: 2: (()+0x3162b7) [0x7f35903442b7]
    cinder-backup[29383]: 3: (Mutex::Lock(bool)+0x1de) [0x7f359031901e]
    cinder-backup[29383]: 4: (()+0x8f452) [0x7f358dafc452]
    cinder-backup[29383]: 5: (()+0x11280d) [0x7f358db7f80d]
    cinder-backup[29383]: 6: (rbd_snap_get_namespace_type()+0x29) [0x7f358dacf549]

    The lock being tried to acquire and the object that contained it have
    already been destroyed by closing the image. The assertion terminates
    the cinder-backup service via SIGABRT.

    On Ceph luminous we've seen occasional segfaults of the cinder-backup
    service, which might have the same underlying cause.

    Closes-Bug: #1838691

    Change-Id: If6043d82cc57d9247a290816d90b95cdf719eaac
    Signed-off-by: Sven Wegener <email address hidden>
    (cherry picked from commit 76569672599eda764f946ad6ee2ce0bdaddad36b)
    (cherry picked from commit e78b220f448c7eb0de35aafd1d49b00547384d41)
    (cherry picked from commit 57b127459189e39e993426f8e401e288f6394d4b)

tags: added: in-stable-queens
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to cinder (stable/pike)

Reviewed: https://review.opendev.org/676273
Committed: https://git.openstack.org/cgit/openstack/cinder/commit/?id=0fdff12b260550190be01c59080a8be0c109db28
Submitter: Zuul
Branch: stable/pike

commit 0fdff12b260550190be01c59080a8be0c109db28
Author: Sven Wegener <email address hidden>
Date: Fri Dec 14 12:56:49 2018 +0100

    Fix ceph: only close rbd image after snapshot iteration is finished

    list_snaps() returns an iterator object that requires resources from the
    Image object. Closing the Image object deallocates these resources.

    On Ceph mimic, which contains changes to the functions being invoked,
    iterating over the snapshots of a closed image results in the following
    assertion being triggered:

    cinder-backup[29383]: /build/ceph-13.2.2/src/common/Mutex.cc: In function 'void Mutex::Lock(bool)' thread 7f35a4812700 time 2018-12-14 10:10:49.843120
    cinder-backup[29383]: /build/ceph-13.2.2/src/common/Mutex.cc: 110: FAILED assert(r == 0)
    cinder-backup[29383]: ceph version 13.2.2 (02899bfda814146b021136e9d8e80eba494e1126) mimic (stable)
    cinder-backup[29383]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x102) [0x7f35903440f2]
    cinder-backup[29383]: 2: (()+0x3162b7) [0x7f35903442b7]
    cinder-backup[29383]: 3: (Mutex::Lock(bool)+0x1de) [0x7f359031901e]
    cinder-backup[29383]: 4: (()+0x8f452) [0x7f358dafc452]
    cinder-backup[29383]: 5: (()+0x11280d) [0x7f358db7f80d]
    cinder-backup[29383]: 6: (rbd_snap_get_namespace_type()+0x29) [0x7f358dacf549]

    The lock being tried to acquire and the object that contained it have
    already been destroyed by closing the image. The assertion terminates
    the cinder-backup service via SIGABRT.

    On Ceph luminous we've seen occasional segfaults of the cinder-backup
    service, which might have the same underlying cause.

    Closes-Bug: #1838691

    Change-Id: If6043d82cc57d9247a290816d90b95cdf719eaac
    Signed-off-by: Sven Wegener <email address hidden>
    (cherry picked from commit 76569672599eda764f946ad6ee2ce0bdaddad36b)
    (cherry picked from commit e78b220f448c7eb0de35aafd1d49b00547384d41)
    (cherry picked from commit 57b127459189e39e993426f8e401e288f6394d4b)
    (cherry picked from commit 9e5d33ac244e8dce31ff6d2c7119ee4bd53a9908)

tags: added: in-stable-pike
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to cinder (stable/ocata)

Reviewed: https://review.opendev.org/676274
Committed: https://git.openstack.org/cgit/openstack/cinder/commit/?id=a2e79da5e18b2e65e56d1dead5c0aba03415b45f
Submitter: Zuul
Branch: stable/ocata

commit a2e79da5e18b2e65e56d1dead5c0aba03415b45f
Author: Sven Wegener <email address hidden>
Date: Fri Dec 14 12:56:49 2018 +0100

    Fix ceph: only close rbd image after snapshot iteration is finished

    list_snaps() returns an iterator object that requires resources from the
    Image object. Closing the Image object deallocates these resources.

    On Ceph mimic, which contains changes to the functions being invoked,
    iterating over the snapshots of a closed image results in the following
    assertion being triggered:

    cinder-backup[29383]: /build/ceph-13.2.2/src/common/Mutex.cc: In function 'void Mutex::Lock(bool)' thread 7f35a4812700 time 2018-12-14 10:10:49.843120
    cinder-backup[29383]: /build/ceph-13.2.2/src/common/Mutex.cc: 110: FAILED assert(r == 0)
    cinder-backup[29383]: ceph version 13.2.2 (02899bfda814146b021136e9d8e80eba494e1126) mimic (stable)
    cinder-backup[29383]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x102) [0x7f35903440f2]
    cinder-backup[29383]: 2: (()+0x3162b7) [0x7f35903442b7]
    cinder-backup[29383]: 3: (Mutex::Lock(bool)+0x1de) [0x7f359031901e]
    cinder-backup[29383]: 4: (()+0x8f452) [0x7f358dafc452]
    cinder-backup[29383]: 5: (()+0x11280d) [0x7f358db7f80d]
    cinder-backup[29383]: 6: (rbd_snap_get_namespace_type()+0x29) [0x7f358dacf549]

    The lock being tried to acquire and the object that contained it have
    already been destroyed by closing the image. The assertion terminates
    the cinder-backup service via SIGABRT.

    On Ceph luminous we've seen occasional segfaults of the cinder-backup
    service, which might have the same underlying cause.

    Closes-Bug: #1838691

    Change-Id: If6043d82cc57d9247a290816d90b95cdf719eaac
    Signed-off-by: Sven Wegener <email address hidden>
    (cherry picked from commit 76569672599eda764f946ad6ee2ce0bdaddad36b)
    (cherry picked from commit e78b220f448c7eb0de35aafd1d49b00547384d41)
    (cherry picked from commit 57b127459189e39e993426f8e401e288f6394d4b)
    (cherry picked from commit 9e5d33ac244e8dce31ff6d2c7119ee4bd53a9908)
    (cherry picked from commit 0fdff12b260550190be01c59080a8be0c109db28)

tags: added: in-stable-ocata
James Page (james-page)
Changed in cinder (Ubuntu Eoan):
status: New → Fix Released
importance: Undecided → High
Changed in cinder (Ubuntu Disco):
status: New → Triaged
importance: Undecided → High
Revision history for this message
James Page (james-page) wrote :

Ubuntu SRU information

[Impact]
Unable to create backups of ceph volumes via cinder.

[Test Case]
<Deploy OpenStack using charms>
openstack volume create --size 5 testvolume
openstack volume backup create testvolume
openstack volume backup create testvolume
openstack volume backup create testvolume

at least one backup will go into error status.

[Regression Potential]
Part of the 13.0.7 stable release from upstream openstack so low regression potential.

Revision history for this message
James Page (james-page) wrote :

Test packages for Bionic/Rocky (UCA):

ppa:james-page/rocky

Revision history for this message
James Page (james-page) wrote : Please test proposed package

Hello Sofia, or anyone else affected,

Accepted cinder into rocky-proposed. The package will build now and be available in the Ubuntu Cloud Archive in a few hours, and then in the -proposed repository.

Please help us by testing this new package. To enable the -proposed repository:

  sudo add-apt-repository cloud-archive:rocky-proposed
  sudo apt-get update

Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-rocky-needed to verification-rocky-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-rocky-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

Revision history for this message
James Page (james-page) wrote : Update Released

The verification of the Stable Release Update for cinder has completed successfully and the package has now been released to -updates. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

Revision history for this message
James Page (james-page) wrote :

This bug was fixed in the package cinder - 2:13.0.7-0ubuntu1~cloud0
---------------

 cinder (2:13.0.7-0ubuntu1~cloud0) bionic; urgency=medium
 .
   * New upstream point release for OpenStack Rocky (LP: #1848153):
     - Includes fix for issue with cinder-backup/ceph (LP: #1838691).
     - d/p/*: Drop all patches as included in release or not used.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/cinder 12.0.10

This issue was fixed in the openstack/cinder 12.0.10 release.

Revision history for this message
Łukasz Zemczak (sil2100) wrote : Please test proposed package

Hello Sofia, or anyone else affected,

Accepted cinder into disco-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/cinder/2:14.0.2-0ubuntu1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-disco to verification-done-disco. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-disco. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Changed in cinder (Ubuntu Disco):
status: Triaged → Fix Committed
tags: added: verification-needed verification-needed-disco
Revision history for this message
Ubuntu SRU Bot (ubuntu-sru-bot) wrote : Autopkgtest regression report (cinder/2:14.0.2-0ubuntu1)

All autopkgtests for the newly accepted cinder (2:14.0.2-0ubuntu1) for disco have finished running.
The following regressions have been reported in tests triggered by the package:

cinder/2:14.0.2-0ubuntu1 (armhf)

Please visit the excuses page listed below and investigate the failures, proceeding afterwards as per the StableReleaseUpdates policy regarding autopkgtest regressions [1].

https://people.canonical.com/~ubuntu-archive/proposed-migration/disco/update_excuses.html#cinder

[1] https://wiki.ubuntu.com/StableReleaseUpdates#Autopkgtest_Regressions

Thank you!

Revision history for this message
Corey Bryant (corey.bryant) wrote : Please test proposed package

Hello Sofia, or anyone else affected,

Accepted cinder into stein-proposed. The package will build now and be available in the Ubuntu Cloud Archive in a few hours, and then in the -proposed repository.

Please help us by testing this new package. To enable the -proposed repository:

  sudo add-apt-repository cloud-archive:stein-proposed
  sudo apt-get update

Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-stein-needed to verification-stein-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-stein-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

tags: added: verification-stein-needed
Revision history for this message
Chris Halse Rogers (raof) wrote :

Waiting for verification on this bug is blocking a release of cinder into disco-proposed; the autopkgtest regression seen earlier appears to have been resolved. Please verify this bug is fixed so we can release it to users :)

Revision history for this message
Sofia Enriquez (lsofia-enriquez) wrote :

Hi Chris, I've tried the fix in fedora/centos and Devstack environment and it fix the problem. Sadly, I don't have access to an instance with Ubuntu Cloud to try your package.

Revision history for this message
Corey Bryant (corey.bryant) wrote :

Since disco is EOL this month, we can work this through the stein cloud archive.

Changed in cinder (Ubuntu Disco):
status: Fix Committed → Won't Fix
Revision history for this message
Corey Bryant (corey.bryant) wrote :

Verified successfully on stein-proposed:

$ juju ssh cinder/0 apt policy cinder-common
cinder-common:
  Installed: 2:14.0.2-0ubuntu1~cloud0
  Candidate: 2:14.0.2-0ubuntu1~cloud0
  Version table:
 *** 2:14.0.2-0ubuntu1~cloud0 500
        500 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 Packages

$ openstack volume list
+--------------------------------------+------+-----------+------+-----------------------------+
| ID | Name | Status | Size | Attached to |
+--------------------------------------+------+-----------+------+-----------------------------+
| 41b29ac2-c580-444c-ba65-17d016fb136f | v2 | available | 5 | |
| 760b2fe5-bfa3-4ec6-964d-6fd05ccba3b0 | v1 | in-use | 1 | Attached to x1 on /dev/vdb |
+--------------------------------------+------+-----------+------+-----------------------------+

$ openstack volume backup create v2
$ openstack volume backup create v2
$ openstack volume backup create v2

$ openstack volume backup list
+--------------------------------------+------+-------------+-----------+------+
| ID | Name | Description | Status | Size |
+--------------------------------------+------+-------------+-----------+------+
| 2d2d2aa8-f3ef-4b1b-b3a4-8f187369e632 | None | None | available | 5 |
| 5892fc21-ac63-4e78-979d-9145b8c67db2 | None | None | available | 5 |
| 1bf0f9ab-b6b7-4cca-a46a-55853ec7f204 | None | None | available | 5 |
+--------------------------------------+------+-------------+-----------+------+

tags: added: verification-stein-done
removed: verification-stein-needed
Revision history for this message
Corey Bryant (corey.bryant) wrote : Update Released

The verification of the Stable Release Update for cinder has completed successfully and the package has now been released to -updates. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

Revision history for this message
Corey Bryant (corey.bryant) wrote :

This bug was fixed in the package cinder - 2:14.0.2-0ubuntu1~cloud0
---------------

 cinder (2:14.0.2-0ubuntu1~cloud0) bionic-stein; urgency=medium
 .
   * New upstream release for the Ubuntu Cloud Archive.
 .
 cinder (2:14.0.2-0ubuntu1) disco; urgency=medium
 .
   * New upstream point release for OpenStack Stein (LP: #1849192):
     - Includes fix for SIGABRT in cinder-backup/ceph (LP: #1838691).
     - d/p/Fix-DetachedInstanceError-for-VolumeAttachment.patch: Drop,
       included in release.
 .
 cinder (2:14.0.1-0ubuntu3) disco; urgency=medium
 .
   * d/tests/cinder-daemons: As of disco, sqlalchemy defaults to mysqldb so
     we must override the driver to use pymysql (LP: #1845321).
 .
 cinder (2:14.0.1-0ubuntu2) disco; urgency=medium
 .
   * d/p/Fix-DetachedInstanceError-for-VolumeAttachment.patch: Cherry
     pick fix for issue with DetachedInstanceError being generated due
     to compatibility issues with SQLAlchemy (LP: #1834845)

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.