CI: cinder-backup reports errors in the cinder-lvm scenario

Bug #1847049 reported by Radosław Piliszek
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
kolla-ansible
Fix Released
Medium
Michal Nasiadka

Bug Description

/var/log/kolla/cinder/cinder-backup.log
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall [-] Fixed interval looping call 'cinder.backup.manager.BackupManager._setup_backup_driver' failed: rados.ObjectNotFound: [errno 2] error calling conf_read_file
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall Traceback (most recent call last):
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_service/loopingcall.py", line 150, in _run_loop
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall result = func(*self.args, **self.kw)
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall File "/var/lib/kolla/venv/lib/python3.6/site-packages/cinder/backup/manager.py", line 163, in _setup_backup_driver
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall backup_service.check_for_setup_error()
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall File "/var/lib/kolla/venv/lib/python3.6/site-packages/cinder/backup/drivers/ceph.py", line 294, in check_for_setup_error
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall with rbd_driver.RADOSClient(self, self._ceph_backup_pool):
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall File "/var/lib/kolla/venv/lib/python3.6/site-packages/cinder/volume/drivers/rbd.py", line 195, in __init__
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall self.cluster, self.ioctx = driver._connect_to_rados(pool)
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall File "/var/lib/kolla/venv/lib/python3.6/site-packages/cinder/backup/drivers/ceph.py", line 301, in _connect_to_rados
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall conffile=self._ceph_backup_conf))
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall File "rados.pyx", line 617, in rados.Rados.__init__
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall File "rados.pyx", line 508, in rados.requires.wrapper.validate_func
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall File "rados.pyx", line 668, in rados.Rados.__setup
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall File "rados.pyx", line 508, in rados.requires.wrapper.validate_func
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall File "rados.pyx", line 731, in rados.Rados.conf_read_file
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall rados.ObjectNotFound: [errno 2] error calling conf_read_file
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall
2019-10-07 06:38:01.584 18 ERROR cinder.service [-] Manager for service cinder-backup primary is reporting problems, not sending heartbeat. Service will appear "down".

Changed in kolla-ansible:
assignee: nobody → Michal Nasiadka (mnasiadka)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla-ansible (master)

Fix proposed to branch: master
Review: https://review.opendev.org/691289

Changed in kolla-ansible:
status: Triaged → In Progress
Revision history for this message
Radosław Piliszek (yoctozepto) wrote :
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla-ansible (master)

Reviewed: https://review.opendev.org/691289
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=df0c64ed32b8d83304541fac4f02973682f5cb57
Submitter: Zuul
Branch: master

commit df0c64ed32b8d83304541fac4f02973682f5cb57
Author: Michal Nasiadka <email address hidden>
Date: Fri Oct 25 13:19:01 2019 +0200

    Disable cinder-backup in cinder-lvm scenario

    cinder-backup[1] does not include an lvm driver, we could use posix
    filesystem driver - but it's not supported in kolla-ansible currently.

    [1]: https://docs.openstack.org/cinder/rocky/drivers.html#backup-drivers

    Change-Id: I847a55692a59c52990186332388f571a04c377b7
    Closes-Bug: #1847049

Changed in kolla-ansible:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla-ansible 9.0.0.0rc1

This issue was fixed in the openstack/kolla-ansible 9.0.0.0rc1 release candidate.

Revision history for this message
Bob Lane (anustsn) wrote :

This issue still exists in ussuri version. How this was fixed?

Revision history for this message
Radosław Piliszek (yoctozepto) wrote :

Hi Bob, this issue was in our CI (Continuous Integration) jobs.
Cinder Backup does not offer the LVM backend, possibly due to low reliability while one expects backups to be more reliable.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.