CI: cinder-backup reports errors in the cinder-lvm scenario

[Radosław Piliszek]

/var/log/kolla/cinder/cinder-backup.log
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall [-] Fixed interval looping call 'cinder.backup.manager.BackupManager._setup_backup_driver' failed: rados.ObjectNotFound: [errno 2] error calling conf_read_file
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall Traceback (most recent call last):
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_service/loopingcall.py", line 150, in _run_loop
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall result = func(*self.args, **self.kw)
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall File "/var/lib/kolla/venv/lib/python3.6/site-packages/cinder/backup/manager.py", line 163, in _setup_backup_driver
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall backup_service.check_for_setup_error()
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall File "/var/lib/kolla/venv/lib/python3.6/site-packages/cinder/backup/drivers/ceph.py", line 294, in check_for_setup_error
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall with rbd_driver.RADOSClient(self, self._ceph_backup_pool):
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall File "/var/lib/kolla/venv/lib/python3.6/site-packages/cinder/volume/drivers/rbd.py", line 195, in __init__
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall self.cluster, self.ioctx = driver._connect_to_rados(pool)
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall File "/var/lib/kolla/venv/lib/python3.6/site-packages/cinder/backup/drivers/ceph.py", line 301, in _connect_to_rados
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall conffile=self._ceph_backup_conf))
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall File "rados.pyx", line 617, in rados.Rados.__init__
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall File "rados.pyx", line 508, in rados.requires.wrapper.validate_func
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall File "rados.pyx", line 668, in rados.Rados.__setup
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall File "rados.pyx", line 508, in rados.requires.wrapper.validate_func
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall File "rados.pyx", line 731, in rados.Rados.conf_read_file
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall rados.ObjectNotFound: [errno 2] error calling conf_read_file
2019-10-07 06:37:51.321 18 ERROR oslo.service.loopingcall
2019-10-07 06:38:01.584 18 ERROR cinder.service [-] Manager for service cinder-backup primary is reporting problems, not sending heartbeat. Service will appear "down".

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/691289

[Radosław Piliszek (yoctozepto)]

We will handle it as k-a bug here: https://bugs.launchpad.net/kolla-ansible/+bug/1849827

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/691289
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=df0c64ed32b8d83304541fac4f02973682f5cb57
Submitter: Zuul
Branch: master

commit df0c64ed32b8d83304541fac4f02973682f5cb57
Author: Michal Nasiadka <email address hidden>
Date: Fri Oct 25 13:19:01 2019 +0200

    Disable cinder-backup in cinder-lvm scenario

    cinder-backup[1] does not include an lvm driver, we could use posix
    filesystem driver - but it's not supported in kolla-ansible currently.

    [1]: https://docs.openstack.org/cinder/rocky/drivers.html#backup-drivers

    Change-Id: I847a55692a59c52990186332388f571a04c377b7
    Closes-Bug: #1847049

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla-ansible 9.0.0.0rc1 release candidate.

[Bob Lane (anustsn)]

This issue still exists in ussuri version. How this was fixed?

[Radosław Piliszek (yoctozepto)]

Hi Bob, this issue was in our CI (Continuous Integration) jobs.
Cinder Backup does not offer the LVM backend, possibly due to low reliability while one expects backups to be more reliable.