| 2021-10-17 19:47:58 |
Radosław Piliszek |
bug |
|
|
added bug |
| 2021-10-18 08:01:03 |
Radosław Piliszek |
description |
Bug summary:
Cinder started requiring write access to glance images RBD pool (on creating volume from image).
See the log excerpt at the report's bottom for the error message.
Identified cause:
I identified the following change as introducing this issue.
"RBD: use correct stripe unit in clone operation"
Change-Id: Iec111ab83e9ed8182c9679c911e3d90927d5a7c3
https://review.opendev.org/c/openstack/cinder/+/786260
Unfortunately, it has been backported back to Train and broke stable deployments. :-(
The `self.rbd.Image` invocation requires write privileges to the image's pool.
This goes against the recommended caps set: https://docs.ceph.com/en/pacific/rbd/rbd-openstack/
The workaround is to revert the change or temporarily set the write access as allowed for Cinder.
QA suggestions:
Ensure that cinder backend is tested with the recommended caps (images read-only).
Log excerpt:
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.7/site-packages/cinder/volume/flows/manager/create_volume.py", line 1032, in _create_from_image
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server image_service)
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.7/site-packages/cinder/volume/drivers/rbd.py", line 1584, in clone_image
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server volume_update = self._clone(volume, pool, image, snapshot)
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.7/site-packages/cinder/volume/drivers/rbd.py", line 1034, in _clone
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server stripe_unit = self._get_stripe_unit(src_client.ioctx, src_image)
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.7/site-packages/cinder/volume/drivers/rbd.py", line 1018, in _get_stripe_unit
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server image = self.rbd.Image(ioctx, volume_name)
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "rbd.pyx", line 2960, in rbd.Image.__init__
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server rbd.PermissionError: [errno 1] error opening image b'XXX' at snapshot None |
Bug summary:
Cinder started requiring write access to glance images RBD pool (on creating volume from image).
See the log excerpt at the report's bottom for the error message.
Identified cause:
I identified the following change as introducing this issue.
"RBD: use correct stripe unit in clone operation"
Change-Id: Iec111ab83e9ed8182c9679c911e3d90927d5a7c3
https://review.opendev.org/c/openstack/cinder/+/786260
Unfortunately, it has been backported back to Train and broke stable deployments. :-(
The `self.rbd.Image` invocation requires write privileges to the image's pool.
This goes against the recommended caps set: https://docs.ceph.com/en/pacific/rbd/rbd-openstack/
The workaround is to revert the change or temporarily set the write access as allowed for Cinder.
Tested versions:
Cinder Victoria
Ceph Nautilus
QA suggestions:
Ensure that cinder backend is tested with the recommended caps (images read-only).
Log excerpt:
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.7/site-packages/cinder/volume/flows/manager/create_volume.py", line 1032, in _create_from_image
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server image_service)
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.7/site-packages/cinder/volume/drivers/rbd.py", line 1584, in clone_image
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server volume_update = self._clone(volume, pool, image, snapshot)
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.7/site-packages/cinder/volume/drivers/rbd.py", line 1034, in _clone
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server stripe_unit = self._get_stripe_unit(src_client.ioctx, src_image)
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.7/site-packages/cinder/volume/drivers/rbd.py", line 1018, in _get_stripe_unit
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server image = self.rbd.Image(ioctx, volume_name)
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "rbd.pyx", line 2960, in rbd.Image.__init__
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server rbd.PermissionError: [errno 1] error opening image b'XXX' at snapshot None |
|
| 2021-10-18 08:39:19 |
Radosław Piliszek |
description |
Bug summary:
Cinder started requiring write access to glance images RBD pool (on creating volume from image).
See the log excerpt at the report's bottom for the error message.
Identified cause:
I identified the following change as introducing this issue.
"RBD: use correct stripe unit in clone operation"
Change-Id: Iec111ab83e9ed8182c9679c911e3d90927d5a7c3
https://review.opendev.org/c/openstack/cinder/+/786260
Unfortunately, it has been backported back to Train and broke stable deployments. :-(
The `self.rbd.Image` invocation requires write privileges to the image's pool.
This goes against the recommended caps set: https://docs.ceph.com/en/pacific/rbd/rbd-openstack/
The workaround is to revert the change or temporarily set the write access as allowed for Cinder.
Tested versions:
Cinder Victoria
Ceph Nautilus
QA suggestions:
Ensure that cinder backend is tested with the recommended caps (images read-only).
Log excerpt:
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.7/site-packages/cinder/volume/flows/manager/create_volume.py", line 1032, in _create_from_image
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server image_service)
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.7/site-packages/cinder/volume/drivers/rbd.py", line 1584, in clone_image
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server volume_update = self._clone(volume, pool, image, snapshot)
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.7/site-packages/cinder/volume/drivers/rbd.py", line 1034, in _clone
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server stripe_unit = self._get_stripe_unit(src_client.ioctx, src_image)
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.7/site-packages/cinder/volume/drivers/rbd.py", line 1018, in _get_stripe_unit
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server image = self.rbd.Image(ioctx, volume_name)
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "rbd.pyx", line 2960, in rbd.Image.__init__
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server rbd.PermissionError: [errno 1] error opening image b'XXX' at snapshot None |
Bug summary:
Cinder started requiring write access to glance images RBD pool (on creating volume from image).
See the log excerpt at the report's bottom for the error message.
Identified cause:
I identified the following change as introducing this issue.
"RBD: use correct stripe unit in clone operation"
Change-Id: Iec111ab83e9ed8182c9679c911e3d90927d5a7c3
https://review.opendev.org/c/openstack/cinder/+/786260
Unfortunately, it has been backported back to Train and broke stable deployments. :-(
The `self.rbd.Image` invocation requires write privileges to the image's pool.
This goes against the recommended caps set: https://docs.ceph.com/en/pacific/rbd/rbd-openstack/
The workaround is to revert the change or temporarily set the write access as allowed for Cinder.
Tested versions:
Cinder Victoria
Ceph Nautilus
QA suggestions:
Ensure that cinder backend is tested with the recommended caps (images read-only).
Ensure that a raw image is tested (the default qcow2 image of cirros gets copied, not cloned).
Log excerpt:
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.7/site-packages/cinder/volume/flows/manager/create_volume.py", line 1032, in _create_from_image
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server image_service)
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.7/site-packages/cinder/volume/drivers/rbd.py", line 1584, in clone_image
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server volume_update = self._clone(volume, pool, image, snapshot)
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.7/site-packages/cinder/volume/drivers/rbd.py", line 1034, in _clone
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server stripe_unit = self._get_stripe_unit(src_client.ioctx, src_image)
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.7/site-packages/cinder/volume/drivers/rbd.py", line 1018, in _get_stripe_unit
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server image = self.rbd.Image(ioctx, volume_name)
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "rbd.pyx", line 2960, in rbd.Image.__init__
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server rbd.PermissionError: [errno 1] error opening image b'XXX' at snapshot None |
|
| 2021-10-18 18:59:10 |
Radosław Piliszek |
description |
Bug summary:
Cinder started requiring write access to glance images RBD pool (on creating volume from image).
See the log excerpt at the report's bottom for the error message.
Identified cause:
I identified the following change as introducing this issue.
"RBD: use correct stripe unit in clone operation"
Change-Id: Iec111ab83e9ed8182c9679c911e3d90927d5a7c3
https://review.opendev.org/c/openstack/cinder/+/786260
Unfortunately, it has been backported back to Train and broke stable deployments. :-(
The `self.rbd.Image` invocation requires write privileges to the image's pool.
This goes against the recommended caps set: https://docs.ceph.com/en/pacific/rbd/rbd-openstack/
The workaround is to revert the change or temporarily set the write access as allowed for Cinder.
Tested versions:
Cinder Victoria
Ceph Nautilus
QA suggestions:
Ensure that cinder backend is tested with the recommended caps (images read-only).
Ensure that a raw image is tested (the default qcow2 image of cirros gets copied, not cloned).
Log excerpt:
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.7/site-packages/cinder/volume/flows/manager/create_volume.py", line 1032, in _create_from_image
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server image_service)
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.7/site-packages/cinder/volume/drivers/rbd.py", line 1584, in clone_image
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server volume_update = self._clone(volume, pool, image, snapshot)
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.7/site-packages/cinder/volume/drivers/rbd.py", line 1034, in _clone
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server stripe_unit = self._get_stripe_unit(src_client.ioctx, src_image)
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.7/site-packages/cinder/volume/drivers/rbd.py", line 1018, in _get_stripe_unit
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server image = self.rbd.Image(ioctx, volume_name)
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "rbd.pyx", line 2960, in rbd.Image.__init__
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server rbd.PermissionError: [errno 1] error opening image b'XXX' at snapshot None |
Bug summary:
Cinder started requiring write access to glance images RBD pool (on creating volume from image).
See the log excerpt at the report's bottom for the error message.
Identified cause:
I identified the following change as introducing this issue.
"RBD: use correct stripe unit in clone operation"
Change-Id: Iec111ab83e9ed8182c9679c911e3d90927d5a7c3
https://review.opendev.org/c/openstack/cinder/+/786260
Unfortunately, it has been backported back to Train and broke stable deployments. :-(
The `self.rbd.Image` invocation requires write privileges to the image's pool.
This goes against the recommended caps set: https://docs.ceph.com/en/pacific/rbd/rbd-openstack/
The workaround is to revert the change or temporarily set the write access as allowed for Cinder.
Tested versions:
Cinder Victoria + Ceph Nautilus
Cinder Xena + Ceph Octopus
QA suggestions:
Ensure that cinder backend is tested with the recommended caps (images read-only).
Ensure that a raw image is tested (the default qcow2 image of cirros gets copied, not cloned).
Log excerpt:
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.7/site-packages/cinder/volume/flows/manager/create_volume.py", line 1032, in _create_from_image
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server image_service)
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.7/site-packages/cinder/volume/drivers/rbd.py", line 1584, in clone_image
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server volume_update = self._clone(volume, pool, image, snapshot)
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.7/site-packages/cinder/volume/drivers/rbd.py", line 1034, in _clone
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server stripe_unit = self._get_stripe_unit(src_client.ioctx, src_image)
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.7/site-packages/cinder/volume/drivers/rbd.py", line 1018, in _get_stripe_unit
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server image = self.rbd.Image(ioctx, volume_name)
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server File "rbd.pyx", line 2960, in rbd.Image.__init__
2021-10-17 19:58:58.820 28 ERROR oslo_messaging.rpc.server rbd.PermissionError: [errno 1] error opening image b'XXX' at snapshot None |
|
| 2021-10-18 18:59:21 |
Radosław Piliszek |
cinder: status |
New |
Confirmed |
|
| 2021-10-26 22:22:04 |
Sofia Enriquez |
cinder: importance |
Undecided |
Medium |
|
| 2021-10-26 22:36:05 |
Sofia Enriquez |
summary |
Cinder started requiring write access to glance images RBD pool |
[RBD] Cinder started requiring write access to glance images RBD pool |
|
| 2021-10-27 15:05:42 |
Eric Harney |
cinder: assignee |
|
Eric Harney (eharney) |
|
| 2021-10-27 15:12:38 |
OpenStack Infra |
cinder: status |
Confirmed |
In Progress |
|
| 2021-10-28 12:25:30 |
Eric Harney |
cinder: importance |
Medium |
High |
|
| 2021-11-08 06:37:16 |
OpenStack Infra |
cinder: status |
In Progress |
Fix Released |
|
| 2021-11-09 16:12:11 |
OpenStack Infra |
tags |
cinder glance rbd |
cinder glance in-stable-xena rbd |
|
| 2021-11-09 21:14:54 |
OpenStack Infra |
tags |
cinder glance in-stable-xena rbd |
cinder glance in-stable-wallaby in-stable-xena rbd |
|
| 2021-11-10 22:58:14 |
OpenStack Infra |
tags |
cinder glance in-stable-wallaby in-stable-xena rbd |
cinder glance in-stable-victoria in-stable-wallaby in-stable-xena rbd |
|
| 2021-11-11 14:38:33 |
OpenStack Infra |
tags |
cinder glance in-stable-victoria in-stable-wallaby in-stable-xena rbd |
cinder glance in-stable-ussuri in-stable-victoria in-stable-wallaby in-stable-xena rbd |
|
| 2021-12-17 19:04:14 |
OpenStack Infra |
tags |
cinder glance in-stable-ussuri in-stable-victoria in-stable-wallaby in-stable-xena rbd |
cinder glance in-stable-train in-stable-ussuri in-stable-victoria in-stable-wallaby in-stable-xena rbd |
|
| 2022-05-31 13:25:15 |
Christian Rohmann |
bug |
|
|
added subscriber Christian Rohmann |
| 2022-05-31 14:54:07 |
Christian Rohmann |
bug |
|
|
added subscriber Waldemar Reger |
| 2022-05-31 14:54:31 |
Christian Rohmann |
bug |
|
|
added subscriber Hannes von Haugwitz |
| 2022-06-01 08:38:08 |
Christian Rohmann |
bug task added |
|
ubuntu |
|
| 2022-06-01 08:38:49 |
Christian Rohmann |
affects |
ubuntu |
cloud-archive |
|
| 2022-06-01 17:48:15 |
Corey Bryant |
nominated for series |
|
cloud-archive/ussuri |
|
| 2022-06-01 17:48:15 |
Corey Bryant |
bug task added |
|
cloud-archive/ussuri |
|
| 2022-06-01 17:48:33 |
Corey Bryant |
nominated for series |
|
cloud-archive/wallaby |
|
| 2022-06-01 17:48:33 |
Corey Bryant |
bug task added |
|
cloud-archive/wallaby |
|
| 2022-06-01 17:48:33 |
Corey Bryant |
nominated for series |
|
cloud-archive/xena |
|
| 2022-06-01 17:48:33 |
Corey Bryant |
bug task added |
|
cloud-archive/xena |
|
| 2022-06-01 17:48:33 |
Corey Bryant |
nominated for series |
|
cloud-archive/yoga |
|
| 2022-06-01 17:48:33 |
Corey Bryant |
bug task added |
|
cloud-archive/yoga |
|
| 2022-06-01 17:48:33 |
Corey Bryant |
nominated for series |
|
cloud-archive/zed |
|
| 2022-06-01 17:48:33 |
Corey Bryant |
bug task added |
|
cloud-archive/zed |
|
| 2022-06-01 17:48:33 |
Corey Bryant |
nominated for series |
|
cloud-archive/victoria |
|
| 2022-06-01 17:48:33 |
Corey Bryant |
bug task added |
|
cloud-archive/victoria |
|
| 2022-06-01 17:48:41 |
Corey Bryant |
cloud-archive/ussuri: status |
New |
Fix Released |
|
| 2022-06-01 17:49:07 |
Corey Bryant |
cloud-archive/wallaby: status |
New |
Fix Released |
|
| 2022-06-01 17:53:20 |
Corey Bryant |
cloud-archive/xena: status |
New |
Triaged |
|
| 2022-06-01 17:53:22 |
Corey Bryant |
cloud-archive/xena: importance |
Undecided |
High |
|
| 2022-06-01 17:54:06 |
Corey Bryant |
cloud-archive/yoga: status |
New |
Fix Released |
|
| 2022-06-01 17:54:15 |
Corey Bryant |
cloud-archive/zed: status |
New |
Fix Released |
|
| 2022-06-01 17:58:42 |
Corey Bryant |
cloud-archive/victoria: status |
New |
Triaged |
|
| 2022-06-01 17:58:45 |
Corey Bryant |
cloud-archive/victoria: importance |
Undecided |
High |
|
| 2022-06-01 20:58:01 |
Corey Bryant |
cloud-archive/victoria: status |
Triaged |
Fix Committed |
|
| 2022-07-18 18:51:22 |
Corey Bryant |
cloud-archive/victoria: status |
Fix Committed |
Fix Released |
|
| 2022-07-18 18:51:25 |
Corey Bryant |
cloud-archive/xena: status |
Triaged |
Fix Released |
|
