| 2018-06-21 17:25:23 |
Will Szumski |
bug |
|
|
added bug |
| 2018-06-21 17:43:09 |
Will Szumski |
description |
When trying to boot an instance that makes use of a cinder cephfs volume, you get the following errors:
2018-06-21 11:29:01.454 24 ERROR nova.scheduler.utils [req-504318b7-666c-44ae-b3b8-e57388be604e aa63d0eb27bd41fbb8a7de48556a972e c90400f
36cdb434984a3c436d34630b9 - default default] [instance: 41e3cbe2-19a2-48ca-aeef-26f387d499f0] Error from last host: svn4-dr06-u7 (node s
vn4-dr06-u7): [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1840,
in _do_build_and_run_instance\n filter_properties, request_spec)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.
py", line 2117, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u"RescheduledException: Build
of instance 41e3cbe2-19a2-48ca-aeef-26f387d499f0 was re-scheduled: Secret not found: no secret with matching uuid 'b01fe2fa-46e7-48ed-8b
c0-3d078e29366d'\n"]
and:
(openstack) 1 stack@eod-seed:~/will/kayobe-env/src/kayobe$ openstack server show test -c fault -f json
{
"fault": {
"message": "Build of instance f1bceb3a-4e8a-4cc6-b775-f5fe1ec8901e aborted: Volume attachment 2e6ee797-8e27-4b7e-858f-59ec37fa998b could not be found.",
"code": 500,
"details": " File \"/usr/lib/python2.7/site-packages/nova/compute/manager.py\", line 1840, in _do_build_and_run_instance\n filter_properties, request_spec)\n File \"/usr/lib/python2.7/site-packages/nova/compute/manager.py\", line 2062, in _build_and_run_instance\n bdms=block_device_mapping)\n File \"/usr/lib/python2.7/site-packages/oslo_utils/excutils.py\", line 220, in __exit__\n self.force_reraise()\n File \"/usr/lib/python2.7/site-packages/oslo_utils/excutils.py\", line 196, in force_reraise\n six.reraise(self.type_, self.value, self.tb)\n File \"/usr/lib/python2.7/site-packages/nova/compute/manager.py\", line 2014, in _build_and_run_instance\n block_device_mapping) as resources:\n File \"/usr/lib64/python2.7/contextlib.py\", line 17, in __enter__\n return self.gen.next()\n File \"/usr/lib/python2.7/site-packages/nova/compute/manager.py\", line 2221, in _build_resources\n reason=e.format_message())\n",
"created": "2018-06-21T10:12:45Z"
}
if you haven't configured the nova cephfs backend. It should be possible to use cinder with nova without enabling this. |
When trying to boot an instance that makes use of a cinder cephfs volume, you get the following errors:
2018-06-21 11:29:01.454 24 ERROR nova.scheduler.utils [req-504318b7-666c-44ae-b3b8-e57388be604e aa63d0eb27bd41fbb8a7de48556a972e c90400f
36cdb434984a3c436d34630b9 - default default] [instance: 41e3cbe2-19a2-48ca-aeef-26f387d499f0] Error from last host: svn4-dr06-u7 (node s
vn4-dr06-u7): [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1840,
in _do_build_and_run_instance\n filter_properties, request_spec)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.
py", line 2117, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u"RescheduledException: Build
of instance 41e3cbe2-19a2-48ca-aeef-26f387d499f0 was re-scheduled: Secret not found: no secret with matching uuid '12345-6789-1011-12
13-1456789'\n"]
and:
(openstack) 1 stack@eod-seed:~/will/kayobe-env/src/kayobe$ openstack server show test -c fault -f json
{
"fault": {
"message": "Build of instance f1bceb3a-4e8a-4cc6-b775-f5fe1ec8901e aborted: Volume attachment 2e6ee797-8e27-4b7e-858f-59ec37fa998b could not be found.",
"code": 500,
"details": " File \"/usr/lib/python2.7/site-packages/nova/compute/manager.py\", line 1840, in _do_build_and_run_instance\n filter_properties, request_spec)\n File \"/usr/lib/python2.7/site-packages/nova/compute/manager.py\", line 2062, in _build_and_run_instance\n bdms=block_device_mapping)\n File \"/usr/lib/python2.7/site-packages/oslo_utils/excutils.py\", line 220, in __exit__\n self.force_reraise()\n File \"/usr/lib/python2.7/site-packages/oslo_utils/excutils.py\", line 196, in force_reraise\n six.reraise(self.type_, self.value, self.tb)\n File \"/usr/lib/python2.7/site-packages/nova/compute/manager.py\", line 2014, in _build_and_run_instance\n block_device_mapping) as resources:\n File \"/usr/lib64/python2.7/contextlib.py\", line 17, in __enter__\n return self.gen.next()\n File \"/usr/lib/python2.7/site-packages/nova/compute/manager.py\", line 2221, in _build_resources\n reason=e.format_message())\n",
"created": "2018-06-21T10:12:45Z"
}
if you haven't configured the nova cephfs backend. It should be possible to use cinder with nova without enabling this. |
|
| 2018-06-22 08:32:33 |
Mark Goddard |
summary |
cinder cephfs volumes don't work unless nova cephfs backend is enabled |
cinder ceph volumes don't work unless nova ceph backend is enabled |
|
| 2018-06-22 08:32:48 |
Mark Goddard |
summary |
cinder ceph volumes don't work unless nova ceph backend is enabled |
Cinder external ceph volumes don't work unless nova ceph backend is enabled |
|
| 2018-06-22 08:36:29 |
Mark Goddard |
description |
When trying to boot an instance that makes use of a cinder cephfs volume, you get the following errors:
2018-06-21 11:29:01.454 24 ERROR nova.scheduler.utils [req-504318b7-666c-44ae-b3b8-e57388be604e aa63d0eb27bd41fbb8a7de48556a972e c90400f
36cdb434984a3c436d34630b9 - default default] [instance: 41e3cbe2-19a2-48ca-aeef-26f387d499f0] Error from last host: svn4-dr06-u7 (node s
vn4-dr06-u7): [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1840,
in _do_build_and_run_instance\n filter_properties, request_spec)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.
py", line 2117, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u"RescheduledException: Build
of instance 41e3cbe2-19a2-48ca-aeef-26f387d499f0 was re-scheduled: Secret not found: no secret with matching uuid '12345-6789-1011-12
13-1456789'\n"]
and:
(openstack) 1 stack@eod-seed:~/will/kayobe-env/src/kayobe$ openstack server show test -c fault -f json
{
"fault": {
"message": "Build of instance f1bceb3a-4e8a-4cc6-b775-f5fe1ec8901e aborted: Volume attachment 2e6ee797-8e27-4b7e-858f-59ec37fa998b could not be found.",
"code": 500,
"details": " File \"/usr/lib/python2.7/site-packages/nova/compute/manager.py\", line 1840, in _do_build_and_run_instance\n filter_properties, request_spec)\n File \"/usr/lib/python2.7/site-packages/nova/compute/manager.py\", line 2062, in _build_and_run_instance\n bdms=block_device_mapping)\n File \"/usr/lib/python2.7/site-packages/oslo_utils/excutils.py\", line 220, in __exit__\n self.force_reraise()\n File \"/usr/lib/python2.7/site-packages/oslo_utils/excutils.py\", line 196, in force_reraise\n six.reraise(self.type_, self.value, self.tb)\n File \"/usr/lib/python2.7/site-packages/nova/compute/manager.py\", line 2014, in _build_and_run_instance\n block_device_mapping) as resources:\n File \"/usr/lib64/python2.7/contextlib.py\", line 17, in __enter__\n return self.gen.next()\n File \"/usr/lib/python2.7/site-packages/nova/compute/manager.py\", line 2221, in _build_resources\n reason=e.format_message())\n",
"created": "2018-06-21T10:12:45Z"
}
if you haven't configured the nova cephfs backend. It should be possible to use cinder with nova without enabling this. |
In a cloud with external ceph [1] configured as the backend for Cinder but not nova, we see problems when creating volume-backed instances. The following errors are seen in nova logs:
2018-06-21 11:29:01.454 24 ERROR nova.scheduler.utils [req-504318b7-666c-44ae-b3b8-e57388be604e aa63d0eb27bd41fbb8a7de48556a972e c90400f
36cdb434984a3c436d34630b9 - default default] [instance: 41e3cbe2-19a2-48ca-aeef-26f387d499f0] Error from last host: svn4-dr06-u7 (node s
vn4-dr06-u7): [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1840,
in _do_build_and_run_instance\n filter_properties, request_spec)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.
py", line 2117, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u"RescheduledException: Build
of instance 41e3cbe2-19a2-48ca-aeef-26f387d499f0 was re-scheduled: Secret not found: no secret with matching uuid '12345-6789-1011-12
13-1456789'\n"]
and:
(openstack) 1 stack@eod-seed:~/will/kayobe-env/src/kayobe$ openstack server show test -c fault -f json
{
"fault": {
"message": "Build of instance f1bceb3a-4e8a-4cc6-b775-f5fe1ec8901e aborted: Volume attachment 2e6ee797-8e27-4b7e-858f-59ec37fa998b could not be found.",
"code": 500,
"details": " File \"/usr/lib/python2.7/site-packages/nova/compute/manager.py\", line 1840, in _do_build_and_run_instance\n filter_properties, request_spec)\n File \"/usr/lib/python2.7/site-packages/nova/compute/manager.py\", line 2062, in _build_and_run_instance\n bdms=block_device_mapping)\n File \"/usr/lib/python2.7/site-packages/oslo_utils/excutils.py\", line 220, in __exit__\n self.force_reraise()\n File \"/usr/lib/python2.7/site-packages/oslo_utils/excutils.py\", line 196, in force_reraise\n six.reraise(self.type_, self.value, self.tb)\n File \"/usr/lib/python2.7/site-packages/nova/compute/manager.py\", line 2014, in _build_and_run_instance\n block_device_mapping) as resources:\n File \"/usr/lib64/python2.7/contextlib.py\", line 17, in __enter__\n return self.gen.next()\n File \"/usr/lib/python2.7/site-packages/nova/compute/manager.py\", line 2221, in _build_resources\n reason=e.format_message())\n",
"created": "2018-06-21T10:12:45Z"
}
if you haven't configured the nova ceph backend. It should be possible to use cinder with nova without enabling this.
Here is a snippet of globals.yml configuration that leads to this issue:
enable_ceph: "no"
cinder_backend_ceph: "yes"
nova_backend_ceph: "no"
[1] https://docs.openstack.org/kolla-ansible/latest/reference/external-ceph-guide.html |
|
| 2018-06-22 08:36:45 |
Mark Goddard |
kolla-ansible: importance |
Undecided |
Medium |
|
| 2018-06-22 08:36:57 |
Mark Goddard |
kolla-ansible: status |
New |
In Progress |
|
| 2018-06-22 08:37:11 |
Mark Goddard |
kolla-ansible: assignee |
|
Will Szumski (ccx-will) |
|
| 2018-06-22 08:37:21 |
Mark Goddard |
kolla-ansible: milestone |
|
rocky-3 |
|
| 2018-06-22 08:37:47 |
Mark Goddard |
nominated for series |
|
kolla-ansible/rocky |
|
| 2018-06-22 08:37:47 |
Mark Goddard |
bug task added |
|
kolla-ansible/rocky |
|
| 2018-06-22 08:37:47 |
Mark Goddard |
nominated for series |
|
kolla-ansible/pike |
|
| 2018-06-22 08:37:47 |
Mark Goddard |
bug task added |
|
kolla-ansible/pike |
|
| 2018-06-22 08:37:47 |
Mark Goddard |
nominated for series |
|
kolla-ansible/queens |
|
| 2018-06-22 08:37:47 |
Mark Goddard |
bug task added |
|
kolla-ansible/queens |
|
| 2018-06-22 08:40:31 |
Mark Goddard |
kolla-ansible/queens: importance |
Undecided |
Medium |
|
| 2018-06-22 08:40:34 |
Mark Goddard |
kolla-ansible/pike: importance |
Undecided |
Medium |
|
| 2018-06-22 09:15:07 |
Mark Goddard |
kolla-ansible/pike: status |
New |
Confirmed |
|
| 2018-06-22 09:15:12 |
Mark Goddard |
kolla-ansible/queens: status |
New |
Confirmed |
|
| 2018-08-27 07:42:56 |
OpenStack Infra |
kolla-ansible: status |
In Progress |
Fix Released |
|
| 2019-01-28 10:48:51 |
OpenStack Infra |
kolla-ansible/queens: status |
Confirmed |
Fix Committed |
|
| 2019-04-10 10:01:56 |
Mark Goddard |
kolla-ansible/queens: status |
Fix Committed |
Fix Released |
|
