403 Forbidden: Error fetching members of image

[Florian Engelmann]

I get the following error messages in my searchlight-manage.log:

2018-03-23 09:29:26.626 14 INFO searchlight.cmd.manage [-] API Reindex start OS::Nova::ServerGroup into searchlight-2018_03_23_09_29_24
2018-03-23 09:29:26.843 14 ERROR searchlight.cmd.manage [-] Failed to setup index extension searchlight-2018_03_23_09_29_24: 403 Forbidden: Error fetching members of image f2533f16-dc46-4705-b9d6-c9c4e96389d0: Only shared images have members. (HTTP 403): HTTPForbidden: 403 Forbidden: Error fetching members of image f2533f16-dc46-4705-b9d6-c9c4e96389d0: Only shared images have members. (HTTP 403)
2018-03-23 09:29:26.843 14 ERROR searchlight.cmd.manage Traceback (most recent call last):
2018-03-23 09:29:26.843 14 ERROR searchlight.cmd.manage File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/searchlight/cmd/manage.py", line 70, in _plugin_api
2018-03-23 09:29:26.843 14 ERROR searchlight.cmd.manage plugin_obj.index_initial_data(index_name=index_name)
2018-03-23 09:29:26.843 14 ERROR searchlight.cmd.manage File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/searchlight/elasticsearch/plugins/base.py", line 188, in index_initial_data
2018-03-23 09:29:26.843 14 ERROR searchlight.cmd.manage document = self.serialize(obj)
2018-03-23 09:29:26.843 14 ERROR searchlight.cmd.manage File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/searchlight/elasticsearch/plugins/glance/images.py", line 161, in serialize
2018-03-23 09:29:26.843 14 ERROR searchlight.cmd.manage return serialize_glance_image(obj)
2018-03-23 09:29:26.843 14 ERROR searchlight.cmd.manage File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/searchlight/elasticsearch/plugins/glance/__init__.py", line 74, in serialize_glance_image
2018-03-23 09:29:26.843 14 ERROR searchlight.cmd.manage members = list(members)
2018-03-23 09:29:26.843 14 ERROR searchlight.cmd.manage File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/glanceclient/common/utils.py", line 524, in next
2018-03-23 09:29:26.843 14 ERROR searchlight.cmd.manage return self._next()
2018-03-23 09:29:26.843 14 ERROR searchlight.cmd.manage File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/glanceclient/common/utils.py", line 517, in _next
2018-03-23 09:29:26.843 14 ERROR searchlight.cmd.manage obj, resp = next(self._self_wrapped)
2018-03-23 09:29:26.843 14 ERROR searchlight.cmd.manage File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/glanceclient/v2/image_members.py", line 38, in list
2018-03-23 09:29:26.843 14 ERROR searchlight.cmd.manage resp, body = self.http_client.get(url)
2018-03-23 09:29:26.843 14 ERROR searchlight.cmd.manage File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 288, in get
2018-03-23 09:29:26.843 14 ERROR searchlight.cmd.manage return self.request(url, 'GET', **kwargs)
2018-03-23 09:29:26.843 14 ERROR searchlight.cmd.manage File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/glanceclient/common/http.py", line 349, in request
2018-03-23 09:29:26.843 14 ERROR searchlight.cmd.manage return self._handle_response(resp)
2018-03-23 09:29:26.843 14 ERROR searchlight.cmd.manage File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/glanceclient/common/http.py", line 98, in _handle_response
2018-03-23 09:29:26.843 14 ERROR searchlight.cmd.manage raise exc.from_response(resp, resp.content)
2018-03-23 09:29:26.843 14 ERROR searchlight.cmd.manage HTTPForbidden: 403 Forbidden: Error fetching members of image f2533f16-dc46-4705-b9d6-c9c4e96389d0: Only shared images have members. (HTTP 403)
2018-03-23 09:29:26.843 14 ERROR searchlight.cmd.manage
[...]
2018-03-23 09:29:32.816 14 ERROR searchlight.cmd.manage [-] The following indexing threads did not complete successfully, due to error or cancellation: OS::Glance::Image
2018-03-23 09:29:32.896 14 INFO elasticsearch [-] DELETE http://kollai.xxxx.xxx:9200/searchlight-2018_03_23_09_29_24 [status:200 request:0.079s]
2018-03-23 09:29:32.896 14 ERROR searchlight.cmd.manage [-] Rolled back; exiting

The image with ID f2533f16-dc46-4705-b9d6-c9c4e96389d0 looks like:

openstack image show f2533f16-dc46-4705-b9d6-c9c4e96389d0

| checksum | d63a4857036b6df0ddb06643f4336df7 |
| container_format | bare |
| created_at | 2018-03-15T09:07:02Z |
| disk_format | raw |
| file | /v2/images/f2533f16-dc46-4705-b9d6-c9c4e96389d0/file |
| id | f2533f16-dc46-4705-b9d6-c9c4e96389d0 |
| min_disk | 0 |
| min_ram | 0 |
| name | amphora |
| owner | c4c92fcf470c40bd89bf794355c8da5f |
| properties | direct_url='rbd://96d0f01c-27b9-44bf-b0a7-e7bcc63c423f/images/f2533f16-dc46-4705-b9d6-c9c4e96389d0/snap', locations='[{u'url': u'rbd://96d0f01c-27b9-44bf-b0a7-e7bcc63c423f/images/f2533f16-dc46-4705-b9d6-c9c4e96389d0/snap', u'metadata': {}}]' |
| protected | False |
| schema | /v2/schemas/image |
| size | 2147483648 |
| status | active |
| tags | amphora |
| updated_at | 2018-03-15T09:07:24Z |
| virtual_size | None |
| visibility | private

So it looks like private images causing this "error message/bug"?

[Arnoud de Jonge (arnoud-dejonge-4)]

Had the same issue with the Octavia amphora image. I set it to public temporarily and then it passed the bootstrap.