This was tested in glance cinder (single) store, when the image-volume storing the image is deleted and we perform any operation using that image eg: create a volume from image, it shows the following stack trace in the logs (which isn't very useful to find the root cause)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: DEBUG glance.api.middleware.version_negotiation [None req-8ab02fbc-068e-4636-9f8b-1e0173cb75b6 admin admin] new path /v2/images/1e15a715-3f30-45d0-aaec-9a6157ff120a/file {{(pid=735363) process_request /opt/stack/glance/glance/api/middleware/version_negotiation.py:70}}
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: INFO glance_store._drivers.swift.store [None req-8ab02fbc-068e-4636-9f8b-1e0173cb75b6 admin admin] Badly formed Swift URI. Credentials not found for account reference
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: WARNING glance.location [None req-8ab02fbc-068e-4636-9f8b-1e0173cb75b6 admin admin] Get image 1e15a715-3f30-45d0-aaec-9a6157ff120a data failed: Badly formed Swift URI. Credentials not found for account reference.: glance_store.exceptions.BadStoreUri: Badly formed Swift URI. Credentials not found for account reference
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance.location [None req-8ab02fbc-068e-4636-9f8b-1e0173cb75b6 admin admin] Glance tried all active locations to get data for image 1e15a715-3f30-45d0-aaec-9a6157ff120a but all have failed.
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: CRITICAL glance [None req-8ab02fbc-068e-4636-9f8b-1e0173cb75b6 admin admin] Unhandled error: TypeError: 'ImageProxy' object is not callable
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance Traceback (most recent call last):
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance resp = self.call_func(req, *args, **kw)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance return self.func(req, *args, **kwargs)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/oslo_middleware/base.py", line 124, in __call__
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance response = req.get_response(self.application)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance status, headers, app_iter = self.call_application(
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance app_iter = application(self.environ, start_response)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance resp = self.call_func(req, *args, **kw)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance return self.func(req, *args, **kwargs)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/oslo_middleware/base.py", line 124, in __call__
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance response = req.get_response(self.application)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance status, headers, app_iter = self.call_application(
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance app_iter = application(self.environ, start_response)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance resp = self.call_func(req, *args, **kw)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance return self.func(req, *args, **kwargs)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/oslo_middleware/base.py", line 124, in __call__
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance response = req.get_response(self.application)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance status, headers, app_iter = self.call_application(
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance app_iter = application(self.environ, start_response)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance resp = self.call_func(req, *args, **kw)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance return self.func(req, *args, **kwargs)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/opt/stack/glance/glance/common/wsgi.py", line 928, in __call__
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance response = req.get_response(self.application)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance status, headers, app_iter = self.call_application(
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance app_iter = application(self.environ, start_response)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance resp = self.call_func(req, *args, **kw)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance return self.func(req, *args, **kwargs)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/osprofiler/web.py", line 119, in __call__
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance return request.get_response(self.application)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance status, headers, app_iter = self.call_application(
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance app_iter = application(self.environ, start_response)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance resp = self.call_func(req, *args, **kw)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance return self.func(req, *args, **kwargs)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py", line 341, in __call__
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance response = req.get_response(self._app)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance status, headers, app_iter = self.call_application(
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance app_iter = application(self.environ, start_response)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance resp = self.call_func(req, *args, **kw)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance return self.func(req, *args, **kwargs)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/opt/stack/glance/glance/common/wsgi.py", line 928, in __call__
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance response = req.get_response(self.application)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance status, headers, app_iter = self.call_application(
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance app_iter = application(self.environ, start_response)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance resp = self.call_func(req, *args, **kw)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance return self.func(req, *args, **kwargs)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/opt/stack/glance/glance/common/wsgi.py", line 928, in __call__
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance response = req.get_response(self.application)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance status, headers, app_iter = self.call_application(
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance app_iter = application(self.environ, start_response)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance resp = self.call_func(req, *args, **kw)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance return self.func(req, *args, **kwargs)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/opt/stack/glance/glance/common/wsgi.py", line 928, in __call__
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance response = req.get_response(self.application)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance status, headers, app_iter = self.call_application(
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance app_iter = application(self.environ, start_response)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/paste/urlmap.py", line 216, in __call__
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance return app(environ, start_response)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance return resp(environ, start_response)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/routes/middleware.py", line 153, in __call__
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance response = self.app(environ, start_response)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance return resp(environ, start_response)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance return resp(environ, start_response)
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance TypeError: 'ImageProxy' object is not callable
Mar 23 14:18:40 ubuntu2004.localdomain <email address hidden>[735363]: ERROR glance
