nova.api unexpected exception glanceclient.exc.HTTPInternalServerError

[Damian O'Donnell]

damo@controller01:~$ dpkg -l | grep nova
ii nova-api 2:12.0.0-0ubuntu2~cloud0 all OpenStack Compute - API frontend
ii nova-cert 2:12.0.0-0ubuntu2~cloud0 all OpenStack Compute - certificate management
ii nova-common 2:12.0.0-0ubuntu2~cloud0 all OpenStack Compute - common files
ii nova-conductor 2:12.0.0-0ubuntu2~cloud0 all OpenStack Compute - conductor service
ii nova-consoleauth 2:12.0.0-0ubuntu2~cloud0 all OpenStack Compute - Console Authenticator
ii nova-novncproxy 2:12.0.0-0ubuntu2~cloud0 all OpenStack Compute - NoVNC proxy
ii nova-scheduler 2:12.0.0-0ubuntu2~cloud0 all OpenStack Compute - virtual machine scheduler
ii python-nova 2:12.0.0-0ubuntu2~cloud0 all OpenStack Compute Python libraries
ii python-novaclient 2:2.30.1-1~cloud0 all client library for OpenStack Compute API
damo@controller01:~$

Installing OpenStack as per the OpenStack Documentation for Ubuntu and page http://docs.openstack.org/liberty/install-guide-ubuntu/nova-verify.html when the last command is executed the following occurs:

damo@controller01:~$ nova image-list
ERROR (ClientException): Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'glanceclient.exc.HTTPInternalServerError'> (HTTP 500) (Request-ID: req-2294aff0-9d05-448c-80ae-daaa9d24785f)

[Tardis Xu (xiaoxubeii)]

please specify the details about your environment

[Damian O'Donnell (damian-mordrid)]

Everything is built as per the documentation on 14.04.LTS on virtualbox VM

The controller node uname -a is
damo@controller01:~$ uname -a
Linux controller01 3.19.0-39-generic #44~14.04.1-Ubuntu SMP Wed Dec 2 10:00:35 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux

The admin-openrc.sh is as follows
damo@controller01:~$ cat admin-openrc.sh
export OS_PROJECT_DOMAIN_ID=default
export OS_USER_DOMAIN_ID=default
export OS_PROJECT_NAME=admin
export OS_TENANT_NAME=admin
export OS_USERNAME=admin
export OS_PASSWORD=XXXXXXXX
export OS_AUTH_URL=http://controller01:35357/v3
export OS_IDENTITY_API_VERSION=3
export OS_IMAGE_API_VERSION=2

It is a test environment so we can provide any information that is required.

[Davanum Srinivas (DIMS) (dims-v)]

Do you see any errors in the glance API log?

[Damian O'Donnell (damian-mordrid)]

Yes, I ran the command again this morning, here is the glance-api.log

2015-12-07 08:27:02.775 2082 ERROR glance.registry.client.v1.client [req-e9eaa5e9-cdf6-410c-b083-ee48bd82b381 d7a14efb7f94483b9e0474d7e7d0d326 2c43d3ebdf8b48a1975abe5932ef40f4 - - -] Registry client request GET /images/detail raised NotAuthenticated
2015-12-07 08:27:02.775 2082 ERROR glance.registry.client.v1.client Traceback (most recent call last):
2015-12-07 08:27:02.775 2082 ERROR glance.registry.client.v1.client File "/usr/lib/python2.7/dist-packages/glance/registry/client/v1/client.py", line 121, in do_request
2015-12-07 08:27:02.775 2082 ERROR glance.registry.client.v1.client **kwargs)
2015-12-07 08:27:02.775 2082 ERROR glance.registry.client.v1.client File "/usr/lib/python2.7/dist-packages/glance/common/client.py", line 74, in wrapped
2015-12-07 08:27:02.775 2082 ERROR glance.registry.client.v1.client return func(self, *args, **kwargs)
2015-12-07 08:27:02.775 2082 ERROR glance.registry.client.v1.client File "/usr/lib/python2.7/dist-packages/glance/common/client.py", line 375, in do_request
2015-12-07 08:27:02.775 2082 ERROR glance.registry.client.v1.client headers=copy.deepcopy(headers))
2015-12-07 08:27:02.775 2082 ERROR glance.registry.client.v1.client File "/usr/lib/python2.7/dist-packages/glance/common/client.py", line 88, in wrapped
2015-12-07 08:27:02.775 2082 ERROR glance.registry.client.v1.client return func(self, method, url, body, headers)
2015-12-07 08:27:02.775 2082 ERROR glance.registry.client.v1.client File "/usr/lib/python2.7/dist-packages/glance/common/client.py", line 517, in _do_request
2015-12-07 08:27:02.775 2082 ERROR glance.registry.client.v1.client raise exception.NotAuthenticated(res.read())
2015-12-07 08:27:02.775 2082 ERROR glance.registry.client.v1.client NotAuthenticated: Authentication required
2015-12-07 08:27:02.775 2082 ERROR glance.registry.client.v1.client
2015-12-07 08:27:02.805 2082 ERROR glance.common.wsgi [req-e9eaa5e9-cdf6-410c-b083-ee48bd82b381 d7a14efb7f94483b9e0474d7e7d0d326 2c43d3ebdf8b48a1975abe5932ef40f4 - - -] Caught error: Authentication required
2015-12-07 08:27:02.805 2082 ERROR glance.common.wsgi Traceback (most recent call last):
2015-12-07 08:27:02.805 2082 ERROR glance.common.wsgi File "/usr/lib/python2.7/dist-packages/glance/common/wsgi.py", line 879, in __call__
2015-12-07 08:27:02.805 2082 ERROR glance.common.wsgi request, **action_args)
2015-12-07 08:27:02.805 2082 ERROR glance.common.wsgi File "/usr/lib/python2.7/dist-packages/glance/common/wsgi.py", line 907, in dispatch
2015-12-07 08:27:02.805 2082 ERROR glance.common.wsgi return method(*args, **kwargs)
2015-12-07 08:27:02.805 2082 ERROR glance.common.wsgi File "/usr/lib/python2.7/dist-packages/glance/api/v1/images.py", line 366, in detail
2015-12-07 08:27:02.805 2082 ERROR glance.common.wsgi images = registry.get_images_detail(req.context, **params)
2015-12-07 08:27:02.805 2082 ERROR glance.common.wsgi File "/usr/lib/python2.7/dist-packages/glance/registry/client/v1/api.py", line 155, in get_images_detail
2015-12-07 08:27:02.805 2082 ERROR glance.common.wsgi return c.get_images_detailed(**kwargs)
2015-...

[aginwala (aginwala-f)]

looks like a config issue.
Please make sure the correct passwords exist in db and in config files for glance api.conf and registry.conf. Also do check nova. Can you do nova --debug list and paste the output.

[Damian O'Donnell (damian-mordrid)]

It was an error in the glance-registry.conf. There was an issue during first testing and this warning was in the registry.log

2015-12-08 09:18:17.501 3139 WARNING oslo_config.cfg [-] Option "username" from group "keystone_authtoken" is deprecated. Use option "user-name" from group "keystone_authtoken".

So this was changed, however changing this to user-name causes the original error. Putting the key back to username has fixed the problem.

damo@controller01:/etc/glance$ glance image-list
+--------------------------------------+--------+
| ID | Name |
+--------------------------------------+--------+
| e1ca2f31-a2c3-4dd9-b0ff-0eee9c532000 | cirros |
+--------------------------------------+--------+

[Damian O'Donnell (damian-mordrid)]

nova image-list is also OK

damo@controller01:~$ nova image-list
+--------------------------------------+--------+--------+--------+
| ID | Name | Status | Server |
+--------------------------------------+--------+--------+--------+
| e1ca2f31-a2c3-4dd9-b0ff-0eee9c532000 | cirros | ACTIVE | |
+--------------------------------------+--------+--------+--------+
damo@controller01:~$

[aginwala (aginwala-f)]

Cool.