Bug in nova image-list

[Moslem Ghayem]

I installed OpenStack using Ubuntu formal documentation. every things is good but in chapter installing compute service in verify section when i run #nova image-list , i recieve the following error:

"ERROR (ClientException): Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'glanceclient.exc.HTTPInternalServerError'> (HTTP 500) (Request-ID: req-d6d93391-b65d-4d0c-b3ba-a8ad51744b74)"

While i run #nova service-list or #nova flavor-list without any problem.

useful log files is attached to this bug report.

[aginwala (aginwala-f)]

Can you check the config and make sure it has correct user/pass value?

[Vihar (storm1911)]

I've checked nova.conf files on all nodes and password/usernames are correct.

[aginwala (aginwala-f)]

run below command:
nova --debug image-list

and then stamp the entire output here. Want to check as to what is getting messed up

[aginwala (aginwala-f)]

Also check glance password in glance-api.conf and the one in db should same. Please try to use the same password.

Are you on juno or kilo?

[Thalabathy (thalabathy-v)]

Issue seen in liberty also

[Thalabathy (thalabathy-v)]

root@liberty-osc:~# nova --debug image-list
DEBUG (session:198) REQ: curl -g -i -X GET http://127.0.0.1:35357/v2.0 -H "Accept: application/json" -H "User-Agent: python-keystoneclient"
INFO (connectionpool:205) Starting new HTTP connection (1): 127.0.0.1
DEBUG (connectionpool:385) "GET /v2.0 HTTP/1.1" 200 336
DEBUG (session:215) RESP: [200] Content-Length: 336 Vary: X-Auth-Token X-Distribution: Ubuntu Connection: keep-alive Date: Thu, 26 Nov 2015 06:57:36 GMT Content-Type: application/json X-Openstack-Request-Id: req-9eb68a99-0df9-4b57-b911-d4738bdb4321
RESP BODY: {"version": {"status": "stable", "updated": "2014-04-17T00:00:00Z", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v2.0+json"}], "id": "v2.0", "links": [{"href": "http://127.0.0.1:35357/v2.0/", "rel": "self"}, {"href": "http://docs.openstack.org/", "type": "text/html", "rel": "describedby"}]}}

DEBUG (v2:86) Making authentication request to http://127.0.0.1:35357/v2.0/tokens
DEBUG (connectionpool:385) "POST /v2.0/tokens HTTP/1.1" 200 1698
DEBUG (session:198) REQ: curl -g -i -X GET http://127.0.0.1:8774/v2/ -H "User-Agent: python-novaclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}ad425dd68b2466f53a4b745b72f64ff5b104cbfb"
INFO (connectionpool:205) Starting new HTTP connection (1): 127.0.0.1
DEBUG (connectionpool:385) "GET /v2/ HTTP/1.1" 200 374
DEBUG (session:215) RESP: [200] Date: Thu, 26 Nov 2015 06:57:36 GMT Connection: keep-alive Content-Type: application/json Content-Length: 374 X-Compute-Request-Id: req-d7c9e778-a092-4563-8d7a-b6bb5057a660
RESP BODY: {"version": {"status": "SUPPORTED", "updated": "2011-01-21T11:33:21Z", "links": [{"href": "http://127.0.0.1:8774/v2/", "rel": "self"}, {"href": "http://docs.openstack.org/", "type": "text/html", "rel": "describedby"}], "min_version": "", "version": "", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.compute+json;version=2"}], "id": "v2.0"}}

DEBUG (session:198) REQ: curl -g -i -X GET http://127.0.0.1:8774/v2/d41e6b4f5ab74c5b9aa3b3f3c11c32a1/images/detail -H "User-Agent: python-novaclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}ad425dd68b2466f53a4b745b72f64ff5b104cbfb"
DEBUG (connectionpool:385) "GET /v2/d41e6b4f5ab74c5b9aa3b3f3c11c32a1/images/detail HTTP/1.1" 500 214
DEBUG (session:215) RESP: [500] Date: Thu, 26 Nov 2015 07:00:42 GMT Connection: keep-alive Content-Type: application/json; charset=UTF-8 Content-Length: 214 X-Compute-Request-Id: req-6f54084f-31eb-4fe7-bcb4-bd8592d414ee
RESP BODY: {"computeFault": {"message": "Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.\n<class 'glanceclient.exc.HTTPInternalServerError'>", "code": 500}}

DEBUG (shell:905) Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'glanceclient.exc.HTTPInternalServerError'> (HTTP 500) (Request-ID: req-6f54084f-31eb-4fe7-bcb4-bd8592d414ee)
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/novaclient/shell.py", line 903, in main
    OpenStackComputeShell().main(argv)
  File "/usr/lib/python2.7/...

[Thalabathy (thalabathy-v)]

Running version:

root@liberty-osc:~# dpkg -l | grep nova
ii nova-api 2:12.0.0-0ubuntu2~cloud0 all OpenStack Compute - API frontend
ii nova-cert 2:12.0.0-0ubuntu2~cloud0 all OpenStack Compute - certificate management
ii nova-common 2:12.0.0-0ubuntu2~cloud0 all OpenStack Compute - common files
ii nova-compute 2:12.0.0-0ubuntu2~cloud0 all OpenStack Compute - compute node base
ii nova-compute-kvm 2:12.0.0-0ubuntu2~cloud0 all OpenStack Compute - compute node (KVM)
ii nova-compute-libvirt 2:12.0.0-0ubuntu2~cloud0 all OpenStack Compute - compute node libvirt support
ii nova-conductor 2:12.0.0-0ubuntu2~cloud0 all OpenStack Compute - conductor service
ii nova-console 2:12.0.0-0ubuntu2~cloud0 all OpenStack Compute - Console
ii nova-consoleauth 2:12.0.0-0ubuntu2~cloud0 all OpenStack Compute - Console Authenticator
ii nova-novncproxy 2:12.0.0-0ubuntu2~cloud0 all OpenStack Compute - NoVNC proxy
ii nova-scheduler 2:12.0.0-0ubuntu2~cloud0 all OpenStack Compute - virtual machine scheduler
ii python-nova 2:12.0.0-0ubuntu2~cloud0 all OpenStack Compute Python libraries
ii python-novaclient 2:2.30.1-1~cloud0 all client library for OpenStack Compute API
root@liberty-osc:~#

[aginwala (aginwala-f)]

Please confirm the keystone endpoint-list

values and check basic glance image-list and other glance commands. This is a configuration issue. Please check the passwords for glance .

[Thalabathy (thalabathy-v)]

root@liberty-osc:~# keystone endpoint-list
/usr/lib/python2.7/dist-packages/keystoneclient/shell.py:64: DeprecationWarning: The keystone CLI is deprecated in favor of python-openstackclient. For a Python library, continue using python-keystoneclient.
  'python-keystoneclient.', DeprecationWarning)
/usr/lib/python2.7/dist-packages/keystoneclient/v2_0/client.py:145: DeprecationWarning: Constructing an instance of the keystoneclient.v2_0.client.Client class without a session is deprecated as of the 1.7.0 release and may be removed in the 2.0.0 release.
  'the 2.0.0 release.', DeprecationWarning)
/usr/lib/python2.7/dist-packages/keystoneclient/v2_0/client.py:147: DeprecationWarning: Using the 'tenant_name' argument is deprecated in version '1.7.0' and will be removed in version '2.0.0', please use the 'project_name' argument instead
  super(Client, self).__init__(**kwargs)
/usr/lib/python2.7/dist-packages/debtcollector/renames.py:43: DeprecationWarning: Using the 'tenant_id' argument is deprecated in version '1.7.0' and will be removed in version '2.0.0', please use the 'project_id' argument instead
  return f(*args, **kwargs)
/usr/lib/python2.7/dist-packages/keystoneclient/httpclient.py:376: DeprecationWarning: Constructing an HTTPClient instance without using a session is deprecated as of the 1.7.0 release and may be removed in the 2.0.0 release.
  'the 2.0.0 release.', DeprecationWarning)
+----------------------------------+-----------+----------------------------------------+----------------------------------------+----------------------------------------+----------------------------------+
| id | region | publicurl | internalurl | adminurl | service_id |
+----------------------------------+-----------+----------------------------------------+----------------------------------------+----------------------------------------+----------------------------------+
| 2408bda10529429cb0e4fbbd729f6ba0 | regionOne | http://127.0.0.1:8774/v2/%(tenant_id)s | http://127.0.0.1:8774/v2/%(tenant_id)s | http://127.0.0.1:8774/v2/%(tenant_id)s | 2f113e6b7e9b4f398f6e3a63d5634e4a |
| 77d739a39ec545f2ac29e27c826e7f73 | regionOne | http://127.0.0.1:9696 | http://127.0.0.1:9696 | http://127.0.0.1:9696 | f1fae12bee9443e39d93425e1f05c404 |
| b9048c6ae5f440aaad4e3a7d2b437902 | regionOne | http://127.0.0.1:9292 | http://127.0.0.1:9292 | http://127.0.0.1:9292 | 387e6bd7f84245d78bf4199b7cba3c55 |
| d304bd3119a44953bb624b53790a5044 | regionOne | http://127.0.0.1:5000/v2.0 | http://127.0.0.1:5000/v2.0 | http://127.0.0.1:35357/v2.0 | 8088e6726503445fb13116fa6a65b6b7 |
+----------------------------------+-----------+----------------------------------------+----------------------------------------+----------------------------------------+----------------------------------+
root@liberty-osc:~# glance image-list
+--------------------------------------+--------------+
| ID ...

[Thalabathy (thalabathy-v)]

I am able to list glance image-list and all other glance operation.
Some how interaction between nova and glance broken.

[aginwala (aginwala-f)]

Alright. This is a password drift. Check in glance-api.conf and glance-registry.conf. Please check password in db for the same. Try to reset the glance password if not. This is duplicate bug since many users have reported in the past. Please refer to old bugs and follow the same.