ClientException: Unexpected API Error

[Ravikumar]

[root@controller1 ~(keystone_admin)]# openstack --version
openstack 3.8.2

[root@controller1 ~(keystone_admin)]# nova list
 ERROR (ClientException): Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'oslo_db.exception.DBError'> (HTTP 500) (Request-ID: req-8d1b122c-16ea-4ee0-84c0-0d9ace08b662)
[root@controller1 ~(keystone_admin)]#

[Balazs Gibizer (balazs-gibizer)]

Please give us more details by filling out the bug report template [1] when you reporting a bug.

Based on the exception type 'oslo_db.exception.DBError' I suspect you have a some problem with your database serer or nova database configuration. But without the actual nova logs I cannot say more.

I'm marking this bug Incomplete. Please set it back to New when you provided the necessary information

[1] http://paste.openstack.org/show/793978/

[Ravikumar (rkontanoor)]

Hi, I am copying the logs snippet of nova-compute.log from controller node. The issue i noticed is horizon page doesnt load properly and sometimes takes longer time open the page or never opens. Also when i try "openstack image list" or nova list or any other openstack cmds, it takes very longer time to show me the - ClientException error. As a workaround i restart my openstack using "systemctl restart openstack-*" and seems like everyting works fine for few minutes and issue occurs again after sometime and it repeats.
Please do let me know if there is permanent workaround or something to reconfigure?

2020-05-21 08:09:01.207 58727 ERROR oslo_service.periodic_task [req-263c72ca-aaa7-47d1-909c-9d848656f424 - - - - -] Error during ComputeManager._instance_usage_audit
2020-05-21 08:09:01.207 58727 ERROR oslo_service.periodic_task Traceback (most recent call last):
2020-05-21 08:09:01.207 58727 ERROR oslo_service.periodic_task File "/usr/lib/python2.7/site-packages/oslo_service/periodic_task.py", line 220, in run_periodic_tasks
2020-05-21 08:09:01.207 58727 ERROR oslo_service.periodic_task task(self, context)
2020-05-21 08:09:01.207 58727 ERROR oslo_service.periodic_task File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 6154, in _instance_usage_audit
2020-05-21 08:09:01.207 58727 ERROR oslo_service.periodic_task self.host):
2020-05-21 08:09:01.207 58727 ERROR oslo_service.periodic_task File "/usr/lib/python2.7/site-packages/nova/objects/base.py", line 319, in wrapper
2020-05-21 08:09:01.207 58727 ERROR oslo_service.periodic_task return fn.__get__(None, obj)(*args, **kwargs)
2020-05-21 08:09:01.207 58727 ERROR oslo_service.periodic_task File "/usr/lib/python2.7/site-packages/oslo_versionedobjects/base.py", line 177, in wrapper
2020-05-21 08:09:01.207 58727 ERROR oslo_service.periodic_task args, kwargs)
2020-05-21 08:09:01.207 58727 ERROR oslo_service.periodic_task File "/usr/lib/python2.7/site-packages/nova/conductor/rpcapi.py", line 239, in object_class_action_versions
2020-05-21 08:09:01.207 58727 ERROR oslo_service.periodic_task args=args, kwargs=kwargs)
2020-05-21 08:09:01.207 58727 ERROR oslo_service.periodic_task File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/client.py", line 169, in call
2020-05-21 08:09:01.207 58727 ERROR oslo_service.periodic_task retry=self.retry)
2020-05-21 08:09:01.207 58727 ERROR oslo_service.periodic_task File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 97, in _send
2020-05-21 08:09:01.207 58727 ERROR oslo_service.periodic_task timeout=timeout, retry=retry)
2020-05-21 08:09:01.207 58727 ERROR oslo_service.periodic_task File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 566, in send
2020-05-21 08:09:01.207 58727 ERROR oslo_service.periodic_task retry=retry)
2020-05-21 08:09:01.207 58727 ERROR oslo_service.periodic_task File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 555, in _send
2020-05-21 08:09:01.207 58727 ERROR oslo_service.periodic_task result = self._waiter.wait(msg_id, timeout)
2020-05-21 08:09:01.207 58727 ERROR oslo_service.periodi...

[Balazs Gibizer (balazs-gibizer)]

From the attached logs it seems that your nova compute cannot talk to nova conductor (it does not get answer via the message bus). So you should check the logs of the conductor service and also check if the message bus are healthy.

[Launchpad Janitor (janitor)]

[Expired for OpenStack Compute (nova) because there has been no activity for 60 days.]