Apologies - here my nova-api.log 2017-03-17 17:34:47.622 19345 DEBUG nova.compute.api [req-7478b76c-8ee9-442d-829b-cdb8af4960dc 85e68b86be514c3aa30d8b65844aa9fb e3fadcd68fad4f99981189c11ae552ee - a5b6d92142924b69b18bbde404da80da a5b6d92142924b69b18bbde404da80da] Searching by: {'deleted': False, 'project_id': u'e3fadcd68fad4f99981189c11ae552ee'} get_all /usr/lib/python2.7/dist-packages/nova/compute/api.py:2381 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions [req-7478b76c-8ee9-442d-829b-cdb8af4960dc 85e68b86be514c3aa30d8b65844aa9fb e3fadcd68fad4f99981189c11ae552ee - a5b6d92142924b69b18bbde404da80da a5b6d92142924b69b18bbde404da80da] Unexpected exception in API method 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions Traceback (most recent call last): 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/nova/api/openstack/extensions.py", line 338, in wrapped 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions return f(*args, **kwargs) 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/nova/api/validation/__init__.py", line 181, in wrapper 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions return func(*args, **kwargs) 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/nova/api/validation/__init__.py", line 181, in wrapper 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions return func(*args, **kwargs) 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/servers.py", line 214, in detail 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions servers = self._get_servers(req, is_detail=True) 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/servers.py", line 357, in _get_servers 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions sort_keys=sort_keys, sort_dirs=sort_dirs) 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 2466, in get_all 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions sort_dirs=sort_dirs) 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 2606, in _get_instances_by_filters 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions expected_attrs=fields, sort_keys=sort_keys, sort_dirs=sort_dirs) 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions result = fn(cls, context, *args, **kwargs) 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/nova/objects/instance.py", line 1220, in get_by_filters 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions use_slave=use_slave, sort_keys=sort_keys, sort_dirs=sort_dirs) 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 235, in wrapper 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions with reader_mode.using(context): 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__ 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions return self.gen.next() 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 944, in _transaction_scope 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions allow_async=self._allow_async) as resource: 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__ 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions return self.gen.next() 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 558, in _session 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions bind=self.connection, mode=self.mode) 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 317, in _create_session 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions self._start() 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 403, in _start 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions engine_args, maker_args) 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 427, in _setup_for_connection 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions sql_connection=sql_connection, **engine_kwargs) 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py", line 155, in create_engine 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions test_conn = _test_connection(engine, max_retries, retry_interval) 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py", line 331, in _test_connection 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions return engine.connect() 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 2018, in connect 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions return self._connection_cls(self, **kwargs) 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 72, in __init__ 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions if connection is not None else engine.raw_connection() 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 2104, in raw_connection 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions self.pool.unique_connection, _connection) 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 2078, in _wrap_pool_connect 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions e, dialect, self) 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1401, in _handle_dbapi_exception_noconnection 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions util.raise_from_cause(newraise, exc_info) 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions reraise(type(exception), exception, tb=exc_tb) 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 2074, in _wrap_pool_connect 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions return fn() 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 318, in unique_connection 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions return _ConnectionFairy._checkout(self) 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 713, in _checkout 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions fairy = _ConnectionRecord.checkout(pool) 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 480, in checkout 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions rec = pool._do_get() 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 1060, in _do_get 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions self._dec_overflow() 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/langhelpers.py", line 60, in __exit__ 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions compat.reraise(exc_type, exc_value, exc_tb) 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 1057, in _do_get 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions return self._create_connection() 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 323, in _create_connection 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions return _ConnectionRecord(self) 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 449, in __init__ 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions self.connection = self.__connect() 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 607, in __connect 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions connection = self.__pool._invoke_creator(self) 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/strategies.py", line 97, in connect 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions return dialect.connect(*cargs, **cparams) 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 385, in connect 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions return self.dbapi.connect(*cargs, **cparams) 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/pymysql/__init__.py", line 90, in Connect 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions return Connection(*args, **kwargs) 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 688, in __init__ 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions self.connect() 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 906, in connect 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions self._request_authentication() 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1114, in _request_authentication 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions auth_packet = self._read_packet() 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 981, in _read_packet 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions packet.check_error() 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 393, in check_error 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions err.raise_mysql_exception(self._data) 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 107, in raise_mysql_exception 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions raise errorclass(errno, errval) 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions OperationalError: (pymysql.err.OperationalError) (1045, u"Access denied for user 'nova'@'controller' (using password: YES)") 2017-03-17 17:34:47.628 19345 ERROR nova.api.openstack.extensions 2017-03-17 17:34:47.629 19345 INFO nova.api.openstack.wsgi [req-7478b76c-8ee9-442d-829b-cdb8af4960dc 85e68b86be514c3aa30d8b65844aa9fb e3fadcd68fad4f99981189c11ae552ee - a5b6d92142924b69b18bbde404da80da a5b6d92142924b69b18bbde404da80da] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. 2017-03-17 17:34:47.629 19345 DEBUG nova.api.openstack.wsgi [req-7478b76c-8ee9-442d-829b-cdb8af4960dc 85e68b86be514c3aa30d8b65844aa9fb e3fadcd68fad4f99981189c11ae552ee - a5b6d92142924b69b18bbde404da80da a5b6d92142924b69b18bbde404da80da] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. __call__ /usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py:1039 2017-03-17 17:34:47.629 19345 INFO nova.osapi_compute.wsgi.server [req-7478b76c-8ee9-442d-829b-cdb8af4960dc 85e68b86be514c3aa30d8b65844aa9fb e3fadcd68fad4f99981189c11ae552ee - a5b6d92142924b69b18bbde404da80da a5b6d92142924b69b18bbde404da80da] 10.0.88.11 "GET /v2.1/e3fadcd68fad4f99981189c11ae552ee/servers/detail HTTP/1.1" status: 500 len: 572 time: 0.1815181 10.0.88.11 is my controller Yes I agree that I have a DB issue. Point is that I can access the nova_api DB with the credentials configured in nova.conf and the user in the user given by 'openstack user list'. Mysql.log shows me also the output of error code 1045