change instance type:Unexpected API Error

Bug #1882165 reported by xuhongbin
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
Invalid
Undecided
Unassigned

Bug Description

my env:
openstack:train
Libvirt + KVM
sotrage:ceph
network:neuron self-service network

I have a instance,it is runing,now is ok ,then I change the instance type,more cpu and more memory give the instance,a error on dashbord,next is nova-api log,thank you very much.

2020-06-05 10:09:42.564 2604 INFO nova.osapi_compute.wsgi.server [req-44b810c0-74e4-4314-ac7d-d0bfc79b371b f69f764f5b8247b08a90981cac201269 55cc1c886afb41f09a17d476f842c76c - default default] 192.168.1.69 "GET /v2.1 HTTP/1.1" status: 302 len: 313 time: 0.4201910
2020-06-05 10:09:42.574 2604 INFO nova.osapi_compute.wsgi.server [req-81908ee8-1e0a-42b0-8de7-4cfbe89b89c3 f69f764f5b8247b08a90981cac201269 55cc1c886afb41f09a17d476f842c76c - default default] 192.168.1.69 "GET /v2.1/ HTTP/1.1" status: 200 len: 784 time: 0.0045490
2020-06-05 10:09:44.092 2605 INFO nova.osapi_compute.wsgi.server [req-e92f7063-8f67-48fd-87e3-846b99c62372 f69f764f5b8247b08a90981cac201269 55cc1c886afb41f09a17d476f842c76c - default default] 192.168.1.69 "GET /v2.1/servers/ce94b132-d0bd-4526-b2f2-c5f03fce8d67 HTTP/1.1" status: 200 len: 2266 time: 1.1976459
2020-06-05 10:09:44.126 2604 INFO nova.osapi_compute.wsgi.server [req-46ec667b-ad9b-48d7-be31-ed0b1bb55b7b f69f764f5b8247b08a90981cac201269 55cc1c886afb41f09a17d476f842c76c - default default] 192.168.1.69 "GET /v2.1/flavors/detail HTTP/1.1" status: 200 len: 3140 time: 0.0265250
2020-06-05 10:09:44.289 2604 INFO nova.osapi_compute.wsgi.server [req-c47276f7-a734-4da1-8542-94d46e183949 f69f764f5b8247b08a90981cac201269 55cc1c886afb41f09a17d476f842c76c - default default] 192.168.1.69 "GET /v2.1/extensions HTTP/1.1" status: 200 len: 23101 time: 0.0082111
2020-06-05 10:09:44.319 2604 INFO nova.osapi_compute.wsgi.server [req-1f286776-5783-4df0-925c-6a96741c2b05 f69f764f5b8247b08a90981cac201269 55cc1c886afb41f09a17d476f842c76c - default default] 192.168.1.69 "GET /v2.1/os-server-groups HTTP/1.1" status: 200 len: 419 time: 0.0242720
2020-06-05 10:09:44.427 2604 INFO nova.osapi_compute.wsgi.server [req-4b525341-80f5-4705-a7b4-d6ea74ba5e03 f69f764f5b8247b08a90981cac201269 55cc1c886afb41f09a17d476f842c76c - default default] 192.168.1.69 "GET /v2.1/limits?reserved=1 HTTP/1.1" status: 200 len: 915 time: 0.0816431

2020-06-05 10:09:58.273 2603 INFO nova.osapi_compute.wsgi.server [req-2fe6b1f1-be66-4cb3-9424-3782a5bffbd6 f69f764f5b8247b08a90981cac201269 55cc1c886afb41f09a17d476f842c76c - default default] 192.168.1.69 "GET /v2.1 HTTP/1.1" status: 302 len: 313 time: 0.3958890
2020-06-05 10:09:58.286 2603 INFO nova.osapi_compute.wsgi.server [req-347b5c45-ee66-456f-87df-f6f458bd973a f69f764f5b8247b08a90981cac201269 55cc1c886afb41f09a17d476f842c76c - default default] 192.168.1.69 "GET /v2.1/ HTTP/1.1" status: 200 len: 784 time: 0.0082009
2020-06-05 10:09:59.804 2603 INFO nova.osapi_compute.wsgi.server [req-aa736cda-3dfc-4bb2-981e-c22a4e633ecd f69f764f5b8247b08a90981cac201269 55cc1c886afb41f09a17d476f842c76c - default default] 192.168.1.69 "GET /v2.1/servers/ce94b132-d0bd-4526-b2f2-c5f03fce8d67 HTTP/1.1" status: 200 len: 2266 time: 1.2375860
2020-06-05 10:09:59.833 2603 INFO nova.osapi_compute.wsgi.server [req-a8b4059c-7335-4e25-b91d-6b7afbb4a298 f69f764f5b8247b08a90981cac201269 55cc1c886afb41f09a17d476f842c76c - default default] 192.168.1.69 "GET /v2.1/flavors/detail HTTP/1.1" status: 200 len: 3140 time: 0.0232201
2020-06-05 10:09:59.849 2603 INFO nova.osapi_compute.wsgi.server [req-72c0a032-8324-4bb2-a3a0-fb01cc4c15dc f69f764f5b8247b08a90981cac201269 55cc1c886afb41f09a17d476f842c76c - default default] 192.168.1.69 "GET /v2.1/extensions HTTP/1.1" status: 200 len: 23101 time: 0.0050662
2020-06-05 10:09:59.873 2603 INFO nova.osapi_compute.wsgi.server [req-47a91c24-a490-42db-89d7-d4394d09b824 f69f764f5b8247b08a90981cac201269 55cc1c886afb41f09a17d476f842c76c - default default] 192.168.1.69 "GET /v2.1/os-server-groups HTTP/1.1" status: 200 len: 419 time: 0.0141439
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi [req-95cd7931-5819-480e-bad7-6167b7249840 f69f764f5b8247b08a90981cac201269 55cc1c886afb41f09a17d476f842c76c - default default] Unexpected exception in API method: RemoteError: Remote error: Unauthorized Unknown auth type: None
[u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming\n res = self.dispatcher.dispatch(message)\n', u' File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 274, in dispatch\n return self._do_dispatch(endpoint, method, ctxt, args)\n', u' File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 194, in _do_dispatch\n result = func(ctxt, **new_args)\n', u' File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 235, in inner\n return func(*args, **kwargs)\n', u' File "/usr/lib/python2.7/site-packages/nova/conductor/manager.py", line 95, in wrapper\n return fn(self, context, *args, **kwargs)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/utils.py", line 1372, in decorated_function\n return function(self, context, *args, **kwargs)\n', u' File "/usr/lib/python2.7/site-packages/nova/conductor/manager.py", line 299, in migrate_server\n host_list)\n', u' File "/usr/lib/python2.7/site-packages/nova/conductor/manager.py", line 381, in _cold_migrate\n updates, ex, request_spec)\n', u' File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__\n self.force_reraise()\n', u' File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise\n six.reraise(self.type_, self.value, self.tb)\n', u' File "/usr/lib/python2.7/site-packages/nova/conductor/manager.py", line 350, in _cold_migrate\n task.execute()\n', u' File "/usr/lib/python2.7/site-packages/nova/conductor/tasks/base.py", line 27, in wrap\n self.rollback()\n', u' File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__\n self.force_reraise()\n', u' File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise\n six.reraise(self.type_, self.value, self.tb)\n', u' File "/usr/lib/python2.7/site-packages/nova/conductor/tasks/base.py", line 24, in wrap\n return original(self)\n', u' File "/usr/lib/python2.7/site-packages/nova/conductor/tasks/base.py", line 42, in execute\n return self._execute()\n', u' File "/usr/lib/python2.7/site-packages/nova/conductor/tasks/migrate.py", line 307, in _execute\n self.context, self.instance.uuid)\n', u' File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 2239, in get_requested_resource_for_instance\n neutron = get_client(context, admin=True)\n', u' File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 172, in get_client\n auth_plugin = _get_auth_plugin(context, admin=admin)\n', u' File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 152, in _get_auth_plugin\n _ADMIN_AUTH = _load_auth_plugin(CONF)\n', u' File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 83, in _load_auth_plugin\n raise neutron_client_exc.Unauthorized(message=err_msg)\n', u'Unauthorized: Unknown auth type: None\n'].
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi Traceback (most recent call last):
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/nova/api/openstack/wsgi.py", line 671, in wrapped
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi return f(*args, **kwargs)
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 110, in wrapper
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi return func(*args, **kwargs)
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/servers.py", line 1044, in _action_resize
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs)
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/servers.py", line 963, in _resize
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, **kwargs)
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 225, in inner
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs)
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 152, in inner
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw)
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 215, in wrapped
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs)
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 3772, in resize
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi request_spec=request_spec)
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/nova/conductor/api.py", line 96, in resize_instance
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi request_spec=request_spec, host_list=host_list)
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/nova/conductor/rpcapi.py", line 340, in migrate_server
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi return cctxt.call(context, 'migrate_server', **kw)
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/client.py", line 181, in call
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi transport_options=self.transport_options)
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 129, in _send
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi transport_options=transport_options)
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 646, in send
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi transport_options=transport_options)
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 636, in _send
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi raise result
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi RemoteError: Remote error: Unauthorized Unknown auth type: None
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming\n res = self.dispatcher.dispatch(message)\n', u' File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 274, in dispatch\n return self._do_dispatch(endpoint, method, ctxt, args)\n', u' File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 194, in _do_dispatch\n result = func(ctxt, **new_args)\n', u' File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 235, in inner\n return func(*args, **kwargs)\n', u' File "/usr/lib/python2.7/site-packages/nova/conductor/manager.py", line 95, in wrapper\n return fn(self, context, *args, **kwargs)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/utils.py", line 1372, in decorated_function\n return function(self, context, *args, **kwargs)\n', u' File "/usr/lib/python2.7/site-packages/nova/conductor/manager.py", line 299, in migrate_server\n host_list)\n', u' File "/usr/lib/python2.7/site-packages/nova/conductor/manager.py", line 381, in _cold_migrate\n updates, ex, request_spec)\n', u' File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__\n self.force_reraise()\n', u' File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise\n six.reraise(self.type_, self.value, self.tb)\n', u' File "/usr/lib/python2.7/site-packages/nova/conductor/manager.py", line 350, in _cold_migrate\n task.execute()\n', u' File "/usr/lib/python2.7/site-packages/nova/conductor/tasks/base.py", line 27, in wrap\n self.rollback()\n', u' File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__\n self.force_reraise()\n', u' File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise\n six.reraise(self.type_, self.value, self.tb)\n', u' File "/usr/lib/python2.7/site-packages/nova/conductor/tasks/base.py", line 24, in wrap\n return original(self)\n', u' File "/usr/lib/python2.7/site-packages/nova/conductor/tasks/base.py", line 42, in execute\n return self._execute()\n', u' File "/usr/lib/python2.7/site-packages/nova/conductor/tasks/migrate.py", line 307, in _execute\n self.context, self.instance.uuid)\n', u' File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 2239, in get_requested_resource_for_instance\n neutron = get_client(context, admin=True)\n', u' File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 172, in get_client\n auth_plugin = _get_auth_plugin(context, admin=admin)\n', u' File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 152, in _get_auth_plugin\n _ADMIN_AUTH = _load_auth_plugin(CONF)\n', u' File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 83, in _load_auth_plugin\n raise neutron_client_exc.Unauthorized(message=err_msg)\n', u'Unauthorized: Unknown auth type: None\n'].
2020-06-05 10:10:00.823 2603 ERROR nova.api.openstack.wsgi
2020-06-05 10:10:00.827 2603 INFO nova.api.openstack.wsgi [req-95cd7931-5819-480e-bad7-6167b7249840 f69f764f5b8247b08a90981cac201269 55cc1c886afb41f09a17d476f842c76c - default default] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'oslo_messaging.rpc.client.RemoteError'>
2020-06-05 10:10:00.830 2603 INFO nova.osapi_compute.wsgi.server [req-95cd7931-5819-480e-bad7-6167b7249840 f69f764f5b8247b08a90981cac201269 55cc1c886afb41f09a17d476f842c76c - default default] 192.168.1.69 "POST /v2.1/servers/ce94b132-d0bd-4526-b2f2-c5f03fce8d67/action HTTP/1.1" status: 500 len: 644 time: 0.9512019
2020-06-05 10:10:01.646 2604 INFO nova.osapi_compute.wsgi.server [req-218aa693-3e8d-4bb4-955a-08dd7d415e81 f69f764f5b8247b08a90981cac201269 55cc1c886afb41f09a17d476f842c76c - default default] 192.168.1.69 "GET /v2.1/flavors/detail HTTP/1.1" status: 200 len: 3140 time: 0.4606969

Tags: nova-api
Revision history for this message
Balazs Gibizer (balazs-gibizer) wrote :

From the stack trace it seems that your nova-conductor service does not have a valid authentication config to talk to neutron. Please check the nova.conf of you conductor services.

Changed in nova:
status: New → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.