Description
===========
I used the "openstack server create" command on a two-node test cluster.
I tested neutron and nova user and mysql passwords, net connectivity, disabled apparmor, loaded the geneve kernel module.
Steps to reproduce
==================
run the command:
root@controller:~# openstack server create --flavor m1.tiny --image cirros --nic net-id=provider --security-group default --key-name mykey test01
Expected result
===============
New server instance created.
Actual result
=============
Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'keystoneauth1.exceptions.http.Unauthorized'> (HTTP 500) (Request-ID: req-4655d135-6509-46e4-b918-27c31ff705a3)
Environment
===========
Debian 10.7
repo: buster-ussuri-backports
nova-common 2:21.1.1-1~bpo10+1
QEMU hypervisor
Neutron option 2 w/OpenVSwitch
Disk storage
Logs & Configs
==============
nova-api.log
2021-02-13 09:05:28.744 1426 INFO nova.api.openstack.wsgi [req-a78ac65e-a3ff-4a7d-b9dd-b2082e319be0 24f68ea810674751a3f3f81641402153 677c973f08a74a4d85368d3bfae359a7 - default default] HTTP exception thrown: Flavor m1.tiny could not be found.
2021-02-13 09:05:28.746 1426 INFO nova.api.openstack.requestlog [req-a78ac65e-a3ff-4a7d-b9dd-b2082e319be0 24f68ea810674751a3f3f81641402153 677c973f08a74a4d85368d3bfae359a7 - default default] 172.29.236.13 "GET /v2.1/flavors/m1.tiny" status: 404 len: 80 microversion: 2.1 time: 0.817156
[pid: 1426|app: 0|req: 10/37] 172.29.236.13 () {32 vars in 626 bytes} [Sat Feb 13 09:05:27 2021] GET /v2.1/flavors/m1.tiny => generated 80 bytes in 853 msecs (HTTP/1.1 404) 7 headers in 339 bytes (1 switches on core 0)
2021-02-13 09:05:28.812 1427 INFO nova.api.openstack.requestlog [req-b06b3fda-52fe-4ebf-bb91-9583eea28eec 24f68ea810674751a3f3f81641402153 677c973f08a74a4d85368d3bfae359a7 - default default] 172.29.236.13 "GET /v2.1/flavors" status: 200 len: 187 microversion: 2.1 time: 0.056631
[pid: 1427|app: 0|req: 10/38] 172.29.236.13 () {32 vars in 610 bytes} [Sat Feb 13 09:05:28 2021] GET /v2.1/flavors => generated 187 bytes in 65 msecs (HTTP/1.1 200) 7 headers in 317 bytes (1 switches on core 0)
2021-02-13 09:05:28.870 1425 INFO nova.api.openstack.requestlog [req-e9b74b79-3c78-4393-b363-5ac72ecaa096 24f68ea810674751a3f3f81641402153 677c973f08a74a4d85368d3bfae359a7 - default default] 172.29.236.13 "GET /v2.1/flavors/0" status: 200 len: 354 microversion: 2.1 time: 0.046618
[pid: 1425|app: 0|req: 10/39] 172.29.236.13 () {32 vars in 614 bytes} [Sat Feb 13 09:05:28 2021] GET /v2.1/flavors/0 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 7 headers in 317 bytes (1 switches on core 0)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi [req-42b91a28-eaff-47aa-a7af-0d07b2ba768d 24f68ea810674751a3f3f81641402153 677c973f08a74a4d85368d3bfae359a7 - default default] Unexpected exception in API method: keystoneauth1.exceptions.http.Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-cf6d651d-9e14-45f7-a87c-4fd8f970046c)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi Traceback (most recent call last):
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/nova/api/openstack/wsgi.py", line 671, in wrapped
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi return f(*args, **kwargs)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/nova/api/validation/__init__.py", line 110, in wrapper
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi return func(*args, **kwargs)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/nova/api/validation/__init__.py", line 110, in wrapper
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi return func(*args, **kwargs)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/nova/api/validation/__init__.py", line 110, in wrapper
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi return func(*args, **kwargs)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi [Previous line repeated 9 more times]
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/nova/api/openstack/compute/servers.py", line 697, in create
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi **create_kwargs)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/nova/hooks.py", line 154, in inner
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi rv = f(*args, **kwargs)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/nova/compute/api.py", line 1997, in create
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi requested_hypervisor_hostname=requested_hypervisor_hostname)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/nova/compute/api.py", line 1452, in _create_instance
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi reservation_id, max_count, supports_port_resource_request)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/nova/compute/api.py", line 974, in _validate_and_build_base_options
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi affinity_policy=pci_numa_affinity_policy)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 2143, in create_resource_requests
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi context, neutron, network_id)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 2011, in _get_physnet_tunneled_info
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi if self._has_multi_provider_extension(context, neutron=neutron):
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 1259, in _has_multi_provider_extension
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(context, neutron=neutron)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 1253, in _refresh_neutron_extensions_cache
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi extensions_list = neutron.list_extensions()['extensions']
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 184, in wrapper
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/neutronclient/v2_0/client.py", line 788, in list_extensions
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 184, in wrapper
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/neutronclient/v2_0/client.py", line 354, in get
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi headers=headers, params=params)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 184, in wrapper
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/neutronclient/v2_0/client.py", line 331, in retry_request
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi headers=headers, params=params)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 184, in wrapper
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/neutronclient/v2_0/client.py", line 282, in do_request
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi headers=headers)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/neutronclient/client.py", line 339, in do_request
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi self._check_uri_length(url)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/neutronclient/client.py", line 332, in _check_uri_length
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/neutronclient/client.py", line 346, in endpoint_url
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi return self.get_endpoint()
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/keystoneauth1/adapter.py", line 282, in get_endpoint
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/keystoneauth1/session.py", line 1225, in get_endpoint
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/keystoneauth1/identity/base.py", line 380, in get_endpoint
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi allow_version_hack=allow_version_hack, **kwargs)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/keystoneauth1/identity/v3/base.py", line 188, in get_auth_ref
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi authenticated=False, log=False, **rkwargs)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/keystoneauth1/session.py", line 1131, in post
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/keystoneauth1/session.py", line 968, in request
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-cf6d651d-9e14-45f7-a87c-4fd8f970046c)
2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi
2021-02-13 09:05:33.882 1428 INFO nova.api.openstack.wsgi [req-42b91a28-eaff-47aa-a7af-0d07b2ba768d 24f68ea810674751a3f3f81641402153 677c973f08a74a4d85368d3bfae359a7 - default default] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'keystoneauth1.exceptions.http.Unauthorized'>
2021-02-13 09:05:33.883 1428 INFO nova.api.openstack.requestlog [req-42b91a28-eaff-47aa-a7af-0d07b2ba768d 24f68ea810674751a3f3f81641402153 677c973f08a74a4d85368d3bfae359a7 - default default] 172.29.236.13 "POST /v2.1/servers" status: 500 len: 216 microversion: 2.1 time: 4.314794
[pid: 1428|app: 0|req: 10/40] 172.29.236.13 () {36 vars in 664 bytes} [Sat Feb 13 09:05:29 2021] POST /v2.1/servers => generated 216 bytes in 4320 msecs (HTTP/1.1 500) 7 headers in 351 bytes (1 switches on core 0)
Does other, simpler operations works in your environment?. E.g.: Does `openstack token issue` works? How do you specify your user, project, and password in this env, is it by sourcing some kind of openrc?