2023-01-06 11:26:33.694 388587 WARNING oslo_messaging.rpc.client [None req-6e6d4628-a393-4d04-8958-dbfcfda36c25 - - - - - -] Using RPCClient manually to instantiate client. Please use get_rpc_client to obtain an RPC client instance. 2023-01-06 11:26:33.695 388587 WARNING oslo_messaging.rpc.client [None req-6e6d4628-a393-4d04-8958-dbfcfda36c25 - - - - - -] Using RPCClient manually to instantiate client. Please use get_rpc_client to obtain an RPC client instance. 2023-01-06 11:26:33.695 388587 WARNING oslo_messaging.rpc.client [None req-6e6d4628-a393-4d04-8958-dbfcfda36c25 - - - - - -] Using RPCClient manually to instantiate client. Please use get_rpc_client to obtain an RPC client instance. 2023-01-06 11:26:33.696 388587 INFO nova.virt.driver [None req-6e6d4628-a393-4d04-8958-dbfcfda36c25 - - - - - -] Loading compute driver 'libvirt.LibvirtDriver' 2023-01-06 11:26:33.778 388587 INFO nova.compute.provider_config [None req-6e6d4628-a393-4d04-8958-dbfcfda36c25 - - - - - -] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access. 2023-01-06 11:26:33.799 388587 WARNING oslo_config.cfg [None req-6e6d4628-a393-4d04-8958-dbfcfda36c25 - - - - - -] Deprecated: Option "api_servers" from group "glance" is deprecated for removal ( Support for image service configuration via standard keystoneauth1 Adapter options was added in the 17.0.0 Queens release. The api_servers option was retained temporarily to allow consumers time to cut over to a real load balancing solution. ). Its value may be silently ignored in the future. 2023-01-06 11:26:33.815 388587 INFO nova.service [-] Starting compute node (version 26.1.0) 2023-01-06 11:26:33.835 388587 CRITICAL nova [-] Unhandled error: nova.exception.InternalError: Can not handle authentication request for 2 credentials 2023-01-06 11:26:33.835 388587 ERROR nova Traceback (most recent call last): 2023-01-06 11:26:33.835 388587 ERROR nova File "/opt/nova/venv/lib/python3.8/site-packages/nova/virt/libvirt/host.py", line 338, in _connect_auth_cb 2023-01-06 11:26:33.835 388587 ERROR nova raise exception.InternalError( 2023-01-06 11:26:33.835 388587 ERROR nova nova.exception.InternalError: Can not handle authentication request for 2 credentials 2023-01-06 11:26:33.835 388587 ERROR nova 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host [-] Connection to libvirt failed: authentication failed: Failed to collect auth credentials: libvirt.libvirtError: authentication failed: Failed to collect auth credentials 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host Traceback (most recent call last): 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host File "/opt/nova/venv/lib/python3.8/site-packages/nova/virt/libvirt/host.py", line 588, in get_connection 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host conn = self._get_connection() 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host File "/opt/nova/venv/lib/python3.8/site-packages/nova/virt/libvirt/host.py", line 568, in _get_connection 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host self._queue_conn_event_handler( 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host File "/opt/nova/venv/lib/python3.8/site-packages/oslo_utils/excutils.py", line 227, in __exit__ 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host self.force_reraise() 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host File "/opt/nova/venv/lib/python3.8/site-packages/oslo_utils/excutils.py", line 200, in force_reraise 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host raise self.value 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host File "/opt/nova/venv/lib/python3.8/site-packages/nova/virt/libvirt/host.py", line 560, in _get_connection 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host self._wrapped_conn = self._get_new_connection() 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host File "/opt/nova/venv/lib/python3.8/site-packages/nova/virt/libvirt/host.py", line 504, in _get_new_connection 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host wrapped_conn = self._connect(self._uri, self._read_only) 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host File "/opt/nova/venv/lib/python3.8/site-packages/nova/virt/libvirt/host.py", line 355, in _connect 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host return self._libvirt_proxy.openAuth(uri, auth, flags) 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host File "/opt/nova/venv/lib/python3.8/site-packages/eventlet/tpool.py", line 193, in doit 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host result = proxy_call(self._autowrap, f, *args, **kwargs) 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host File "/opt/nova/venv/lib/python3.8/site-packages/eventlet/tpool.py", line 151, in proxy_call 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host rv = execute(f, *args, **kwargs) 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host File "/opt/nova/venv/lib/python3.8/site-packages/eventlet/tpool.py", line 132, in execute 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host six.reraise(c, e, tb) 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host File "/opt/nova/venv/lib/python3.8/site-packages/six.py", line 719, in reraise 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host raise value 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host File "/opt/nova/venv/lib/python3.8/site-packages/eventlet/tpool.py", line 86, in tworker 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host rv = meth(*args, **kwargs) 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host File "/opt/nova/venv/lib/python3.8/site-packages/libvirt.py", line 147, in openAuth 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host raise libvirtError('virConnectOpenAuth() failed') 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host libvirt.libvirtError: authentication failed: Failed to collect auth credentials 2023-01-06 11:26:33.840 388587 ERROR nova.virt.libvirt.host 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service [None req-dab1701b-cce2-458c-a3a2-d7d7a36cb641 - - - - - -] Error starting thread.: nova.exception.HypervisorUnavailable: Connection to the hypervisor is broken on host 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service Traceback (most recent call last): 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service File "/opt/nova/venv/lib/python3.8/site-packages/nova/virt/libvirt/host.py", line 588, in get_connection 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service conn = self._get_connection() 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service File "/opt/nova/venv/lib/python3.8/site-packages/nova/virt/libvirt/host.py", line 568, in _get_connection 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service self._queue_conn_event_handler( 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service File "/opt/nova/venv/lib/python3.8/site-packages/oslo_utils/excutils.py", line 227, in __exit__ 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service self.force_reraise() 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service File "/opt/nova/venv/lib/python3.8/site-packages/oslo_utils/excutils.py", line 200, in force_reraise 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service raise self.value 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service File "/opt/nova/venv/lib/python3.8/site-packages/nova/virt/libvirt/host.py", line 560, in _get_connection 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service self._wrapped_conn = self._get_new_connection() 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service File "/opt/nova/venv/lib/python3.8/site-packages/nova/virt/libvirt/host.py", line 504, in _get_new_connection 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service wrapped_conn = self._connect(self._uri, self._read_only) 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service File "/opt/nova/venv/lib/python3.8/site-packages/nova/virt/libvirt/host.py", line 355, in _connect 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service return self._libvirt_proxy.openAuth(uri, auth, flags) 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service File "/opt/nova/venv/lib/python3.8/site-packages/eventlet/tpool.py", line 193, in doit 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service result = proxy_call(self._autowrap, f, *args, **kwargs) 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service File "/opt/nova/venv/lib/python3.8/site-packages/eventlet/tpool.py", line 151, in proxy_call 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service rv = execute(f, *args, **kwargs) 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service File "/opt/nova/venv/lib/python3.8/site-packages/eventlet/tpool.py", line 132, in execute 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service six.reraise(c, e, tb) 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service File "/opt/nova/venv/lib/python3.8/site-packages/six.py", line 719, in reraise 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service raise value 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service File "/opt/nova/venv/lib/python3.8/site-packages/eventlet/tpool.py", line 86, in tworker 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service rv = meth(*args, **kwargs) 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service File "/opt/nova/venv/lib/python3.8/site-packages/libvirt.py", line 147, in openAuth 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service raise libvirtError('virConnectOpenAuth() failed') 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service libvirt.libvirtError: authentication failed: Failed to collect auth credentials 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service During handling of the above exception, another exception occurred: 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service Traceback (most recent call last): 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service File "/opt/nova/venv/lib/python3.8/site-packages/oslo_service/service.py", line 806, in run_service 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service service.start() 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service File "/opt/nova/venv/lib/python3.8/site-packages/nova/service.py", line 159, in start 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service self.manager.init_host() 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service File "/opt/nova/venv/lib/python3.8/site-packages/nova/compute/manager.py", line 1526, in init_host 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service self.driver.init_host(host=self.host) 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service File "/opt/nova/venv/lib/python3.8/site-packages/nova/virt/libvirt/driver.py", line 726, in init_host 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service self._update_host_specific_capabilities() 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service File "/opt/nova/venv/lib/python3.8/site-packages/nova/virt/libvirt/driver.py", line 832, in _update_host_specific_capabilities 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service 'supports_secure_boot': self._host.supports_secure_boot, 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service File "/opt/nova/venv/lib/python3.8/site-packages/nova/virt/libvirt/host.py", line 1715, in supports_secure_boot 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service arch = self.get_capabilities().host.cpu.arch 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service File "/opt/nova/venv/lib/python3.8/site-packages/nova/virt/libvirt/host.py", line 783, in get_capabilities 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service xmlstr = self.get_connection().getCapabilities() 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service File "/opt/nova/venv/lib/python3.8/site-packages/nova/virt/libvirt/host.py", line 598, in get_connection 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service raise exception.HypervisorUnavailable() 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service nova.exception.HypervisorUnavailable: Connection to the hypervisor is broken on host 2023-01-06 11:26:33.844 388587 ERROR oslo_service.service 2023-01-06 11:26:33.852 388587 INFO nova.virt.libvirt.driver [-] Connection event '0' reason 'Failed to connect to libvirt: authentication failed: Failed to collect auth credentials'