2022-07-13 20:04:08.040 1938943 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 __log_wakeup /usr/lib64/python3.6/site-packages/ovs/poller.py:263 2022-07-13 20:04:08.587 1938943 DEBUG oslo_concurrency.lockutils [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Lock "c18565f9-da37-42e9-97b9-fa33da5f1ad0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner /usr/lib/python3.6/site-packages/oslo_concurrency/lockutils.py:359 2022-07-13 20:04:08.605 1938943 DEBUG nova.compute.manager [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Starting instance... _do_build_and_run_instance /usr/lib/python3.6/site-packages/nova/compute/manager.py:2244 2022-07-13 20:04:08.740 1938943 DEBUG oslo_concurrency.lockutils [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner /usr/lib/python3.6/site-packages/oslo_concurrency/lockutils.py:359 2022-07-13 20:04:08.744 1938943 DEBUG nova.virt.hardware [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host /usr/lib/python3.6/site-packages/nova/virt/hardware.py:2247 2022-07-13 20:04:08.744 1938943 INFO nova.compute.claims [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Claim successful on node openstack-nova-a40-gpu-0.sdsc.edu 2022-07-13 20:04:08.905 1938943 DEBUG oslo_concurrency.processutils [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Running cmd (subprocess): ceph df --format=json --id cinder --conf /etc/ceph/ceph.conf execute /usr/lib/python3.6/site-packages/oslo_concurrency/processutils.py:384 2022-07-13 20:04:09.044 1938943 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 __log_wakeup /usr/lib64/python3.6/site-packages/ovs/poller.py:263 2022-07-13 20:04:09.187 1938943 DEBUG oslo_concurrency.processutils [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] CMD "ceph df --format=json --id cinder --conf /etc/ceph/ceph.conf" returned: 0 in 0.282s execute /usr/lib/python3.6/site-packages/oslo_concurrency/processutils.py:423 2022-07-13 20:04:09.340 1938943 DEBUG nova.compute.provider_tree [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed in ProviderTree for provider: 21eb447a-5cab-4024-b65a-4f9eb6141183 update_inventory /usr/lib/python3.6/site-packages/nova/compute/provider_tree.py:181 2022-07-13 20:04:09.341 1938943 DEBUG nova.compute.provider_tree [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed in ProviderTree for provider: 52e042ee-06a3-4f63-abde-9860b6fb53f8 update_inventory /usr/lib/python3.6/site-packages/nova/compute/provider_tree.py:181 2022-07-13 20:04:09.341 1938943 DEBUG nova.compute.provider_tree [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed in ProviderTree for provider: 0e4cd478-c30b-4ee8-8449-426e41d02d08 update_inventory /usr/lib/python3.6/site-packages/nova/compute/provider_tree.py:181 2022-07-13 20:04:09.341 1938943 DEBUG nova.compute.provider_tree [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed in ProviderTree for provider: 879a3c61-33d7-4eb1-a1c9-0f04ce804dcb update_inventory /usr/lib/python3.6/site-packages/nova/compute/provider_tree.py:181 2022-07-13 20:04:09.342 1938943 DEBUG nova.compute.provider_tree [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed in ProviderTree for provider: 26e35628-f776-44e3-b969-51f99ad8e1be update_inventory /usr/lib/python3.6/site-packages/nova/compute/provider_tree.py:181 2022-07-13 20:04:09.342 1938943 DEBUG nova.compute.provider_tree [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed in ProviderTree for provider: 6dc173ae-1b8b-4314-b658-7d149aa1b581 update_inventory /usr/lib/python3.6/site-packages/nova/compute/provider_tree.py:181 2022-07-13 20:04:09.342 1938943 DEBUG nova.compute.provider_tree [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed in ProviderTree for provider: 875fc62c-a335-4074-a5f4-5c2aa8600347 update_inventory /usr/lib/python3.6/site-packages/nova/compute/provider_tree.py:181 2022-07-13 20:04:09.343 1938943 DEBUG nova.compute.provider_tree [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed in ProviderTree for provider: a1d7a8e2-9b1e-4a12-86e1-ef889f31ba16 update_inventory /usr/lib/python3.6/site-packages/nova/compute/provider_tree.py:181 2022-07-13 20:04:09.343 1938943 DEBUG nova.compute.provider_tree [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed in ProviderTree for provider: 6395cc0f-01b1-46c8-9e3a-a8504a0fbb1e update_inventory /usr/lib/python3.6/site-packages/nova/compute/provider_tree.py:181 2022-07-13 20:04:09.363 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 03ff5725-b1f1-428c-9d9d-49f77bbfb028 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.363 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 404bd87c-e124-4c01-8fd1-9c45f9431403 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.364 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider a3551e29-ee60-45ce-bdcd-66afe60609b2 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.364 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 9301164d-3816-4acf-bc99-6a71f69d3f2b based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.365 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 2aff0a21-7d15-4d35-9dca-47ceb14272f1 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.365 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 875fc62c-a335-4074-a5f4-5c2aa8600347 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.365 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 2a4e80fd-1298-4ee0-af2b-fda0367019ab based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.366 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 38114077-73f9-441f-baa1-ea9aedb81e81 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.366 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 13593d1d-a498-4391-b477-ea30a85ff63d based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.366 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider a4e8060f-c29d-42fa-bb3f-e062a9c5a191 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.367 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider a1d7a8e2-9b1e-4a12-86e1-ef889f31ba16 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.367 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 21eb447a-5cab-4024-b65a-4f9eb6141183 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.367 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 879a3c61-33d7-4eb1-a1c9-0f04ce804dcb based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.368 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider ef59cdcc-eb5a-40c3-9d64-96bf47ad1391 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.368 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 417f155f-e431-4528-994c-c05b461f8711 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.368 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider e79c72c4-b706-4985-a426-477beb6f0773 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.369 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 83d7ee45-22bc-4c66-8d53-306b0959249c based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.369 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 0f5820c3-4f60-4c67-a330-99136238b2e4 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.369 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 2b92adde-3dfa-43d4-84cf-7afa0967f61f based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.370 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 9bdeaf4e-5219-4299-9f7e-09c297c1bb87 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.370 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider e2c3c3ea-0035-47b6-8bfc-95b999af6f9a based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.370 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider da7fa2fc-3b6b-41ec-9858-bf7c289f4443 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.371 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 26e35628-f776-44e3-b969-51f99ad8e1be based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.371 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 36eb0c12-a6db-4917-a300-479a490ec74c based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.371 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider a4a09a66-3947-4d19-9d03-c73b31087868 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.372 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider a21cd2a8-c64c-4790-a8c6-7cec545a7874 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.372 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 0b5bee80-13be-43e1-ac6b-a5e4ef8bf21d based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.372 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider d6577c6a-9fe9-444b-aec8-bb3a1b84c73e based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.373 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider af701b60-1154-411c-94d7-0ec8b99506fc based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.373 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 10506e2e-4e00-40cb-9507-cf2fb2b37090 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.373 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 3bcd3193-b8f0-4bba-9ae8-77286417c194 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.374 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 784b7846-9ea4-41ba-86c4-ac0f27d4191b based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.374 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 11d81af6-6130-49ff-ac76-8dcc5011840c based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.374 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 67543b35-789f-44fc-b7c0-6bc21eee8d2c based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.375 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 2f740ce8-69a3-4feb-8354-f5b0d514db0d based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.375 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider aa50f39b-db52-4cba-b4c4-d83fb744aa1d based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.375 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider d5e712f1-6f14-481c-b171-93d022d35e4f based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.376 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 2ea40c9f-548f-48b4-addc-e5ac92611c6f based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.376 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 87f356ed-150c-4f3a-9e91-93fc30a25173 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.376 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 8d0c768a-2492-4543-990a-ac5e0e0654e7 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.377 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 12d8b5a9-70c2-4252-854e-533762d20be2 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.377 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 3a501b9a-ba08-4cab-9cd1-8e152aae3f90 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.377 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 908c072e-b882-4823-a1d6-729143917ff6 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.378 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider f19f86cd-f206-4f2e-b4ad-2486ca2570bf based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.378 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 17736b4e-d133-44bc-8f08-af27b3b3cbbb based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.378 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 0e4cd478-c30b-4ee8-8449-426e41d02d08 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.379 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 52e042ee-06a3-4f63-abde-9860b6fb53f8 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.379 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 9848453d-0a48-4a1c-9d28-c28fc820dee5 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.379 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider fbacd5d6-59e6-488a-8ed1-fbfc3a89413e based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.380 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 5416598b-69c8-494d-af67-c04fb4c9478c based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.380 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider e3fda9e3-5438-43e2-9b2b-155c4a4a8fc4 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.380 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 71526cdf-fc44-4810-9395-cc15e5f5157b based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.381 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider bc52fc83-b598-4f1b-9127-560699e9f6b1 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.381 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider a05c6bbb-7383-4fb3-967e-9fcbda088f1c based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.381 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 8830e51c-ec57-4d39-9b3f-acf7009c0fd8 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.382 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 4bd01518-4a33-4666-8a6d-4087076b0b0d based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.382 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 1302453f-8e00-47cc-a168-a3c116845622 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.382 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 5d16209f-564e-47f3-81c6-36c5b226bdb1 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.383 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 52f1a7d8-e925-4465-be5c-29247f417ca5 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.383 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 8acde315-bab8-427f-8e84-fff58708d6fb based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.384 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 3f1b4c78-1907-4fa5-91d5-2a971527d6b6 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.384 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 6dc173ae-1b8b-4314-b658-7d149aa1b581 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.384 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 12f8fbaf-ca18-4b57-83df-21e6292c8efa based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.385 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider d12c95f5-10ef-4855-a367-6da218ebaaca based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.385 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 6395cc0f-01b1-46c8-9e3a-a8504a0fbb1e based on inventory data: {'VCPU': {'total': 32, 'reserved': 0, 'min_unit': 1, 'max_unit': 32, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 257274, 'reserved': 512, 'min_unit': 1, 'max_unit': 257274, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 223436, 'reserved': 0, 'min_unit': 1, 'max_unit': 223436, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:09.385 1938943 DEBUG oslo_concurrency.lockutils [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.645s inner /usr/lib/python3.6/site-packages/oslo_concurrency/lockutils.py:371 2022-07-13 20:04:09.386 1938943 DEBUG nova.compute.manager [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Start building networks asynchronously for instance. _build_resources /usr/lib/python3.6/site-packages/nova/compute/manager.py:2598 2022-07-13 20:04:09.499 1938943 DEBUG nova.compute.manager [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Allocating IP information in the background. _allocate_network_async /usr/lib/python3.6/site-packages/nova/compute/manager.py:1788 2022-07-13 20:04:09.500 1938943 DEBUG nova.network.neutron [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] allocate_for_instance() allocate_for_instance /usr/lib/python3.6/site-packages/nova/network/neutron.py:1016 2022-07-13 20:04:09.518 1938943 INFO nova.virt.libvirt.driver [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names 2022-07-13 20:04:09.540 1938943 DEBUG nova.compute.manager [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Start building block device mappings for instance. _build_resources /usr/lib/python3.6/site-packages/nova/compute/manager.py:2633 2022-07-13 20:04:09.655 1938943 INFO nova.virt.block_device [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Booting with volume-backed-image 3ca4f24e-9b37-42ae-ac46-633844ab2f4d at /dev/vda 2022-07-13 20:04:09.773 1938943 DEBUG nova.policy [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e28435e0a66740968c523e6376c57f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18882d9c32ba42aeaa33c4703ad84b2c', 'project_domain_id': 'default', 'roles': ['heat_stack_owner', '_member_', 'creator'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize /usr/lib/python3.6/site-packages/nova/policy.py:225 2022-07-13 20:04:10.848 1938943 DEBUG nova.network.neutron [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Successfully created port: 9259e174-afa1-4f9a-ab50-56fcaa1a196a _create_port_minimal /usr/lib/python3.6/site-packages/nova/network/neutron.py:548 2022-07-13 20:04:12.672 1938943 DEBUG nova.network.neutron [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Successfully updated port: 9259e174-afa1-4f9a-ab50-56fcaa1a196a _update_port /usr/lib/python3.6/site-packages/nova/network/neutron.py:586 2022-07-13 20:04:12.686 1938943 DEBUG oslo_concurrency.lockutils [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Acquired lock "refresh_cache-c18565f9-da37-42e9-97b9-fa33da5f1ad0" lock /usr/lib/python3.6/site-packages/oslo_concurrency/lockutils.py:266 2022-07-13 20:04:12.686 1938943 DEBUG nova.network.neutron [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Building network info cache for instance _get_instance_nw_info /usr/lib/python3.6/site-packages/nova/network/neutron.py:1839 2022-07-13 20:04:12.899 1938943 DEBUG nova.network.neutron [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Instance cache missing network info. _get_preexisting_port_ids /usr/lib/python3.6/site-packages/nova/network/neutron.py:2996 2022-07-13 20:04:12.991 1938943 DEBUG nova.compute.manager [req-a6e195fd-ea7f-4b21-b38b-468723af3373 2940af67c5b148579a6607174281ee96 dfc0dd6b7262421ea8e4ca9f345ecae1 - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Received event network-changed-9259e174-afa1-4f9a-ab50-56fcaa1a196a external_instance_event /usr/lib/python3.6/site-packages/nova/compute/manager.py:10472 2022-07-13 20:04:12.991 1938943 DEBUG nova.compute.manager [req-a6e195fd-ea7f-4b21-b38b-468723af3373 2940af67c5b148579a6607174281ee96 dfc0dd6b7262421ea8e4ca9f345ecae1 - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Refreshing instance network info cache due to event network-changed-9259e174-afa1-4f9a-ab50-56fcaa1a196a. external_instance_event /usr/lib/python3.6/site-packages/nova/compute/manager.py:10476 2022-07-13 20:04:13.041 1938943 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 __log_wakeup /usr/lib64/python3.6/site-packages/ovs/poller.py:263 2022-07-13 20:04:13.425 1938943 DEBUG nova.network.neutron [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Updating instance_info_cache with network_info: [{"id": "9259e174-afa1-4f9a-ab50-56fcaa1a196a", "address": "fa:16:3e:c0:a4:73", "network": {"id": "aed09c75-74e0-447a-936e-7362ad77597b", "bridge": "br-int", "label": "tenant-b-net", "subnets": [{"cidr": "192.168.2.0/24", "dns": [], "gateway": {"address": "192.168.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.2.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.2.3"}}], "meta": {"injected": false, "tenant_id": "18882d9c32ba42aeaa33c4703ad84b2c", "mtu": 1458, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": true, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap9259e174-af", "ovs_interfaceid": "9259e174-afa1-4f9a-ab50-56fcaa1a196a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] update_instance_cache_with_nw_info /usr/lib/python3.6/site-packages/nova/network/neutron.py:117 2022-07-13 20:04:13.444 1938943 DEBUG oslo_concurrency.lockutils [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Releasing lock "refresh_cache-c18565f9-da37-42e9-97b9-fa33da5f1ad0" lock /usr/lib/python3.6/site-packages/oslo_concurrency/lockutils.py:282 2022-07-13 20:04:13.444 1938943 DEBUG nova.compute.manager [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Instance network_info: |[{"id": "9259e174-afa1-4f9a-ab50-56fcaa1a196a", "address": "fa:16:3e:c0:a4:73", "network": {"id": "aed09c75-74e0-447a-936e-7362ad77597b", "bridge": "br-int", "label": "tenant-b-net", "subnets": [{"cidr": "192.168.2.0/24", "dns": [], "gateway": {"address": "192.168.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.2.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.2.3"}}], "meta": {"injected": false, "tenant_id": "18882d9c32ba42aeaa33c4703ad84b2c", "mtu": 1458, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": true, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap9259e174-af", "ovs_interfaceid": "9259e174-afa1-4f9a-ab50-56fcaa1a196a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}]| _allocate_network_async /usr/lib/python3.6/site-packages/nova/compute/manager.py:1802 2022-07-13 20:04:13.445 1938943 DEBUG oslo_concurrency.lockutils [req-a6e195fd-ea7f-4b21-b38b-468723af3373 2940af67c5b148579a6607174281ee96 dfc0dd6b7262421ea8e4ca9f345ecae1 - default default] Acquired lock "refresh_cache-c18565f9-da37-42e9-97b9-fa33da5f1ad0" lock /usr/lib/python3.6/site-packages/oslo_concurrency/lockutils.py:266 2022-07-13 20:04:13.445 1938943 DEBUG nova.network.neutron [req-a6e195fd-ea7f-4b21-b38b-468723af3373 2940af67c5b148579a6607174281ee96 dfc0dd6b7262421ea8e4ca9f345ecae1 - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Refreshing network info cache for port 9259e174-afa1-4f9a-ab50-56fcaa1a196a _get_instance_nw_info /usr/lib/python3.6/site-packages/nova/network/neutron.py:1836 2022-07-13 20:04:13.521 1938943 DEBUG oslo_service.periodic_task [req-235f0b03-4b51-43e2-a44f-3218c19131dd - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks /usr/lib/python3.6/site-packages/oslo_service/periodic_task.py:211 2022-07-13 20:04:13.674 1938943 DEBUG os_brick.utils [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.1.2.60', 'multipath': False, 'enforce_multipath': True, 'host': 'openstack-nova-a40-gpu-0.sdsc.edu', 'execute': None}" trace_logging_wrapper /usr/lib/python3.6/site-packages/os_brick/utils.py:153 2022-07-13 20:04:13.681 1938943 DEBUG os_brick.initiator.linuxfc [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] No Fibre Channel support detected on system. get_fc_hbas /usr/lib/python3.6/site-packages/os_brick/initiator/linuxfc.py:157 2022-07-13 20:04:13.681 1938943 DEBUG os_brick.initiator.linuxfc [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] No Fibre Channel support detected on system. get_fc_hbas /usr/lib/python3.6/site-packages/os_brick/initiator/linuxfc.py:157 2022-07-13 20:04:13.687 1938943 DEBUG os_brick.utils [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] <== get_connector_properties: return (11ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.1.2.60', 'host': 'openstack-nova-a40-gpu-0.sdsc.edu', 'multipath': False, 'initiator': 'iqn.1994-05.com.redhat:843831b7bbc', 'do_local_attach': False, 'system uuid': '4c4c4544-004a-3110-8047-b7c04f4e4633'} trace_logging_wrapper /usr/lib/python3.6/site-packages/os_brick/utils.py:177 2022-07-13 20:04:13.687 1938943 DEBUG nova.virt.block_device [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Updating existing volume attachment record: d2980658-5eb8-4ff8-8054-edb3967a171e _volume_attach /usr/lib/python3.6/site-packages/nova/virt/block_device.py:570 2022-07-13 20:04:14.046 1938943 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 __log_wakeup /usr/lib64/python3.6/site-packages/ovs/poller.py:263 2022-07-13 20:04:14.106 1938943 DEBUG nova.network.neutron [req-a6e195fd-ea7f-4b21-b38b-468723af3373 2940af67c5b148579a6607174281ee96 dfc0dd6b7262421ea8e4ca9f345ecae1 - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Updated VIF entry in instance network info cache for port 9259e174-afa1-4f9a-ab50-56fcaa1a196a. _build_network_info_model /usr/lib/python3.6/site-packages/nova/network/neutron.py:3129 2022-07-13 20:04:14.107 1938943 DEBUG nova.network.neutron [req-a6e195fd-ea7f-4b21-b38b-468723af3373 2940af67c5b148579a6607174281ee96 dfc0dd6b7262421ea8e4ca9f345ecae1 - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Updating instance_info_cache with network_info: [{"id": "9259e174-afa1-4f9a-ab50-56fcaa1a196a", "address": "fa:16:3e:c0:a4:73", "network": {"id": "aed09c75-74e0-447a-936e-7362ad77597b", "bridge": "br-int", "label": "tenant-b-net", "subnets": [{"cidr": "192.168.2.0/24", "dns": [], "gateway": {"address": "192.168.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.2.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.2.3"}}], "meta": {"injected": false, "tenant_id": "18882d9c32ba42aeaa33c4703ad84b2c", "mtu": 1458, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": true, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap9259e174-af", "ovs_interfaceid": "9259e174-afa1-4f9a-ab50-56fcaa1a196a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] update_instance_cache_with_nw_info /usr/lib/python3.6/site-packages/nova/network/neutron.py:117 2022-07-13 20:04:14.124 1938943 DEBUG oslo_concurrency.lockutils [req-a6e195fd-ea7f-4b21-b38b-468723af3373 2940af67c5b148579a6607174281ee96 dfc0dd6b7262421ea8e4ca9f345ecae1 - default default] Releasing lock "refresh_cache-c18565f9-da37-42e9-97b9-fa33da5f1ad0" lock /usr/lib/python3.6/site-packages/oslo_concurrency/lockutils.py:282 2022-07-13 20:04:15.232 1938943 DEBUG nova.compute.manager [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Start spawning the instance on the hypervisor. _build_and_run_instance /usr/lib/python3.6/site-packages/nova/compute/manager.py:2440 2022-07-13 20:04:15.233 1938943 DEBUG nova.virt.libvirt.driver [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Creating instance directory _create_image /usr/lib/python3.6/site-packages/nova/virt/libvirt/driver.py:4090 2022-07-13 20:04:15.233 1938943 INFO nova.virt.libvirt.driver [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Creating image 2022-07-13 20:04:15.234 1938943 DEBUG nova.virt.libvirt.driver [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Did not create local disks _create_image /usr/lib/python3.6/site-packages/nova/virt/libvirt/driver.py:4225 2022-07-13 20:04:15.234 1938943 DEBUG nova.virt.libvirt.driver [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Ensure instance console log exists: /var/lib/nova/instances/c18565f9-da37-42e9-97b9-fa33da5f1ad0/console.log _ensure_console_log_for_instance /usr/lib/python3.6/site-packages/nova/virt/libvirt/driver.py:3981 2022-07-13 20:04:15.234 1938943 DEBUG oslo_concurrency.lockutils [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s inner /usr/lib/python3.6/site-packages/oslo_concurrency/lockutils.py:359 2022-07-13 20:04:15.367 1938943 DEBUG oslo_concurrency.lockutils [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Lock "vgpu_resources" released by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.133s inner /usr/lib/python3.6/site-packages/oslo_concurrency/lockutils.py:371 2022-07-13 20:04:15.368 1938943 ERROR nova.compute.manager [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Instance failed to spawn: nova.exception.ComputeResourcesUnavailable: Insufficient compute resources: vGPU resource is not available. 2022-07-13 20:04:15.368 1938943 ERROR nova.compute.manager [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Traceback (most recent call last): 2022-07-13 20:04:15.368 1938943 ERROR nova.compute.manager [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] File "/usr/lib/python3.6/site-packages/nova/compute/manager.py", line 2673, in _build_resources 2022-07-13 20:04:15.368 1938943 ERROR nova.compute.manager [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] yield resources 2022-07-13 20:04:15.368 1938943 ERROR nova.compute.manager [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] File "/usr/lib/python3.6/site-packages/nova/compute/manager.py", line 2446, in _build_and_run_instance 2022-07-13 20:04:15.368 1938943 ERROR nova.compute.manager [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] accel_info=accel_info) 2022-07-13 20:04:15.368 1938943 ERROR nova.compute.manager [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 3769, in spawn 2022-07-13 20:04:15.368 1938943 ERROR nova.compute.manager [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] mdevs = self._allocate_mdevs(allocations) 2022-07-13 20:04:15.368 1938943 ERROR nova.compute.manager [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] File "/usr/lib/python3.6/site-packages/oslo_concurrency/lockutils.py", line 360, in inner 2022-07-13 20:04:15.368 1938943 ERROR nova.compute.manager [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] return f(*args, **kwargs) 2022-07-13 20:04:15.368 1938943 ERROR nova.compute.manager [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 7587, in _allocate_mdevs 2022-07-13 20:04:15.368 1938943 ERROR nova.compute.manager [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] reason='vGPU resource is not available') 2022-07-13 20:04:15.368 1938943 ERROR nova.compute.manager [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] nova.exception.ComputeResourcesUnavailable: Insufficient compute resources: vGPU resource is not available. 2022-07-13 20:04:15.368 1938943 ERROR nova.compute.manager [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] 2022-07-13 20:04:15.369 1938943 INFO nova.compute.manager [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Terminating instance 2022-07-13 20:04:15.369 1938943 DEBUG nova.compute.manager [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Start destroying the instance on the hypervisor. _shutdown_instance /usr/lib/python3.6/site-packages/nova/compute/manager.py:2905 2022-07-13 20:04:15.371 1938943 DEBUG nova.virt.libvirt.driver [-] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] During wait destroy, instance disappeared. _wait_for_destroy /usr/lib/python3.6/site-packages/nova/virt/libvirt/driver.py:1310 2022-07-13 20:04:15.371 1938943 INFO nova.virt.libvirt.driver [-] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Instance destroyed successfully. 2022-07-13 20:04:15.372 1938943 DEBUG nova.virt.libvirt.vif [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=True,availability_zone='West-Datacenter',cell_name=None,cleaned=False,config_drive='',created_at=2022-07-13T20:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='colby_gpu_test23',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(249),hidden=False,host='openstack-nova-a40-gpu-0.sdsc.edu',hostname='colby-gpu-test23',id=83265,image_ref='',info_cache=InstanceInfoCache,instance_type_id=249,kernel_id='',key_data='ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAIEAqURlIIp/9DmV5hEnUGFbJUrtr/0+GbyMnW6s+bDEjjqC9pUG9DTBmNy3Dzhl5emuHHf/wR5aYFCmg42kU/nuWTMv5zJkzngnW3MJ61ozXGviRNF+X5Hl09UE3V1X/ANq+WpagRF7eSR56qoQKjAkQJ06Ng+C3f1oQNvr1Gi7aZ8= colby@beeker',key_name='colby',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='openstack-nova-a40-gpu-0.sdsc.edu',locked=False,locked_by=None,memory_mb=24576,metadata={},migration_context=,new_flavor=None,node='openstack-nova-a40-gpu-0.sdsc.edu',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18882d9c32ba42aeaa33c4703ad84b2c',ramdisk_id='',reservation_id='r-9kc66bji',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='heat_stack_owner,_member_,creator',image_base_image_ref='',image_container_format='bare',image_disk_format='raw',image_min_disk='20',image_min_ram='2048',network_allocated='True',owner_project_name='colby',owner_user_name='colby'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2022-07-13T20:04:09Z,user_data=None,user_id='e28435e0a66740968c523e6376c57f68',uuid=c18565f9-da37-42e9-97b9-fa33da5f1ad0,vcpu_model=None,vcpus=2,vm_mode=None,vm_state='building') vif={"id": "9259e174-afa1-4f9a-ab50-56fcaa1a196a", "address": "fa:16:3e:c0:a4:73", "network": {"id": "aed09c75-74e0-447a-936e-7362ad77597b", "bridge": "br-int", "label": "tenant-b-net", "subnets": [{"cidr": "192.168.2.0/24", "dns": [], "gateway": {"address": "192.168.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.2.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.2.3"}}], "meta": {"injected": false, "tenant_id": "18882d9c32ba42aeaa33c4703ad84b2c", "mtu": 1458, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": true, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap9259e174-af", "ovs_interfaceid": "9259e174-afa1-4f9a-ab50-56fcaa1a196a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}} unplug /usr/lib/python3.6/site-packages/nova/virt/libvirt/vif.py:813 2022-07-13 20:04:15.372 1938943 DEBUG nova.network.os_vif_util [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Converting VIF {"id": "9259e174-afa1-4f9a-ab50-56fcaa1a196a", "address": "fa:16:3e:c0:a4:73", "network": {"id": "aed09c75-74e0-447a-936e-7362ad77597b", "bridge": "br-int", "label": "tenant-b-net", "subnets": [{"cidr": "192.168.2.0/24", "dns": [], "gateway": {"address": "192.168.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.2.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.2.3"}}], "meta": {"injected": false, "tenant_id": "18882d9c32ba42aeaa33c4703ad84b2c", "mtu": 1458, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": true, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap9259e174-af", "ovs_interfaceid": "9259e174-afa1-4f9a-ab50-56fcaa1a196a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}} nova_to_osvif_vif /usr/lib/python3.6/site-packages/nova/network/os_vif_util.py:501 2022-07-13 20:04:15.373 1938943 DEBUG nova.network.os_vif_util [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Converted object VIFBridge(active=False,address=fa:16:3e:c0:a4:73,bridge_name='qbr9259e174-af',has_traffic_filtering=True,id=9259e174-afa1-4f9a-ab50-56fcaa1a196a,network=Network(aed09c75-74e0-447a-936e-7362ad77597b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9259e174-af') nova_to_osvif_vif /usr/lib/python3.6/site-packages/nova/network/os_vif_util.py:538 2022-07-13 20:04:15.373 1938943 DEBUG os_vif [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Unplugging vif VIFBridge(active=False,address=fa:16:3e:c0:a4:73,bridge_name='qbr9259e174-af',has_traffic_filtering=True,id=9259e174-afa1-4f9a-ab50-56fcaa1a196a,network=Network(aed09c75-74e0-447a-936e-7362ad77597b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9259e174-af') unplug /usr/lib/python3.6/site-packages/os_vif/__init__.py:109 2022-07-13 20:04:15.376 1938943 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.6/site-packages/ovs/poller.py:263 2022-07-13 20:04:15.376 1938943 DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(port=qvo9259e174-af, bridge=br-int, if_exists=True) do_commit /usr/lib/python3.6/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:90 2022-07-13 20:04:15.376 1938943 DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change do_commit /usr/lib/python3.6/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:133 2022-07-13 20:04:15.378 1938943 INFO os_vif [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Successfully unplugged vif VIFBridge(active=False,address=fa:16:3e:c0:a4:73,bridge_name='qbr9259e174-af',has_traffic_filtering=True,id=9259e174-afa1-4f9a-ab50-56fcaa1a196a,network=Network(aed09c75-74e0-447a-936e-7362ad77597b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9259e174-af') 2022-07-13 20:04:15.443 1938943 INFO nova.virt.libvirt.driver [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Deleting instance files /var/lib/nova/instances/c18565f9-da37-42e9-97b9-fa33da5f1ad0_del 2022-07-13 20:04:15.443 1938943 INFO nova.virt.libvirt.driver [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Deletion of /var/lib/nova/instances/c18565f9-da37-42e9-97b9-fa33da5f1ad0_del complete 2022-07-13 20:04:15.564 1938943 INFO nova.compute.manager [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Took 0.19 seconds to destroy the instance on the hypervisor. 2022-07-13 20:04:15.798 1938943 INFO nova.compute.manager [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Took 0.23 seconds to detach 1 volumes for instance. 2022-07-13 20:04:15.799 1938943 DEBUG nova.compute.claims [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Aborting claim: abort /usr/lib/python3.6/site-packages/nova/compute/claims.py:82 2022-07-13 20:04:15.799 1938943 DEBUG oslo_concurrency.lockutils [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner /usr/lib/python3.6/site-packages/oslo_concurrency/lockutils.py:359 2022-07-13 20:04:15.958 1938943 DEBUG oslo_concurrency.processutils [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Running cmd (subprocess): ceph df --format=json --id cinder --conf /etc/ceph/ceph.conf execute /usr/lib/python3.6/site-packages/oslo_concurrency/processutils.py:384 2022-07-13 20:04:16.238 1938943 DEBUG oslo_concurrency.processutils [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] CMD "ceph df --format=json --id cinder --conf /etc/ceph/ceph.conf" returned: 0 in 0.280s execute /usr/lib/python3.6/site-packages/oslo_concurrency/processutils.py:423 2022-07-13 20:04:16.378 1938943 DEBUG nova.compute.provider_tree [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed in ProviderTree for provider: 21eb447a-5cab-4024-b65a-4f9eb6141183 update_inventory /usr/lib/python3.6/site-packages/nova/compute/provider_tree.py:181 2022-07-13 20:04:16.378 1938943 DEBUG nova.compute.provider_tree [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed in ProviderTree for provider: 52e042ee-06a3-4f63-abde-9860b6fb53f8 update_inventory /usr/lib/python3.6/site-packages/nova/compute/provider_tree.py:181 2022-07-13 20:04:16.379 1938943 DEBUG nova.compute.provider_tree [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed in ProviderTree for provider: 0e4cd478-c30b-4ee8-8449-426e41d02d08 update_inventory /usr/lib/python3.6/site-packages/nova/compute/provider_tree.py:181 2022-07-13 20:04:16.379 1938943 DEBUG nova.compute.provider_tree [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed in ProviderTree for provider: 879a3c61-33d7-4eb1-a1c9-0f04ce804dcb update_inventory /usr/lib/python3.6/site-packages/nova/compute/provider_tree.py:181 2022-07-13 20:04:16.380 1938943 DEBUG nova.compute.provider_tree [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed in ProviderTree for provider: 26e35628-f776-44e3-b969-51f99ad8e1be update_inventory /usr/lib/python3.6/site-packages/nova/compute/provider_tree.py:181 2022-07-13 20:04:16.380 1938943 DEBUG nova.compute.provider_tree [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed in ProviderTree for provider: 6dc173ae-1b8b-4314-b658-7d149aa1b581 update_inventory /usr/lib/python3.6/site-packages/nova/compute/provider_tree.py:181 2022-07-13 20:04:16.380 1938943 DEBUG nova.compute.provider_tree [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed in ProviderTree for provider: 875fc62c-a335-4074-a5f4-5c2aa8600347 update_inventory /usr/lib/python3.6/site-packages/nova/compute/provider_tree.py:181 2022-07-13 20:04:16.381 1938943 DEBUG nova.compute.provider_tree [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed in ProviderTree for provider: a1d7a8e2-9b1e-4a12-86e1-ef889f31ba16 update_inventory /usr/lib/python3.6/site-packages/nova/compute/provider_tree.py:181 2022-07-13 20:04:16.381 1938943 DEBUG nova.compute.provider_tree [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed in ProviderTree for provider: 6395cc0f-01b1-46c8-9e3a-a8504a0fbb1e update_inventory /usr/lib/python3.6/site-packages/nova/compute/provider_tree.py:181 2022-07-13 20:04:16.401 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 03ff5725-b1f1-428c-9d9d-49f77bbfb028 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.402 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 404bd87c-e124-4c01-8fd1-9c45f9431403 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.402 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider a3551e29-ee60-45ce-bdcd-66afe60609b2 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.403 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 9301164d-3816-4acf-bc99-6a71f69d3f2b based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.403 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 2aff0a21-7d15-4d35-9dca-47ceb14272f1 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.403 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 875fc62c-a335-4074-a5f4-5c2aa8600347 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.404 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 2a4e80fd-1298-4ee0-af2b-fda0367019ab based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.404 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 38114077-73f9-441f-baa1-ea9aedb81e81 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.404 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 13593d1d-a498-4391-b477-ea30a85ff63d based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.405 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider a4e8060f-c29d-42fa-bb3f-e062a9c5a191 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.405 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider a1d7a8e2-9b1e-4a12-86e1-ef889f31ba16 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.405 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 21eb447a-5cab-4024-b65a-4f9eb6141183 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.406 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 879a3c61-33d7-4eb1-a1c9-0f04ce804dcb based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.406 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider ef59cdcc-eb5a-40c3-9d64-96bf47ad1391 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.406 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 417f155f-e431-4528-994c-c05b461f8711 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.407 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider e79c72c4-b706-4985-a426-477beb6f0773 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.407 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 83d7ee45-22bc-4c66-8d53-306b0959249c based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.407 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 0f5820c3-4f60-4c67-a330-99136238b2e4 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.408 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 2b92adde-3dfa-43d4-84cf-7afa0967f61f based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.408 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 9bdeaf4e-5219-4299-9f7e-09c297c1bb87 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.409 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider e2c3c3ea-0035-47b6-8bfc-95b999af6f9a based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.409 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider da7fa2fc-3b6b-41ec-9858-bf7c289f4443 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.409 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 26e35628-f776-44e3-b969-51f99ad8e1be based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.410 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 36eb0c12-a6db-4917-a300-479a490ec74c based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.410 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider a4a09a66-3947-4d19-9d03-c73b31087868 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.410 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider a21cd2a8-c64c-4790-a8c6-7cec545a7874 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.411 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 0b5bee80-13be-43e1-ac6b-a5e4ef8bf21d based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.411 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider d6577c6a-9fe9-444b-aec8-bb3a1b84c73e based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.411 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider af701b60-1154-411c-94d7-0ec8b99506fc based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.412 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 10506e2e-4e00-40cb-9507-cf2fb2b37090 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.412 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 3bcd3193-b8f0-4bba-9ae8-77286417c194 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.412 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 784b7846-9ea4-41ba-86c4-ac0f27d4191b based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.413 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 11d81af6-6130-49ff-ac76-8dcc5011840c based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.413 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 67543b35-789f-44fc-b7c0-6bc21eee8d2c based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.413 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 2f740ce8-69a3-4feb-8354-f5b0d514db0d based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.414 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider aa50f39b-db52-4cba-b4c4-d83fb744aa1d based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.414 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider d5e712f1-6f14-481c-b171-93d022d35e4f based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.414 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 2ea40c9f-548f-48b4-addc-e5ac92611c6f based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.415 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 87f356ed-150c-4f3a-9e91-93fc30a25173 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.415 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 8d0c768a-2492-4543-990a-ac5e0e0654e7 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.415 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 12d8b5a9-70c2-4252-854e-533762d20be2 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.416 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 3a501b9a-ba08-4cab-9cd1-8e152aae3f90 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.416 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 908c072e-b882-4823-a1d6-729143917ff6 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.416 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider f19f86cd-f206-4f2e-b4ad-2486ca2570bf based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.417 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 17736b4e-d133-44bc-8f08-af27b3b3cbbb based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.417 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 0e4cd478-c30b-4ee8-8449-426e41d02d08 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.417 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 52e042ee-06a3-4f63-abde-9860b6fb53f8 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.418 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 9848453d-0a48-4a1c-9d28-c28fc820dee5 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.418 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider fbacd5d6-59e6-488a-8ed1-fbfc3a89413e based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.418 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 5416598b-69c8-494d-af67-c04fb4c9478c based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.419 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider e3fda9e3-5438-43e2-9b2b-155c4a4a8fc4 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.419 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 71526cdf-fc44-4810-9395-cc15e5f5157b based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.420 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider bc52fc83-b598-4f1b-9127-560699e9f6b1 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.420 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider a05c6bbb-7383-4fb3-967e-9fcbda088f1c based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.420 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 8830e51c-ec57-4d39-9b3f-acf7009c0fd8 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.421 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 4bd01518-4a33-4666-8a6d-4087076b0b0d based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.421 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 1302453f-8e00-47cc-a168-a3c116845622 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.421 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 5d16209f-564e-47f3-81c6-36c5b226bdb1 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.422 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 52f1a7d8-e925-4465-be5c-29247f417ca5 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.422 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 8acde315-bab8-427f-8e84-fff58708d6fb based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.422 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 3f1b4c78-1907-4fa5-91d5-2a971527d6b6 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.423 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 6dc173ae-1b8b-4314-b658-7d149aa1b581 based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.423 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 12f8fbaf-ca18-4b57-83df-21e6292c8efa based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.423 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider d12c95f5-10ef-4855-a367-6da218ebaaca based on inventory data: {'VGPU': {'total': 1, 'reserved': 0, 'min_unit': 1, 'max_unit': 1, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.424 1938943 DEBUG nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Inventory has not changed for provider 6395cc0f-01b1-46c8-9e3a-a8504a0fbb1e based on inventory data: {'VCPU': {'total': 32, 'reserved': 0, 'min_unit': 1, 'max_unit': 32, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 257274, 'reserved': 512, 'min_unit': 1, 'max_unit': 257274, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 223436, 'reserved': 0, 'min_unit': 1, 'max_unit': 223436, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider /usr/lib/python3.6/site-packages/nova/scheduler/client/report.py:899 2022-07-13 20:04:16.424 1938943 DEBUG oslo_concurrency.lockutils [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.625s inner /usr/lib/python3.6/site-packages/oslo_concurrency/lockutils.py:371 2022-07-13 20:04:16.424 1938943 DEBUG nova.compute.manager [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Insufficient compute resources: vGPU resource is not available. _build_and_run_instance /usr/lib/python3.6/site-packages/nova/compute/manager.py:2460 2022-07-13 20:04:16.425 1938943 DEBUG nova.compute.utils [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Insufficient compute resources: vGPU resource is not available. notify_about_instance_usage /usr/lib/python3.6/site-packages/nova/compute/utils.py:429 2022-07-13 20:04:16.425 1938943 DEBUG nova.compute.manager [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Build of instance c18565f9-da37-42e9-97b9-fa33da5f1ad0 was re-scheduled: Insufficient compute resources: vGPU resource is not available. _do_build_and_run_instance /usr/lib/python3.6/site-packages/nova/compute/manager.py:2290 2022-07-13 20:04:16.426 1938943 DEBUG nova.compute.manager [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Unplugging VIFs for instance _cleanup_allocated_networks /usr/lib/python3.6/site-packages/nova/compute/manager.py:2760 2022-07-13 20:04:16.426 1938943 DEBUG nova.virt.libvirt.vif [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=True,availability_zone='West-Datacenter',cell_name=None,cleaned=True,config_drive='',created_at=2022-07-13T20:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='colby_gpu_test23',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(249),hidden=False,host='openstack-nova-a40-gpu-0.sdsc.edu',hostname='colby-gpu-test23',id=83265,image_ref='',info_cache=InstanceInfoCache,instance_type_id=249,kernel_id='',key_data='ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAIEAqURlIIp/9DmV5hEnUGFbJUrtr/0+GbyMnW6s+bDEjjqC9pUG9DTBmNy3Dzhl5emuHHf/wR5aYFCmg42kU/nuWTMv5zJkzngnW3MJ61ozXGviRNF+X5Hl09UE3V1X/ANq+WpagRF7eSR56qoQKjAkQJ06Ng+C3f1oQNvr1Gi7aZ8= colby@beeker',key_name='colby',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='openstack-nova-a40-gpu-0.sdsc.edu',locked=False,locked_by=None,memory_mb=24576,metadata={},migration_context=,new_flavor=None,node='openstack-nova-a40-gpu-0.sdsc.edu',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18882d9c32ba42aeaa33c4703ad84b2c',ramdisk_id='',reservation_id='r-9kc66bji',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='heat_stack_owner,_member_,creator',clean_attempts='1',image_base_image_ref='',image_container_format='bare',image_disk_format='raw',image_min_disk='20',image_min_ram='2048',network_allocated='True',owner_project_name='colby',owner_user_name='colby'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2022-07-13T20:04:15Z,user_data=None,user_id='e28435e0a66740968c523e6376c57f68',uuid=c18565f9-da37-42e9-97b9-fa33da5f1ad0,vcpu_model=None,vcpus=2,vm_mode=None,vm_state='building') vif={"id": "9259e174-afa1-4f9a-ab50-56fcaa1a196a", "address": "fa:16:3e:c0:a4:73", "network": {"id": "aed09c75-74e0-447a-936e-7362ad77597b", "bridge": "br-int", "label": "tenant-b-net", "subnets": [{"cidr": "192.168.2.0/24", "dns": [], "gateway": {"address": "192.168.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.2.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.2.3"}}], "meta": {"injected": false, "tenant_id": "18882d9c32ba42aeaa33c4703ad84b2c", "mtu": 1458, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": true, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap9259e174-af", "ovs_interfaceid": "9259e174-afa1-4f9a-ab50-56fcaa1a196a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}} unplug /usr/lib/python3.6/site-packages/nova/virt/libvirt/vif.py:813 2022-07-13 20:04:16.427 1938943 DEBUG nova.network.os_vif_util [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Converting VIF {"id": "9259e174-afa1-4f9a-ab50-56fcaa1a196a", "address": "fa:16:3e:c0:a4:73", "network": {"id": "aed09c75-74e0-447a-936e-7362ad77597b", "bridge": "br-int", "label": "tenant-b-net", "subnets": [{"cidr": "192.168.2.0/24", "dns": [], "gateway": {"address": "192.168.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.2.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.2.3"}}], "meta": {"injected": false, "tenant_id": "18882d9c32ba42aeaa33c4703ad84b2c", "mtu": 1458, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": true, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap9259e174-af", "ovs_interfaceid": "9259e174-afa1-4f9a-ab50-56fcaa1a196a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}} nova_to_osvif_vif /usr/lib/python3.6/site-packages/nova/network/os_vif_util.py:501 2022-07-13 20:04:16.427 1938943 DEBUG nova.network.os_vif_util [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Converted object VIFBridge(active=False,address=fa:16:3e:c0:a4:73,bridge_name='qbr9259e174-af',has_traffic_filtering=True,id=9259e174-afa1-4f9a-ab50-56fcaa1a196a,network=Network(aed09c75-74e0-447a-936e-7362ad77597b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9259e174-af') nova_to_osvif_vif /usr/lib/python3.6/site-packages/nova/network/os_vif_util.py:538 2022-07-13 20:04:16.428 1938943 DEBUG os_vif [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Unplugging vif VIFBridge(active=False,address=fa:16:3e:c0:a4:73,bridge_name='qbr9259e174-af',has_traffic_filtering=True,id=9259e174-afa1-4f9a-ab50-56fcaa1a196a,network=Network(aed09c75-74e0-447a-936e-7362ad77597b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9259e174-af') unplug /usr/lib/python3.6/site-packages/os_vif/__init__.py:109 2022-07-13 20:04:16.430 1938943 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.6/site-packages/ovs/poller.py:263 2022-07-13 20:04:16.430 1938943 DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(port=qvo9259e174-af, bridge=br-int, if_exists=True) do_commit /usr/lib/python3.6/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:90 2022-07-13 20:04:16.430 1938943 DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change do_commit /usr/lib/python3.6/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:133 2022-07-13 20:04:16.432 1938943 INFO os_vif [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Successfully unplugged vif VIFBridge(active=False,address=fa:16:3e:c0:a4:73,bridge_name='qbr9259e174-af',has_traffic_filtering=True,id=9259e174-afa1-4f9a-ab50-56fcaa1a196a,network=Network(aed09c75-74e0-447a-936e-7362ad77597b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9259e174-af') 2022-07-13 20:04:16.433 1938943 DEBUG nova.compute.manager [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Unplugged VIFs for instance _cleanup_allocated_networks /usr/lib/python3.6/site-packages/nova/compute/manager.py:2796 2022-07-13 20:04:16.433 1938943 DEBUG nova.compute.manager [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Deallocating network for instance _deallocate_network /usr/lib/python3.6/site-packages/nova/compute/manager.py:2102 2022-07-13 20:04:16.433 1938943 DEBUG nova.network.neutron [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] deallocate_for_instance() deallocate_for_instance /usr/lib/python3.6/site-packages/nova/network/neutron.py:1651 2022-07-13 20:04:17.673 1938943 DEBUG nova.network.neutron [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info /usr/lib/python3.6/site-packages/nova/network/neutron.py:117 2022-07-13 20:04:17.691 1938943 INFO nova.compute.manager [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] [instance: c18565f9-da37-42e9-97b9-fa33da5f1ad0] Took 1.26 seconds to deallocate network for instance. 2022-07-13 20:04:18.007 1938943 INFO nova.scheduler.client.report [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Deleted allocation for instance c18565f9-da37-42e9-97b9-fa33da5f1ad0 2022-07-13 20:04:18.035 1938943 DEBUG oslo_concurrency.lockutils [req-2a3e7f01-920b-43eb-8d78-b478a9d6b9f2 e28435e0a66740968c523e6376c57f68 18882d9c32ba42aeaa33c4703ad84b2c - default default] Lock "c18565f9-da37-42e9-97b9-fa33da5f1ad0" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 9.448s inner /usr/lib/python3.6/site-packages/oslo_concurrency/lockutils.py:371 2022-07-13 20:04:18.044 1938943 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 __log_wakeup /usr/lib64/python3.6/site-packages/ovs/poller.py:263 2022-07-13 20:04:19.048 1938943 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 __log_wakeup /usr/lib64/python3.6/site-packages/ovs/poller.py:263 2022-07-13 20:04:23.045 1938943 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 __log_wakeup /usr/lib64/python3.6/site-packages/ovs/poller.py:263 2022-07-13 20:04:24.050 1938943 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 __log_wakeup /usr/lib64/python3.6/site-packages/ovs/poller.py:263