2022-09-01T13:51:33.301399+0000 devstack0a nova-compute[79776]: DEBUG oslo_service.periodic_task [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=79776) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} 2022-09-01T13:51:40.302275+0000 devstack0a nova-compute[79776]: DEBUG oslo_service.periodic_task [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=79776) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} 2022-09-01T13:51:41.301001+0000 devstack0a nova-compute[79776]: DEBUG oslo_service.periodic_task [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=79776) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} 2022-09-01T13:51:41.301175+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Starting heal instance info cache {{(pid=79776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9474}} 2022-09-01T13:51:41.301385+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Rebuilding the list of instances to heal {{(pid=79776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9478}} 2022-09-01T13:51:41.311612+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Didn't find any instances for network info cache update. {{(pid=79776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9560}} 2022-09-01T13:51:41.312060+0000 devstack0a nova-compute[79776]: DEBUG oslo_service.periodic_task [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Running periodic task ComputeManager.update_available_resource {{(pid=79776) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} 2022-09-01T13:51:41.337837+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:385}} 2022-09-01T13:51:41.338031+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:390}} 2022-09-01T13:51:41.338250+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} 2022-09-01T13:51:41.338494+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.resource_tracker [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Auditing locally available compute resources for devstack0a (node: devstack0a) {{(pid=79776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:880}} 2022-09-01T13:51:41.475696+0000 devstack0a nova-compute[79776]: WARNING nova.virt.libvirt.driver [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2022-09-01T13:51:41.476737+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.resource_tracker [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Hypervisor/Node resource view: name=devstack0a free_ram=2294MB free_disk=21.28335952758789GB free_vcpus=unknown pci_devices=[{"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000d", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000d", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_2", "address": "0000:00:05.2", "product_id": "100e", "vendor_id": "8086", "numa_node": null, "label": "label_8086_100e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "00b8", "vendor_id": "1013", "numa_node": null, "label": "label_1013_00b8", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_00_0", "address": "0000:02:00.0", "product_id": "1043", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1043", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_1", "address": "0000:00:05.1", "product_id": "100e", "vendor_id": "8086", "numa_node": null, "label": "label_8086_100e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "100e", "vendor_id": "8086", "numa_node": null, "label": "label_8086_100e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1042", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1042", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}] {{(pid=79776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1048}} 2022-09-01T13:51:41.477022+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:385}} 2022-09-01T13:51:41.477325+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:390}} 2022-09-01T13:51:41.628553+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.resource_tracker [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Final resource view: name=devstack0a phys_ram=3923MB used_ram=512MB phys_disk=28GB used_disk=0GB total_vcpus=0 used_vcpus=0 pci_stats=[] {{(pid=79776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}} 2022-09-01T13:51:41.636260+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.provider_tree [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Inventory has not changed in ProviderTree for provider: 838d258c-c254-4357-b5f9-1cc3e6255169 {{(pid=79776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} 2022-09-01T13:51:41.649851+0000 devstack0a nova-compute[79776]: DEBUG nova.scheduler.client.report [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Inventory has not changed for provider 838d258c-c254-4357-b5f9-1cc3e6255169 based on inventory data: {'MEMORY_MB': {'total': 3923, 'reserved': 512, 'min_unit': 1, 'max_unit': 3923, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}, 'PCPU': {'total': 2, 'reserved': 0, 'min_unit': 1, 'max_unit': 2, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=79776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} 2022-09-01T13:51:41.650749+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.resource_tracker [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Compute_service record updated for devstack0a:devstack0a {{(pid=79776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1008}} 2022-09-01T13:51:41.651308+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} 2022-09-01T13:51:42.640934+0000 devstack0a nova-compute[79776]: DEBUG oslo_service.periodic_task [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=79776) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} 2022-09-01T13:51:42.642017+0000 devstack0a nova-compute[79776]: DEBUG oslo_service.periodic_task [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=79776) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} 2022-09-01T13:51:43.295389+0000 devstack0a nova-compute[79776]: DEBUG oslo_service.periodic_task [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=79776) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} 2022-09-01T13:51:43.300768+0000 devstack0a nova-compute[79776]: DEBUG oslo_service.periodic_task [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=79776) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} 2022-09-01T13:51:43.301434+0000 devstack0a nova-compute[79776]: DEBUG oslo_service.periodic_task [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=79776) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} 2022-09-01T13:51:43.301887+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=79776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10091}} 2022-09-01T13:51:44.301033+0000 devstack0a nova-compute[79776]: DEBUG oslo_service.periodic_task [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=79776) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} 2022-09-01T13:51:44.301744+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Cleaning up deleted instances {{(pid=79776) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:10738}} 2022-09-01T13:51:44.316452+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] There are 0 instances to clean {{(pid=79776) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:10747}} 2022-09-01T13:51:45.301383+0000 devstack0a nova-compute[79776]: DEBUG oslo_service.periodic_task [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=79776) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} 2022-09-01T13:51:45.302512+0000 devstack0a nova-compute[79776]: DEBUG oslo_service.periodic_task [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=79776) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} 2022-09-01T13:51:45.303121+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Cleaning up deleted instances with incomplete migration {{(pid=79776) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:10776}} 2022-09-01T13:51:46.484025+0000 devstack0a nova-compute[79776]: DEBUG oslo_service.periodic_task [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Running periodic task ComputeManager._sync_power_states {{(pid=79776) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} 2022-09-01T13:51:47.312966+0000 devstack0a nova-compute[79776]: DEBUG oslo_service.periodic_task [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=79776) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} 2022-09-01T13:52:02.074061+0000 devstack0a nova-compute[79776]: INFO nova.compute.manager [None req-e1b62bbc-91d8-46ca-bba4-451391c6b1a1 admin admin] [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] Evacuating instance 2022-09-01T13:52:02.118117+0000 devstack0a nova-compute[79776]: INFO nova.compute.manager [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Evacuating instance 2022-09-01T13:52:02.144032+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.rebuild_claim" {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:385}} 2022-09-01T13:52:02.144786+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.rebuild_claim" :: waited 0.001s {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:390}} 2022-09-01T13:52:02.147508+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-e1b62bbc-91d8-46ca-bba4-451391c6b1a1 admin admin] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.rebuild_claim" {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:385}} 2022-09-01T13:52:02.148136+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-e1b62bbc-91d8-46ca-bba4-451391c6b1a1 admin admin] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.rebuild_claim" :: waited 0.001s {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:390}} 2022-09-01T13:52:02.178551+0000 devstack0a nova-compute[79776]: DEBUG nova.objects.instance [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Lazy-loading 'pci_requests' on Instance uuid 48343f6f-de61-449e-b142-c24ba2f14c02 {{(pid=79776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} 2022-09-01T13:52:02.181519+0000 devstack0a nova-compute[79776]: DEBUG nova.objects.instance [None req-e1b62bbc-91d8-46ca-bba4-451391c6b1a1 admin admin] Lazy-loading 'pci_requests' on Instance uuid 30d87026-64b6-4070-8c9a-41bec88b5841 {{(pid=79776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} 2022-09-01T13:52:02.196745+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.hardware [None req-e1b62bbc-91d8-46ca-bba4-451391c6b1a1 admin admin] Attempting to fit instance cell InstanceNUMACell(cpu_pinning_raw=None,cpu_policy='dedicated',cpu_thread_policy=None,cpu_topology=,cpuset=set([]),cpuset_reserved=None,id=0,memory=256,pagesize=None,pcpuset=set([0])) on host_cell NUMACell(cpu_usage=0,cpuset=set([]),id=0,memory=3923,memory_usage=0,mempages=[NUMAPagesTopology,NUMAPagesTopology],network_metadata=NetworkMetadata,pcpuset=set([0,1]),pinned_cpus=set([]),siblings=[set([0]),set([1])],socket=None) {{(pid=79776) _numa_fit_instance_cell /opt/stack/nova/nova/virt/hardware.py:929}} 2022-09-01T13:52:02.197350+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.hardware [None req-e1b62bbc-91d8-46ca-bba4-451391c6b1a1 admin admin] No specific pagesize requested for instance, selected pagesize: 4 {{(pid=79776) _numa_fit_instance_cell /opt/stack/nova/nova/virt/hardware.py:956}} 2022-09-01T13:52:02.197775+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.hardware [None req-e1b62bbc-91d8-46ca-bba4-451391c6b1a1 admin admin] Instance has requested pinned CPUs {{(pid=79776) _numa_fit_instance_cell /opt/stack/nova/nova/virt/hardware.py:1021}} 2022-09-01T13:52:02.198251+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.hardware [None req-e1b62bbc-91d8-46ca-bba4-451391c6b1a1 admin admin] Packing an instance onto a set of siblings: host_cell_free_siblings: [{0}, {1}] instance_cell: InstanceNUMACell(cpu_pinning_raw=None,cpu_policy='dedicated',cpu_thread_policy=None,cpu_topology=,cpuset=set([]),cpuset_reserved=None,id=0,memory=256,pagesize=None,pcpuset=set([0])) host_cell_id: 0 threads_per_core: 1 num_cpu_reserved: 0 {{(pid=79776) _pack_instance_onto_cores /opt/stack/nova/nova/virt/hardware.py:658}} 2022-09-01T13:52:02.198678+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.hardware [None req-e1b62bbc-91d8-46ca-bba4-451391c6b1a1 admin admin] Built sibling_sets: defaultdict(, {1: [{0}, {1}]}) {{(pid=79776) _pack_instance_onto_cores /opt/stack/nova/nova/virt/hardware.py:679}} 2022-09-01T13:52:02.199075+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.hardware [None req-e1b62bbc-91d8-46ca-bba4-451391c6b1a1 admin admin] User did not specify a thread policy. Using default for 1 cores {{(pid=79776) _pack_instance_onto_cores /opt/stack/nova/nova/virt/hardware.py:794}} 2022-09-01T13:52:02.199516+0000 devstack0a nova-compute[79776]: INFO nova.virt.hardware [None req-e1b62bbc-91d8-46ca-bba4-451391c6b1a1 admin admin] Computed NUMA topology CPU pinning: usable pCPUs: [[0], [1]], vCPUs mapping: [(0, 0)] 2022-09-01T13:52:02.199900+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.hardware [None req-e1b62bbc-91d8-46ca-bba4-451391c6b1a1 admin admin] Selected cores for pinning: [(0, 0)], in cell 0 {{(pid=79776) _pack_instance_onto_cores /opt/stack/nova/nova/virt/hardware.py:900}} 2022-09-01T13:52:02.200412+0000 devstack0a nova-compute[79776]: INFO nova.compute.claims [None req-e1b62bbc-91d8-46ca-bba4-451391c6b1a1 admin admin] [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] Claim successful on node devstack0a 2022-09-01T13:52:02.200894+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.resource_tracker [None req-e1b62bbc-91d8-46ca-bba4-451391c6b1a1 admin admin] Skip claiming resources of provider 36235f27-fc90-431c-9b37-cc2d163f02fe, since the provider UUIDs are not in provider tree. {{(pid=79776) _claim_resources /opt/stack/nova/nova/compute/resource_tracker.py:412}} 2022-09-01T13:52:02.201380+0000 devstack0a nova-compute[79776]: DEBUG nova.objects.instance [None req-e1b62bbc-91d8-46ca-bba4-451391c6b1a1 admin admin] Lazy-loading 'resources' on Instance uuid 30d87026-64b6-4070-8c9a-41bec88b5841 {{(pid=79776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} 2022-09-01T13:52:02.205874+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.hardware [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Attempting to fit instance cell InstanceNUMACell(cpu_pinning_raw=None,cpu_policy='dedicated',cpu_thread_policy=None,cpu_topology=,cpuset=set([]),cpuset_reserved=None,id=0,memory=256,pagesize=None,pcpuset=set([0])) on host_cell NUMACell(cpu_usage=0,cpuset=set([]),id=0,memory=3923,memory_usage=0,mempages=[NUMAPagesTopology,NUMAPagesTopology],network_metadata=NetworkMetadata,pcpuset=set([0,1]),pinned_cpus=set([]),siblings=[set([0]),set([1])],socket=None) {{(pid=79776) _numa_fit_instance_cell /opt/stack/nova/nova/virt/hardware.py:929}} 2022-09-01T13:52:02.206515+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.hardware [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] No specific pagesize requested for instance, selected pagesize: 4 {{(pid=79776) _numa_fit_instance_cell /opt/stack/nova/nova/virt/hardware.py:956}} 2022-09-01T13:52:02.206928+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.hardware [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Instance has requested pinned CPUs {{(pid=79776) _numa_fit_instance_cell /opt/stack/nova/nova/virt/hardware.py:1021}} 2022-09-01T13:52:02.207447+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.hardware [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Packing an instance onto a set of siblings: host_cell_free_siblings: [{0}, {1}] instance_cell: InstanceNUMACell(cpu_pinning_raw=None,cpu_policy='dedicated',cpu_thread_policy=None,cpu_topology=,cpuset=set([]),cpuset_reserved=None,id=0,memory=256,pagesize=None,pcpuset=set([0])) host_cell_id: 0 threads_per_core: 1 num_cpu_reserved: 0 {{(pid=79776) _pack_instance_onto_cores /opt/stack/nova/nova/virt/hardware.py:658}} 2022-09-01T13:52:02.207910+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.hardware [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Built sibling_sets: defaultdict(, {1: [{0}, {1}]}) {{(pid=79776) _pack_instance_onto_cores /opt/stack/nova/nova/virt/hardware.py:679}} 2022-09-01T13:52:02.208357+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.hardware [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] User did not specify a thread policy. Using default for 1 cores {{(pid=79776) _pack_instance_onto_cores /opt/stack/nova/nova/virt/hardware.py:794}} 2022-09-01T13:52:02.209226+0000 devstack0a nova-compute[79776]: INFO nova.virt.hardware [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Computed NUMA topology CPU pinning: usable pCPUs: [[0], [1]], vCPUs mapping: [(0, 0)] 2022-09-01T13:52:02.209719+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.hardware [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Selected cores for pinning: [(0, 0)], in cell 0 {{(pid=79776) _pack_instance_onto_cores /opt/stack/nova/nova/virt/hardware.py:900}} 2022-09-01T13:52:02.210239+0000 devstack0a nova-compute[79776]: INFO nova.compute.claims [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Claim successful on node devstack0a 2022-09-01T13:52:02.210710+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.resource_tracker [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Skip claiming resources of provider 36235f27-fc90-431c-9b37-cc2d163f02fe, since the provider UUIDs are not in provider tree. {{(pid=79776) _claim_resources /opt/stack/nova/nova/compute/resource_tracker.py:412}} 2022-09-01T13:52:02.211194+0000 devstack0a nova-compute[79776]: DEBUG nova.objects.instance [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Lazy-loading 'resources' on Instance uuid 48343f6f-de61-449e-b142-c24ba2f14c02 {{(pid=79776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} 2022-09-01T13:52:02.213557+0000 devstack0a nova-compute[79776]: DEBUG nova.objects.instance [None req-e1b62bbc-91d8-46ca-bba4-451391c6b1a1 admin admin] Lazy-loading 'numa_topology' on Instance uuid 30d87026-64b6-4070-8c9a-41bec88b5841 {{(pid=79776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} 2022-09-01T13:52:02.222123+0000 devstack0a nova-compute[79776]: DEBUG nova.objects.instance [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Lazy-loading 'numa_topology' on Instance uuid 48343f6f-de61-449e-b142-c24ba2f14c02 {{(pid=79776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} 2022-09-01T13:52:02.236720+0000 devstack0a nova-compute[79776]: DEBUG nova.objects.instance [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Lazy-loading 'pci_devices' on Instance uuid 48343f6f-de61-449e-b142-c24ba2f14c02 {{(pid=79776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} 2022-09-01T13:52:02.239264+0000 devstack0a nova-compute[79776]: DEBUG nova.objects.instance [None req-e1b62bbc-91d8-46ca-bba4-451391c6b1a1 admin admin] Lazy-loading 'pci_devices' on Instance uuid 30d87026-64b6-4070-8c9a-41bec88b5841 {{(pid=79776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} 2022-09-01T13:52:02.352296+0000 devstack0a nova-compute[79776]: INFO nova.compute.resource_tracker [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Updating resource usage from migration 27ec950e-cae5-40af-b7ad-ff1becf6a230 2022-09-01T13:52:02.352889+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.resource_tracker [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Starting to track incoming migration 27ec950e-cae5-40af-b7ad-ff1becf6a230 with flavor d2ba5f97-2d1f-499f-ad1d-c827b827de68 {{(pid=79776) _update_usage_from_migration /opt/stack/nova/nova/compute/resource_tracker.py:1387}} 2022-09-01T13:52:02.367795+0000 devstack0a nova-compute[79776]: INFO nova.compute.resource_tracker [None req-e1b62bbc-91d8-46ca-bba4-451391c6b1a1 admin admin] [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] Updating resource usage from migration a549567b-ea30-4e8c-a57d-573ef4593d04 2022-09-01T13:52:02.368358+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.resource_tracker [None req-e1b62bbc-91d8-46ca-bba4-451391c6b1a1 admin admin] [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] Starting to track incoming migration a549567b-ea30-4e8c-a57d-573ef4593d04 with flavor d2ba5f97-2d1f-499f-ad1d-c827b827de68 {{(pid=79776) _update_usage_from_migration /opt/stack/nova/nova/compute/resource_tracker.py:1387}} 2022-09-01T13:52:02.388504+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-e1b62bbc-91d8-46ca-bba4-451391c6b1a1 admin admin] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.rebuild_claim" :: held 0.240s {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} 2022-09-01T13:52:02.433526+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.provider_tree [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Inventory has not changed in ProviderTree for provider: 838d258c-c254-4357-b5f9-1cc3e6255169 {{(pid=79776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} 2022-09-01T13:52:02.454653+0000 devstack0a nova-compute[79776]: DEBUG nova.scheduler.client.report [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Inventory has not changed for provider 838d258c-c254-4357-b5f9-1cc3e6255169 based on inventory data: {'MEMORY_MB': {'total': 3923, 'reserved': 512, 'min_unit': 1, 'max_unit': 3923, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}, 'PCPU': {'total': 2, 'reserved': 0, 'min_unit': 1, 'max_unit': 2, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=79776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} 2022-09-01T13:52:02.455376+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.rebuild_claim" :: held 0.311s {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} 2022-09-01T13:52:02.458101+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] on_shared_storage is not provided, using driver information to decide if the instance needs to be evacuated {{(pid=79776) _do_rebuild_instance /opt/stack/nova/nova/compute/manager.py:3682}} 2022-09-01T13:52:02.458653+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.libvirt.driver [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Checking instance files accessibility /opt/stack/data/nova/instances/48343f6f-de61-449e-b142-c24ba2f14c02 {{(pid=79776) instance_on_disk /opt/stack/nova/nova/virt/libvirt/driver.py:11875}} 2022-09-01T13:52:02.459109+0000 devstack0a nova-compute[79776]: INFO nova.compute.manager [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] disk not on shared storage, evacuating from image: 'b8eb1c47-b543-4fab-9c1c-906075f7a4d1' 2022-09-01T13:52:02.459550+0000 devstack0a nova-compute[79776]: DEBUG nova.objects.instance [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Lazy-loading 'trusted_certs' on Instance uuid 48343f6f-de61-449e-b142-c24ba2f14c02 {{(pid=79776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} 2022-09-01T13:52:02.475156+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Checking state {{(pid=79776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1659}} 2022-09-01T13:52:02.594664+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.utils [None req-e1b62bbc-91d8-46ca-bba4-451391c6b1a1 admin admin] [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] CPU set to pin [0] must be a subset of free CPU set [1] {{(pid=79776) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}} 2022-09-01T13:52:02.603792+0000 devstack0a nova-compute[79776]: ERROR nova.compute.manager [None req-e1b62bbc-91d8-46ca-bba4-451391c6b1a1 admin admin] [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] Setting instance vm_state to ERROR: nova.exception.CPUPinningInvalid: CPU set to pin [0] must be a subset of free CPU set [1] 2022-09-01T13:52:02.603792+0000 devstack0a nova-compute[79776]: ERROR nova.compute.manager [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] Traceback (most recent call last): 2022-09-01T13:52:02.603792+0000 devstack0a nova-compute[79776]: ERROR nova.compute.manager [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] File "/opt/stack/nova/nova/compute/manager.py", line 10375, in _error_out_instance_on_exception 2022-09-01T13:52:02.603792+0000 devstack0a nova-compute[79776]: ERROR nova.compute.manager [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] yield 2022-09-01T13:52:02.603792+0000 devstack0a nova-compute[79776]: ERROR nova.compute.manager [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] File "/opt/stack/nova/nova/compute/manager.py", line 3564, in rebuild_instance 2022-09-01T13:52:02.603792+0000 devstack0a nova-compute[79776]: ERROR nova.compute.manager [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] self._do_rebuild_instance_with_claim( 2022-09-01T13:52:02.603792+0000 devstack0a nova-compute[79776]: ERROR nova.compute.manager [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] File "/opt/stack/nova/nova/compute/manager.py", line 3641, in _do_rebuild_instance_with_claim 2022-09-01T13:52:02.603792+0000 devstack0a nova-compute[79776]: ERROR nova.compute.manager [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] claim_context = rebuild_claim( 2022-09-01T13:52:02.603792+0000 devstack0a nova-compute[79776]: ERROR nova.compute.manager [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py", line 395, in inner 2022-09-01T13:52:02.603792+0000 devstack0a nova-compute[79776]: ERROR nova.compute.manager [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] return f(*args, **kwargs) 2022-09-01T13:52:02.603792+0000 devstack0a nova-compute[79776]: ERROR nova.compute.manager [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] File "/opt/stack/nova/nova/compute/resource_tracker.py", line 204, in rebuild_claim 2022-09-01T13:52:02.603792+0000 devstack0a nova-compute[79776]: ERROR nova.compute.manager [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] return self._move_claim( 2022-09-01T13:52:02.603792+0000 devstack0a nova-compute[79776]: ERROR nova.compute.manager [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] File "/opt/stack/nova/nova/compute/resource_tracker.py", line 348, in _move_claim 2022-09-01T13:52:02.603792+0000 devstack0a nova-compute[79776]: ERROR nova.compute.manager [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] self._update_usage_from_migration(context, instance, migration, 2022-09-01T13:52:02.603792+0000 devstack0a nova-compute[79776]: ERROR nova.compute.manager [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] File "/opt/stack/nova/nova/compute/resource_tracker.py", line 1411, in _update_usage_from_migration 2022-09-01T13:52:02.603792+0000 devstack0a nova-compute[79776]: ERROR nova.compute.manager [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] self._update_usage(usage, nodename) 2022-09-01T13:52:02.603792+0000 devstack0a nova-compute[79776]: ERROR nova.compute.manager [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] File "/opt/stack/nova/nova/compute/resource_tracker.py", line 1326, in _update_usage 2022-09-01T13:52:02.603792+0000 devstack0a nova-compute[79776]: ERROR nova.compute.manager [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] cn.numa_topology = hardware.numa_usage_from_instance_numa( 2022-09-01T13:52:02.603792+0000 devstack0a nova-compute[79776]: ERROR nova.compute.manager [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] File "/opt/stack/nova/nova/virt/hardware.py", line 2567, in numa_usage_from_instance_numa 2022-09-01T13:52:02.603792+0000 devstack0a nova-compute[79776]: ERROR nova.compute.manager [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] new_cell.pin_cpus(pinned_cpus) 2022-09-01T13:52:02.603792+0000 devstack0a nova-compute[79776]: ERROR nova.compute.manager [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] File "/opt/stack/nova/nova/objects/numa.py", line 95, in pin_cpus 2022-09-01T13:52:02.603792+0000 devstack0a nova-compute[79776]: ERROR nova.compute.manager [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] raise exception.CPUPinningInvalid(requested=list(cpus), 2022-09-01T13:52:02.603792+0000 devstack0a nova-compute[79776]: ERROR nova.compute.manager [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] nova.exception.CPUPinningInvalid: CPU set to pin [0] must be a subset of free CPU set [1] 2022-09-01T13:52:02.603792+0000 devstack0a nova-compute[79776]: ERROR nova.compute.manager [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] 2022-09-01T13:52:02.898180+0000 devstack0a nova-compute[79776]: INFO nova.compute.manager [None req-e1b62bbc-91d8-46ca-bba4-451391c6b1a1 admin admin] [instance: 30d87026-64b6-4070-8c9a-41bec88b5841] Successfully reverted task state from rebuilding on failure for instance. 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server [None req-e1b62bbc-91d8-46ca-bba4-451391c6b1a1 admin admin] Exception during message handling: nova.exception.CPUPinningInvalid: CPU set to pin [0] must be a subset of free CPU set [1] 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server self.force_reraise() 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server raise self.value 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw) 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 163, in decorated_function 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server self.force_reraise() 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server raise self.value 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 154, in decorated_function 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 210, in decorated_function 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server self.force_reraise() 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server raise self.value 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 200, in decorated_function 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 3564, in rebuild_instance 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server self._do_rebuild_instance_with_claim( 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 3641, in _do_rebuild_instance_with_claim 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server claim_context = rebuild_claim( 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py", line 395, in inner 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/resource_tracker.py", line 204, in rebuild_claim 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server return self._move_claim( 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/resource_tracker.py", line 348, in _move_claim 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server self._update_usage_from_migration(context, instance, migration, 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/resource_tracker.py", line 1411, in _update_usage_from_migration 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server self._update_usage(usage, nodename) 2022-09-01T13:52:02.909015+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/resource_tracker.py", line 1326, in _update_usage 2022-09-01T13:52:02.911914+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server cn.numa_topology = hardware.numa_usage_from_instance_numa( 2022-09-01T13:52:02.911914+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/hardware.py", line 2567, in numa_usage_from_instance_numa 2022-09-01T13:52:02.911914+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server new_cell.pin_cpus(pinned_cpus) 2022-09-01T13:52:02.911914+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/objects/numa.py", line 95, in pin_cpus 2022-09-01T13:52:02.911914+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server raise exception.CPUPinningInvalid(requested=list(cpus), 2022-09-01T13:52:02.911914+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server nova.exception.CPUPinningInvalid: CPU set to pin [0] must be a subset of free CPU set [1] 2022-09-01T13:52:02.911914+0000 devstack0a nova-compute[79776]: ERROR oslo_messaging.rpc.server 2022-09-01T13:52:03.145846+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [req-cb68e85b-a054-4f69-921e-4b0d391d3dc7 req-8c917611-f527-4eb0-ac78-558266f2f647 service nova] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Received event network-vif-unplugged-e3c723fb-59a8-49bf-8034-6bd7bd3da680 {{(pid=79776) external_instance_event /opt/stack/nova/nova/compute/manager.py:10641}} 2022-09-01T13:52:03.146419+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [req-cb68e85b-a054-4f69-921e-4b0d391d3dc7 req-8c917611-f527-4eb0-ac78-558266f2f647 service nova] Acquiring lock "48343f6f-de61-449e-b142-c24ba2f14c02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:385}} 2022-09-01T13:52:03.146419+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [req-cb68e85b-a054-4f69-921e-4b0d391d3dc7 req-8c917611-f527-4eb0-ac78-558266f2f647 service nova] Lock "48343f6f-de61-449e-b142-c24ba2f14c02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:390}} 2022-09-01T13:52:03.146654+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [req-cb68e85b-a054-4f69-921e-4b0d391d3dc7 req-8c917611-f527-4eb0-ac78-558266f2f647 service nova] Lock "48343f6f-de61-449e-b142-c24ba2f14c02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} 2022-09-01T13:52:03.146809+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [req-cb68e85b-a054-4f69-921e-4b0d391d3dc7 req-8c917611-f527-4eb0-ac78-558266f2f647 service nova] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] No waiting events found dispatching network-vif-unplugged-e3c723fb-59a8-49bf-8034-6bd7bd3da680 {{(pid=79776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:317}} 2022-09-01T13:52:03.147080+0000 devstack0a nova-compute[79776]: WARNING nova.compute.manager [req-cb68e85b-a054-4f69-921e-4b0d391d3dc7 req-8c917611-f527-4eb0-ac78-558266f2f647 service nova] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Received unexpected event network-vif-unplugged-e3c723fb-59a8-49bf-8034-6bd7bd3da680 for instance with vm_state active and task_state rebuilding. 2022-09-01T13:52:03.442775+0000 devstack0a nova-compute[79776]: DEBUG nova.network.neutron [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Port e3c723fb-59a8-49bf-8034-6bd7bd3da680 updated with migration profile {'migrating_to': 'devstack0a'} successfully {{(pid=79776) _setup_migration_port_profile /opt/stack/nova/nova/network/neutron.py:353}} 2022-09-01T13:52:03.475938+0000 devstack0a nova-compute[79776]: INFO nova.network.neutron [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Updating port e3c723fb-59a8-49bf-8034-6bd7bd3da680 with attributes {'binding:host_id': 'devstack0a', 'device_owner': 'compute:nova', 'binding:profile': {}} 2022-09-01T13:52:03.982822+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Acquiring lock "refresh_cache-48343f6f-de61-449e-b142-c24ba2f14c02" {{(pid=79776) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:293}} 2022-09-01T13:52:03.983190+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Acquired lock "refresh_cache-48343f6f-de61-449e-b142-c24ba2f14c02" {{(pid=79776) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:296}} 2022-09-01T13:52:03.983507+0000 devstack0a nova-compute[79776]: DEBUG nova.network.neutron [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Building network info cache for instance {{(pid=79776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} 2022-09-01T13:52:04.660968+0000 devstack0a nova-compute[79776]: DEBUG nova.network.neutron [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Updating instance_info_cache with network_info: [{"id": "e3c723fb-59a8-49bf-8034-6bd7bd3da680", "address": "fa:16:3e:1b:c9:fa", "network": {"id": "21b5983e-c4f1-486e-9063-28144657b072", "bridge": "br-int", "label": "private", "subnets": [{"cidr": "10.0.0.0/26", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.2"}}, {"cidr": "fd3f:cc4:f190::/64", "dns": [], "gateway": {"address": "fd3f:cc4:f190::1", "type": "gateway", "version": 6, "meta": {}}, "ips": [{"address": "fd3f:cc4:f190:0:f816:3eff:fe1b:c9fa", "type": "fixed", "version": 6, "meta": {}, "floating_ips": []}], "routes": [], "version": 6, "meta": {"ipv6_address_mode": "slaac", "dhcp_server": "fd3f:cc4:f190:0:f816:3eff:fe94:a913"}}], "meta": {"injected": false, "tenant_id": "0fa1a3175d10483d814fd787aac9c3b5", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int", "bound_drivers": {"0": "openvswitch"}}, "devname": "tape3c723fb-59", "ovs_interfaceid": "e3c723fb-59a8-49bf-8034-6bd7bd3da680", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=79776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} 2022-09-01T13:52:04.692256+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Releasing lock "refresh_cache-48343f6f-de61-449e-b142-c24ba2f14c02" {{(pid=79776) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:314}} 2022-09-01T13:52:04.833768+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.libvirt.driver [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Creating instance directory {{(pid=79776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4657}} 2022-09-01T13:52:04.834146+0000 devstack0a nova-compute[79776]: INFO nova.virt.libvirt.driver [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Creating image(s) 2022-09-01T13:52:04.834849+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Acquiring lock "/opt/stack/data/nova/instances/48343f6f-de61-449e-b142-c24ba2f14c02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:385}} 2022-09-01T13:52:04.835126+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Lock "/opt/stack/data/nova/instances/48343f6f-de61-449e-b142-c24ba2f14c02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:390}} 2022-09-01T13:52:04.836003+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Lock "/opt/stack/data/nova/instances/48343f6f-de61-449e-b142-c24ba2f14c02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} 2022-09-01T13:52:04.837571+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.processutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f0f28d4c58ca0834bc64b5ab906d1675924581 --force-share --output=json {{(pid=79776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} 2022-09-01T13:52:04.898420+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.processutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f0f28d4c58ca0834bc64b5ab906d1675924581 --force-share --output=json" returned: 0 in 0.060s {{(pid=79776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} 2022-09-01T13:52:04.899030+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Acquiring lock "a0f0f28d4c58ca0834bc64b5ab906d1675924581" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:385}} 2022-09-01T13:52:04.899854+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Lock "a0f0f28d4c58ca0834bc64b5ab906d1675924581" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:390}} 2022-09-01T13:52:04.900257+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.processutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f0f28d4c58ca0834bc64b5ab906d1675924581 --force-share --output=json {{(pid=79776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} 2022-09-01T13:52:04.959088+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.processutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f0f28d4c58ca0834bc64b5ab906d1675924581 --force-share --output=json" returned: 0 in 0.058s {{(pid=79776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} 2022-09-01T13:52:04.959734+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.processutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f0f28d4c58ca0834bc64b5ab906d1675924581,backing_fmt=raw,size=1073741824 /opt/stack/data/nova/instances/48343f6f-de61-449e-b142-c24ba2f14c02/disk {{(pid=79776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} 2022-09-01T13:52:05.004885+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.processutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f0f28d4c58ca0834bc64b5ab906d1675924581,backing_fmt=raw,size=1073741824 /opt/stack/data/nova/instances/48343f6f-de61-449e-b142-c24ba2f14c02/disk" returned: 0 in 0.044s {{(pid=79776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} 2022-09-01T13:52:05.005782+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Lock "a0f0f28d4c58ca0834bc64b5ab906d1675924581" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.106s {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} 2022-09-01T13:52:05.006555+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.processutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f0f28d4c58ca0834bc64b5ab906d1675924581 --force-share --output=json {{(pid=79776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} 2022-09-01T13:52:05.069430+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.processutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f0f28d4c58ca0834bc64b5ab906d1675924581 --force-share --output=json" returned: 0 in 0.062s {{(pid=79776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} 2022-09-01T13:52:05.070161+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.disk.api [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Checking if we can resize image /opt/stack/data/nova/instances/48343f6f-de61-449e-b142-c24ba2f14c02/disk. size=1073741824 {{(pid=79776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}} 2022-09-01T13:52:05.070611+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.processutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48343f6f-de61-449e-b142-c24ba2f14c02/disk --force-share --output=json {{(pid=79776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} 2022-09-01T13:52:05.132036+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.processutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48343f6f-de61-449e-b142-c24ba2f14c02/disk --force-share --output=json" returned: 0 in 0.061s {{(pid=79776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} 2022-09-01T13:52:05.132575+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.disk.api [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Cannot resize image /opt/stack/data/nova/instances/48343f6f-de61-449e-b142-c24ba2f14c02/disk to a smaller size. {{(pid=79776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}} 2022-09-01T13:52:05.146298+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.libvirt.driver [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Created local disks {{(pid=79776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4784}} 2022-09-01T13:52:05.146605+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.libvirt.driver [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Ensure instance console log exists: /opt/stack/data/nova/instances/48343f6f-de61-449e-b142-c24ba2f14c02/console.log {{(pid=79776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4547}} 2022-09-01T13:52:05.147009+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:385}} 2022-09-01T13:52:05.147371+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:390}} 2022-09-01T13:52:05.147752+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} 2022-09-01T13:52:05.150103+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.libvirt.driver [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Start _get_guest_xml network_info=[{"id": "e3c723fb-59a8-49bf-8034-6bd7bd3da680", "address": "fa:16:3e:1b:c9:fa", "network": {"id": "21b5983e-c4f1-486e-9063-28144657b072", "bridge": "br-int", "label": "private", "subnets": [{"cidr": "10.0.0.0/26", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.2"}}, {"cidr": "fd3f:cc4:f190::/64", "dns": [], "gateway": {"address": "fd3f:cc4:f190::1", "type": "gateway", "version": 6, "meta": {}}, "ips": [{"address": "fd3f:cc4:f190:0:f816:3eff:fe1b:c9fa", "type": "fixed", "version": 6, "meta": {}, "floating_ips": []}], "routes": [], "version": 6, "meta": {"ipv6_address_mode": "slaac", "dhcp_server": "fd3f:cc4:f190:0:f816:3eff:fe94:a913"}}], "meta": {"injected": false, "tenant_id": "0fa1a3175d10483d814fd787aac9c3b5", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int", "bound_drivers": {"0": "openvswitch"}}, "devname": "tape3c723fb-59", "ovs_interfaceid": "e3c723fb-59a8-49bf-8034-6bd7bd3da680", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=b8eb1c47-b543-4fab-9c1c-906075f7a4d1,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': 'b8eb1c47-b543-4fab-9c1c-906075f7a4d1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=79776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7317}} 2022-09-01T13:52:05.156247+0000 devstack0a nova-compute[79776]: WARNING nova.virt.libvirt.driver [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError 2022-09-01T13:52:05.158530+0000 devstack0a nova-compute[79776]: DEBUG nova.scheduler.utils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Translating request for VCPU=1 to VCPU=0,PCPU=1 {{(pid=79776) _translate_pinning_policies /opt/stack/nova/nova/scheduler/utils.py:348}} 2022-09-01T13:52:05.159316+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.libvirt.driver [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=79776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5275}} 2022-09-01T13:52:05.159788+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.hardware [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Getting desirable topologies for flavor Flavor(created_at=2022-09-01T13:31:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw:cpu_policy='dedicated',hw_rng:allowed='True'},flavorid='d2ba5f97-2d1f-499f-ad1d-c827b827de68',id=11,is_public=True,memory_mb=256,name='cirros256-pinned',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=b8eb1c47-b543-4fab-9c1c-906075f7a4d1,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=79776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}} 2022-09-01T13:52:05.160029+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.hardware [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Flavor limits 0:0:0 {{(pid=79776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} 2022-09-01T13:52:05.160253+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.hardware [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Image limits 0:0:0 {{(pid=79776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} 2022-09-01T13:52:05.160577+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.hardware [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Flavor pref 0:0:0 {{(pid=79776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} 2022-09-01T13:52:05.160784+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.hardware [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Image pref 0:0:0 {{(pid=79776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} 2022-09-01T13:52:05.161046+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.hardware [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=79776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} 2022-09-01T13:52:05.161384+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.hardware [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=79776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}} 2022-09-01T13:52:05.161585+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.hardware [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=79776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}} 2022-09-01T13:52:05.161833+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.hardware [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Got 1 possible topologies {{(pid=79776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}} 2022-09-01T13:52:05.162151+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.hardware [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=79776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}} 2022-09-01T13:52:05.162521+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.hardware [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=79776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}} 2022-09-01T13:52:05.162919+0000 devstack0a nova-compute[79776]: DEBUG nova.objects.instance [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Lazy-loading 'vcpu_model' on Instance uuid 48343f6f-de61-449e-b142-c24ba2f14c02 {{(pid=79776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} 2022-09-01T13:52:05.193059+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.libvirt.vif [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2022-09-01T13:51:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='vm1',display_name='vm1',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='devstack0',hostname='vm1',id=3,image_ref='b8eb1c47-b543-4fab-9c1c-906075f7a4d1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2022-09-01T13:51:34Z,launched_on='devstack0',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=None,node='devstack0',numa_topology=InstanceNUMATopology(UNKNOWN),old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='311ddfdb901749848cfc815cbb80ca2c',ramdisk_id='',reservation_id='r-0f9zuyu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader,admin',image_base_image_ref='b8eb1c47-b543-4fab-9c1c-906075f7a4d1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='admin',owner_user_name='admin'},tags=,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2022-09-01T13:52:05Z,user_data=None,user_id='2dd34d507a434450ba9006c835f64bf2',uuid=48343f6f-de61-449e-b142-c24ba2f14c02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3c723fb-59a8-49bf-8034-6bd7bd3da680", "address": "fa:16:3e:1b:c9:fa", "network": {"id": "21b5983e-c4f1-486e-9063-28144657b072", "bridge": "br-int", "label": "private", "subnets": [{"cidr": "10.0.0.0/26", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.2"}}, {"cidr": "fd3f:cc4:f190::/64", "dns": [], "gateway": {"address": "fd3f:cc4:f190::1", "type": "gateway", "version": 6, "meta": {}}, "ips": [{"address": "fd3f:cc4:f190:0:f816:3eff:fe1b:c9fa", "type": "fixed", "version": 6, "meta": {}, "floating_ips": []}], "routes": [], "version": 6, "meta": {"ipv6_address_mode": "slaac", "dhcp_server": "fd3f:cc4:f190:0:f816:3eff:fe94:a913"}}], "meta": {"injected": false, "tenant_id": "0fa1a3175d10483d814fd787aac9c3b5", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int", "bound_drivers": {"0": "openvswitch"}}, "devname": "tape3c723fb-59", "ovs_interfaceid": "e3c723fb-59a8-49bf-8034-6bd7bd3da680", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=79776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}} 2022-09-01T13:52:05.193569+0000 devstack0a nova-compute[79776]: DEBUG nova.network.os_vif_util [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Converting VIF {"id": "e3c723fb-59a8-49bf-8034-6bd7bd3da680", "address": "fa:16:3e:1b:c9:fa", "network": {"id": "21b5983e-c4f1-486e-9063-28144657b072", "bridge": "br-int", "label": "private", "subnets": [{"cidr": "10.0.0.0/26", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.2"}}, {"cidr": "fd3f:cc4:f190::/64", "dns": [], "gateway": {"address": "fd3f:cc4:f190::1", "type": "gateway", "version": 6, "meta": {}}, "ips": [{"address": "fd3f:cc4:f190:0:f816:3eff:fe1b:c9fa", "type": "fixed", "version": 6, "meta": {}, "floating_ips": []}], "routes": [], "version": 6, "meta": {"ipv6_address_mode": "slaac", "dhcp_server": "fd3f:cc4:f190:0:f816:3eff:fe94:a913"}}], "meta": {"injected": false, "tenant_id": "0fa1a3175d10483d814fd787aac9c3b5", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int", "bound_drivers": {"0": "openvswitch"}}, "devname": "tape3c723fb-59", "ovs_interfaceid": "e3c723fb-59a8-49bf-8034-6bd7bd3da680", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=79776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} 2022-09-01T13:52:05.195248+0000 devstack0a nova-compute[79776]: DEBUG nova.network.os_vif_util [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c9:fa,bridge_name='br-int',has_traffic_filtering=True,id=e3c723fb-59a8-49bf-8034-6bd7bd3da680,network=Network(21b5983e-c4f1-486e-9063-28144657b072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3c723fb-59') {{(pid=79776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.libvirt.driver [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] End _get_guest_xml xml= 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 48343f6f-de61-449e-b142-c24ba2f14c02 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: instance-00000003 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 262144 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 1 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: vm1 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01 13:52:05 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 256 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 1 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 0 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 0 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 1 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: admin 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: admin 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: OpenStack Foundation 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: OpenStack Nova 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 25.1.0 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 48343f6f-de61-449e-b142-c24ba2f14c02 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 48343f6f-de61-449e-b142-c24ba2f14c02 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: Virtual Machine 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: hvm 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: Nehalem 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: /dev/urandom 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: 2022-09-01T13:52:05.198042+0000 devstack0a nova-compute[79776]: {{(pid=79776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7323}} 2022-09-01T13:52:05.207765+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Preparing to wait for external event network-vif-plugged-e3c723fb-59a8-49bf-8034-6bd7bd3da680 {{(pid=79776) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:280}} 2022-09-01T13:52:05.207765+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Acquiring lock "48343f6f-de61-449e-b142-c24ba2f14c02-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:385}} 2022-09-01T13:52:05.207765+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Lock "48343f6f-de61-449e-b142-c24ba2f14c02-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:390}} 2022-09-01T13:52:05.207765+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Lock "48343f6f-de61-449e-b142-c24ba2f14c02-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} 2022-09-01T13:52:05.207765+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.libvirt.vif [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2022-09-01T13:51:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='vm1',display_name='vm1',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='devstack0',hostname='vm1',id=3,image_ref='b8eb1c47-b543-4fab-9c1c-906075f7a4d1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2022-09-01T13:51:34Z,launched_on='devstack0',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=None,node='devstack0',numa_topology=InstanceNUMATopology(UNKNOWN),old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='311ddfdb901749848cfc815cbb80ca2c',ramdisk_id='',reservation_id='r-0f9zuyu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader,admin',image_base_image_ref='b8eb1c47-b543-4fab-9c1c-906075f7a4d1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='admin',owner_user_name='admin'},tags=,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2022-09-01T13:52:05Z,user_data=None,user_id='2dd34d507a434450ba9006c835f64bf2',uuid=48343f6f-de61-449e-b142-c24ba2f14c02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3c723fb-59a8-49bf-8034-6bd7bd3da680", "address": "fa:16:3e:1b:c9:fa", "network": {"id": "21b5983e-c4f1-486e-9063-28144657b072", "bridge": "br-int", "label": "private", "subnets": [{"cidr": "10.0.0.0/26", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.2"}}, {"cidr": "fd3f:cc4:f190::/64", "dns": [], "gateway": {"address": "fd3f:cc4:f190::1", "type": "gateway", "version": 6, "meta": {}}, "ips": [{"address": "fd3f:cc4:f190:0:f816:3eff:fe1b:c9fa", "type": "fixed", "version": 6, "meta": {}, "floating_ips": []}], "routes": [], "version": 6, "meta": {"ipv6_address_mode": "slaac", "dhcp_server": "fd3f:cc4:f190:0:f816:3eff:fe94:a913"}}], "meta": {"injected": false, "tenant_id": "0fa1a3175d10483d814fd787aac9c3b5", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int", "bound_drivers": {"0": "openvswitch"}}, "devname": "tape3c723fb-59", "ovs_interfaceid": "e3c723fb-59a8-49bf-8034-6bd7bd3da680", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=79776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}} 2022-09-01T13:52:05.208494+0000 devstack0a nova-compute[79776]: DEBUG nova.network.os_vif_util [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Converting VIF {"id": "e3c723fb-59a8-49bf-8034-6bd7bd3da680", "address": "fa:16:3e:1b:c9:fa", "network": {"id": "21b5983e-c4f1-486e-9063-28144657b072", "bridge": "br-int", "label": "private", "subnets": [{"cidr": "10.0.0.0/26", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.2"}}, {"cidr": "fd3f:cc4:f190::/64", "dns": [], "gateway": {"address": "fd3f:cc4:f190::1", "type": "gateway", "version": 6, "meta": {}}, "ips": [{"address": "fd3f:cc4:f190:0:f816:3eff:fe1b:c9fa", "type": "fixed", "version": 6, "meta": {}, "floating_ips": []}], "routes": [], "version": 6, "meta": {"ipv6_address_mode": "slaac", "dhcp_server": "fd3f:cc4:f190:0:f816:3eff:fe94:a913"}}], "meta": {"injected": false, "tenant_id": "0fa1a3175d10483d814fd787aac9c3b5", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int", "bound_drivers": {"0": "openvswitch"}}, "devname": "tape3c723fb-59", "ovs_interfaceid": "e3c723fb-59a8-49bf-8034-6bd7bd3da680", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=79776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} 2022-09-01T13:52:05.208494+0000 devstack0a nova-compute[79776]: DEBUG nova.network.os_vif_util [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c9:fa,bridge_name='br-int',has_traffic_filtering=True,id=e3c723fb-59a8-49bf-8034-6bd7bd3da680,network=Network(21b5983e-c4f1-486e-9063-28144657b072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3c723fb-59') {{(pid=79776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} 2022-09-01T13:52:05.208494+0000 devstack0a nova-compute[79776]: DEBUG os_vif [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c9:fa,bridge_name='br-int',has_traffic_filtering=True,id=e3c723fb-59a8-49bf-8034-6bd7bd3da680,network=Network(21b5983e-c4f1-486e-9063-28144657b072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3c723fb-59') {{(pid=79776) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}} 2022-09-01T13:52:05.212885+0000 devstack0a ovs-vsctl[82508]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --timeout=120 --oneline --format=json --db=tcp:127.0.0.1:6640 -- --may-exist add-br br-int -- set Bridge br-int datapath_type=system 2022-09-01T13:52:05.228232+0000 devstack0a ovs-vsctl[82509]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --timeout=120 --oneline --format=json --db=tcp:127.0.0.1:6640 -- --may-exist add-port br-int tape3c723fb-59 -- set Interface tape3c723fb-59 external_ids:iface-id=e3c723fb-59a8-49bf-8034-6bd7bd3da680 external_ids:iface-status=active external_ids:attached-mac=fa:16:3e:1b:c9:fa external_ids:vm-uuid=48343f6f-de61-449e-b142-c24ba2f14c02 2022-09-01T13:52:05.249717+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [req-63fec893-9952-4505-a6de-643835e0e758 req-d9cdf58e-39ab-4243-85ca-933c13f20196 service nova] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Received event network-changed-e3c723fb-59a8-49bf-8034-6bd7bd3da680 {{(pid=79776) external_instance_event /opt/stack/nova/nova/compute/manager.py:10641}} 2022-09-01T13:52:05.249717+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [req-63fec893-9952-4505-a6de-643835e0e758 req-d9cdf58e-39ab-4243-85ca-933c13f20196 service nova] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Refreshing instance network info cache due to event network-changed-e3c723fb-59a8-49bf-8034-6bd7bd3da680. {{(pid=79776) external_instance_event /opt/stack/nova/nova/compute/manager.py:10646}} 2022-09-01T13:52:05.250229+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [req-63fec893-9952-4505-a6de-643835e0e758 req-d9cdf58e-39ab-4243-85ca-933c13f20196 service nova] Acquiring lock "refresh_cache-48343f6f-de61-449e-b142-c24ba2f14c02" {{(pid=79776) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:293}} 2022-09-01T13:52:05.250229+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [req-63fec893-9952-4505-a6de-643835e0e758 req-d9cdf58e-39ab-4243-85ca-933c13f20196 service nova] Acquired lock "refresh_cache-48343f6f-de61-449e-b142-c24ba2f14c02" {{(pid=79776) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:296}} 2022-09-01T13:52:05.250470+0000 devstack0a nova-compute[79776]: DEBUG nova.network.neutron [req-63fec893-9952-4505-a6de-643835e0e758 req-d9cdf58e-39ab-4243-85ca-933c13f20196 service nova] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Refreshing network info cache for port e3c723fb-59a8-49bf-8034-6bd7bd3da680 {{(pid=79776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} 2022-09-01T13:52:05.258677+0000 devstack0a nova-compute[79776]: INFO os_vif [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c9:fa,bridge_name='br-int',has_traffic_filtering=True,id=e3c723fb-59a8-49bf-8034-6bd7bd3da680,network=Network(21b5983e-c4f1-486e-9063-28144657b072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3c723fb-59') 2022-09-01T13:52:05.332110+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.libvirt.driver [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] No BDM found with device name vda, not building metadata. {{(pid=79776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:11776}} 2022-09-01T13:52:05.332691+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.libvirt.driver [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] No VIF found with MAC fa:16:3e:1b:c9:fa, not building metadata {{(pid=79776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:11752}} 2022-09-01T13:52:05.887561+0000 devstack0a nova-compute[79776]: DEBUG nova.network.neutron [req-63fec893-9952-4505-a6de-643835e0e758 req-d9cdf58e-39ab-4243-85ca-933c13f20196 service nova] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Updated VIF entry in instance network info cache for port e3c723fb-59a8-49bf-8034-6bd7bd3da680. {{(pid=79776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3437}} 2022-09-01T13:52:05.887561+0000 devstack0a nova-compute[79776]: DEBUG nova.network.neutron [req-63fec893-9952-4505-a6de-643835e0e758 req-d9cdf58e-39ab-4243-85ca-933c13f20196 service nova] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Updating instance_info_cache with network_info: [{"id": "e3c723fb-59a8-49bf-8034-6bd7bd3da680", "address": "fa:16:3e:1b:c9:fa", "network": {"id": "21b5983e-c4f1-486e-9063-28144657b072", "bridge": "br-int", "label": "private", "subnets": [{"cidr": "10.0.0.0/26", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.2"}}, {"cidr": "fd3f:cc4:f190::/64", "dns": [], "gateway": {"address": "fd3f:cc4:f190::1", "type": "gateway", "version": 6, "meta": {}}, "ips": [{"address": "fd3f:cc4:f190:0:f816:3eff:fe1b:c9fa", "type": "fixed", "version": 6, "meta": {}, "floating_ips": []}], "routes": [], "version": 6, "meta": {"ipv6_address_mode": "slaac", "dhcp_server": "fd3f:cc4:f190:0:f816:3eff:fe94:a913"}}], "meta": {"injected": false, "tenant_id": "0fa1a3175d10483d814fd787aac9c3b5", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int", "bound_drivers": {"0": "openvswitch"}}, "devname": "tape3c723fb-59", "ovs_interfaceid": "e3c723fb-59a8-49bf-8034-6bd7bd3da680", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=79776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} 2022-09-01T13:52:05.899422+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [req-63fec893-9952-4505-a6de-643835e0e758 req-d9cdf58e-39ab-4243-85ca-933c13f20196 service nova] Releasing lock "refresh_cache-48343f6f-de61-449e-b142-c24ba2f14c02" {{(pid=79776) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:314}} 2022-09-01T13:52:05.899833+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [req-63fec893-9952-4505-a6de-643835e0e758 req-d9cdf58e-39ab-4243-85ca-933c13f20196 service nova] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Received event network-changed-e3c723fb-59a8-49bf-8034-6bd7bd3da680 {{(pid=79776) external_instance_event /opt/stack/nova/nova/compute/manager.py:10641}} 2022-09-01T13:52:05.900142+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [req-63fec893-9952-4505-a6de-643835e0e758 req-d9cdf58e-39ab-4243-85ca-933c13f20196 service nova] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Refreshing instance network info cache due to event network-changed-e3c723fb-59a8-49bf-8034-6bd7bd3da680. {{(pid=79776) external_instance_event /opt/stack/nova/nova/compute/manager.py:10646}} 2022-09-01T13:52:05.900483+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [req-63fec893-9952-4505-a6de-643835e0e758 req-d9cdf58e-39ab-4243-85ca-933c13f20196 service nova] Acquiring lock "refresh_cache-48343f6f-de61-449e-b142-c24ba2f14c02" {{(pid=79776) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:293}} 2022-09-01T13:52:05.900774+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [req-63fec893-9952-4505-a6de-643835e0e758 req-d9cdf58e-39ab-4243-85ca-933c13f20196 service nova] Acquired lock "refresh_cache-48343f6f-de61-449e-b142-c24ba2f14c02" {{(pid=79776) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:296}} 2022-09-01T13:52:05.901098+0000 devstack0a nova-compute[79776]: DEBUG nova.network.neutron [req-63fec893-9952-4505-a6de-643835e0e758 req-d9cdf58e-39ab-4243-85ca-933c13f20196 service nova] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Refreshing network info cache for port e3c723fb-59a8-49bf-8034-6bd7bd3da680 {{(pid=79776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} 2022-09-01T13:52:06.739700+0000 devstack0a nova-compute[79776]: DEBUG nova.network.neutron [req-63fec893-9952-4505-a6de-643835e0e758 req-d9cdf58e-39ab-4243-85ca-933c13f20196 service nova] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Updated VIF entry in instance network info cache for port e3c723fb-59a8-49bf-8034-6bd7bd3da680. {{(pid=79776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3437}} 2022-09-01T13:52:06.740125+0000 devstack0a nova-compute[79776]: DEBUG nova.network.neutron [req-63fec893-9952-4505-a6de-643835e0e758 req-d9cdf58e-39ab-4243-85ca-933c13f20196 service nova] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Updating instance_info_cache with network_info: [{"id": "e3c723fb-59a8-49bf-8034-6bd7bd3da680", "address": "fa:16:3e:1b:c9:fa", "network": {"id": "21b5983e-c4f1-486e-9063-28144657b072", "bridge": "br-int", "label": "private", "subnets": [{"cidr": "10.0.0.0/26", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.2"}}, {"cidr": "fd3f:cc4:f190::/64", "dns": [], "gateway": {"address": "fd3f:cc4:f190::1", "type": "gateway", "version": 6, "meta": {}}, "ips": [{"address": "fd3f:cc4:f190:0:f816:3eff:fe1b:c9fa", "type": "fixed", "version": 6, "meta": {}, "floating_ips": []}], "routes": [], "version": 6, "meta": {"ipv6_address_mode": "slaac", "dhcp_server": "fd3f:cc4:f190:0:f816:3eff:fe94:a913"}}], "meta": {"injected": false, "tenant_id": "0fa1a3175d10483d814fd787aac9c3b5", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int", "bound_drivers": {"0": "openvswitch"}}, "devname": "tape3c723fb-59", "ovs_interfaceid": "e3c723fb-59a8-49bf-8034-6bd7bd3da680", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=79776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} 2022-09-01T13:52:06.753069+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [req-63fec893-9952-4505-a6de-643835e0e758 req-d9cdf58e-39ab-4243-85ca-933c13f20196 service nova] Releasing lock "refresh_cache-48343f6f-de61-449e-b142-c24ba2f14c02" {{(pid=79776) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:314}} 2022-09-01T13:52:06.904804+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [req-114697ec-d352-41ce-ac13-4b8b2138f073 req-5714f4af-ac3e-44be-8f2d-96d06cff71b6 service nova] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Received event network-vif-plugged-e3c723fb-59a8-49bf-8034-6bd7bd3da680 {{(pid=79776) external_instance_event /opt/stack/nova/nova/compute/manager.py:10641}} 2022-09-01T13:52:06.905299+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [req-114697ec-d352-41ce-ac13-4b8b2138f073 req-5714f4af-ac3e-44be-8f2d-96d06cff71b6 service nova] Acquiring lock "48343f6f-de61-449e-b142-c24ba2f14c02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:385}} 2022-09-01T13:52:06.905384+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [req-114697ec-d352-41ce-ac13-4b8b2138f073 req-5714f4af-ac3e-44be-8f2d-96d06cff71b6 service nova] Lock "48343f6f-de61-449e-b142-c24ba2f14c02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:390}} 2022-09-01T13:52:06.905623+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [req-114697ec-d352-41ce-ac13-4b8b2138f073 req-5714f4af-ac3e-44be-8f2d-96d06cff71b6 service nova] Lock "48343f6f-de61-449e-b142-c24ba2f14c02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} 2022-09-01T13:52:06.905855+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [req-114697ec-d352-41ce-ac13-4b8b2138f073 req-5714f4af-ac3e-44be-8f2d-96d06cff71b6 service nova] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Processing event network-vif-plugged-e3c723fb-59a8-49bf-8034-6bd7bd3da680 {{(pid=79776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10401}} 2022-09-01T13:52:07.326640+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.driver [None req-3ee36098-26a8-4aad-af47-f71a87c56c68 None None] Emitting event Started> {{(pid=79776) emit_event /opt/stack/nova/nova/virt/driver.py:1630}} 2022-09-01T13:52:07.326949+0000 devstack0a nova-compute[79776]: INFO nova.compute.manager [None req-3ee36098-26a8-4aad-af47-f71a87c56c68 None None] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] VM Started (Lifecycle Event) 2022-09-01T13:52:07.329715+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=79776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:574}} 2022-09-01T13:52:07.333408+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.libvirt.driver [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Guest created on hypervisor {{(pid=79776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4355}} 2022-09-01T13:52:07.336727+0000 devstack0a nova-compute[79776]: INFO nova.virt.libvirt.driver [-] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Instance spawned successfully. 2022-09-01T13:52:07.337397+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Checking state {{(pid=79776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1659}} 2022-09-01T13:52:07.419756+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [None req-3ee36098-26a8-4aad-af47-f71a87c56c68 None None] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Checking state {{(pid=79776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1659}} 2022-09-01T13:52:07.424736+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [None req-3ee36098-26a8-4aad-af47-f71a87c56c68 None None] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 0, VM power_state: 1 {{(pid=79776) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1379}} 2022-09-01T13:52:07.468647+0000 devstack0a nova-compute[79776]: INFO nova.compute.manager [None req-3ee36098-26a8-4aad-af47-f71a87c56c68 None None] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] During the sync_power process the instance has moved from host devstack0 to host devstack0a 2022-09-01T13:52:07.469059+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.driver [None req-3ee36098-26a8-4aad-af47-f71a87c56c68 None None] Emitting event Paused> {{(pid=79776) emit_event /opt/stack/nova/nova/virt/driver.py:1630}} 2022-09-01T13:52:07.469364+0000 devstack0a nova-compute[79776]: INFO nova.compute.manager [None req-3ee36098-26a8-4aad-af47-f71a87c56c68 None None] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] VM Paused (Lifecycle Event) 2022-09-01T13:52:07.587145+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [None req-3ee36098-26a8-4aad-af47-f71a87c56c68 None None] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Checking state {{(pid=79776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1659}} 2022-09-01T13:52:07.591136+0000 devstack0a nova-compute[79776]: DEBUG nova.virt.driver [None req-3ee36098-26a8-4aad-af47-f71a87c56c68 None None] Emitting event Resumed> {{(pid=79776) emit_event /opt/stack/nova/nova/virt/driver.py:1630}} 2022-09-01T13:52:07.591493+0000 devstack0a nova-compute[79776]: INFO nova.compute.manager [None req-3ee36098-26a8-4aad-af47-f71a87c56c68 None None] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] VM Resumed (Lifecycle Event) 2022-09-01T13:52:07.640135+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:385}} 2022-09-01T13:52:07.640764+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:390}} 2022-09-01T13:52:07.661463+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [None req-3ee36098-26a8-4aad-af47-f71a87c56c68 None None] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Checking state {{(pid=79776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1659}} 2022-09-01T13:52:07.665250+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [None req-3ee36098-26a8-4aad-af47-f71a87c56c68 None None] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=79776) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1379}} 2022-09-01T13:52:07.713880+0000 devstack0a nova-compute[79776]: INFO nova.compute.manager [None req-3ee36098-26a8-4aad-af47-f71a87c56c68 None None] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] During the sync_power process the instance has moved from host devstack0 to host devstack0a 2022-09-01T13:52:08.053607+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-e892fc24-0651-4c08-be7c-551c1ecc7bc7 admin admin] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.413s {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} 2022-09-01T13:52:42.301825+0000 devstack0a nova-compute[79776]: DEBUG oslo_service.periodic_task [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=79776) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} 2022-09-01T13:52:42.305284+0000 devstack0a nova-compute[79776]: DEBUG oslo_service.periodic_task [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=79776) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} 2022-09-01T13:52:43.302256+0000 devstack0a nova-compute[79776]: DEBUG oslo_service.periodic_task [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=79776) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} 2022-09-01T13:52:43.303987+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Starting heal instance info cache {{(pid=79776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9474}} 2022-09-01T13:52:43.303987+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Rebuilding the list of instances to heal {{(pid=79776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9478}} 2022-09-01T13:52:43.390370+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Acquiring lock "refresh_cache-48343f6f-de61-449e-b142-c24ba2f14c02" {{(pid=79776) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:293}} 2022-09-01T13:52:43.390604+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Acquired lock "refresh_cache-48343f6f-de61-449e-b142-c24ba2f14c02" {{(pid=79776) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:296}} 2022-09-01T13:52:43.390858+0000 devstack0a nova-compute[79776]: DEBUG nova.network.neutron [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Forcefully refreshing network info cache for instance {{(pid=79776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1984}} 2022-09-01T13:52:43.391068+0000 devstack0a nova-compute[79776]: DEBUG nova.objects.instance [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Lazy-loading 'info_cache' on Instance uuid 48343f6f-de61-449e-b142-c24ba2f14c02 {{(pid=79776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} 2022-09-01T13:52:43.854355+0000 devstack0a nova-compute[79776]: DEBUG nova.network.neutron [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Updating instance_info_cache with network_info: [{"id": "e3c723fb-59a8-49bf-8034-6bd7bd3da680", "address": "fa:16:3e:1b:c9:fa", "network": {"id": "21b5983e-c4f1-486e-9063-28144657b072", "bridge": "br-int", "label": "private", "subnets": [{"cidr": "10.0.0.0/26", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.2"}}, {"cidr": "fd3f:cc4:f190::/64", "dns": [], "gateway": {"address": "fd3f:cc4:f190::1", "type": "gateway", "version": 6, "meta": {}}, "ips": [{"address": "fd3f:cc4:f190:0:f816:3eff:fe1b:c9fa", "type": "fixed", "version": 6, "meta": {}, "floating_ips": []}], "routes": [], "version": 6, "meta": {"ipv6_address_mode": "slaac", "dhcp_server": "fd3f:cc4:f190:0:f816:3eff:fe94:a913"}}], "meta": {"injected": false, "tenant_id": "0fa1a3175d10483d814fd787aac9c3b5", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int", "bound_drivers": {"0": "openvswitch"}}, "devname": "tape3c723fb-59", "ovs_interfaceid": "e3c723fb-59a8-49bf-8034-6bd7bd3da680", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=79776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} 2022-09-01T13:52:43.878540+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Releasing lock "refresh_cache-48343f6f-de61-449e-b142-c24ba2f14c02" {{(pid=79776) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:314}} 2022-09-01T13:52:43.879101+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] [instance: 48343f6f-de61-449e-b142-c24ba2f14c02] Updated the network info_cache for instance {{(pid=79776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9545}} 2022-09-01T13:52:43.879945+0000 devstack0a nova-compute[79776]: DEBUG oslo_service.periodic_task [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Running periodic task ComputeManager.update_available_resource {{(pid=79776) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} 2022-09-01T13:52:43.897669+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:385}} 2022-09-01T13:52:43.898227+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:390}} 2022-09-01T13:52:43.898670+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} 2022-09-01T13:52:43.899166+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.resource_tracker [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Auditing locally available compute resources for devstack0a (node: devstack0a) {{(pid=79776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:880}} 2022-09-01T13:52:43.948488+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.processutils [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48343f6f-de61-449e-b142-c24ba2f14c02/disk --force-share --output=json {{(pid=79776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} 2022-09-01T13:52:44.012405+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.processutils [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48343f6f-de61-449e-b142-c24ba2f14c02/disk --force-share --output=json" returned: 0 in 0.063s {{(pid=79776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} 2022-09-01T13:52:44.013834+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.processutils [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48343f6f-de61-449e-b142-c24ba2f14c02/disk --force-share --output=json {{(pid=79776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} 2022-09-01T13:52:44.073371+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.processutils [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48343f6f-de61-449e-b142-c24ba2f14c02/disk --force-share --output=json" returned: 0 in 0.059s {{(pid=79776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} 2022-09-01T13:52:44.195585+0000 devstack0a nova-compute[79776]: WARNING nova.virt.libvirt.driver [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2022-09-01T13:52:44.197817+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.resource_tracker [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Hypervisor/Node resource view: name=devstack0a free_ram=1952MB free_disk=21.26390838623047GB free_vcpus=unknown pci_devices=[{"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000d", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000d", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_2", "address": "0000:00:05.2", "product_id": "100e", "vendor_id": "8086", "numa_node": null, "label": "label_8086_100e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "00b8", "vendor_id": "1013", "numa_node": null, "label": "label_1013_00b8", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_00_0", "address": "0000:02:00.0", "product_id": "1043", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1043", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_1", "address": "0000:00:05.1", "product_id": "100e", "vendor_id": "8086", "numa_node": null, "label": "label_8086_100e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "100e", "vendor_id": "8086", "numa_node": null, "label": "label_8086_100e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1042", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1042", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}] {{(pid=79776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1048}} 2022-09-01T13:52:44.198567+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:385}} 2022-09-01T13:52:44.199281+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:390}} 2022-09-01T13:52:44.274212+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.resource_tracker [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Instance 48343f6f-de61-449e-b142-c24ba2f14c02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 256, 'DISK_GB': 1, 'PCPU': 1}}. {{(pid=79776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1588}} 2022-09-01T13:52:44.274819+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.resource_tracker [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Final resource view: name=devstack0a phys_ram=3923MB used_ram=768MB phys_disk=28GB used_disk=1GB total_vcpus=0 used_vcpus=0 pci_stats=[] {{(pid=79776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}} 2022-09-01T13:52:44.336045+0000 devstack0a nova-compute[79776]: DEBUG nova.scheduler.client.report [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Refreshing inventories for resource provider 838d258c-c254-4357-b5f9-1cc3e6255169 {{(pid=79776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}} 2022-09-01T13:52:44.356418+0000 devstack0a nova-compute[79776]: DEBUG nova.scheduler.client.report [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Updating ProviderTree inventory for provider 838d258c-c254-4357-b5f9-1cc3e6255169 from _refresh_and_get_inventory using data: {'MEMORY_MB': {'total': 3923, 'reserved': 512, 'min_unit': 1, 'max_unit': 3923, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}, 'PCPU': {'total': 2, 'reserved': 0, 'min_unit': 1, 'max_unit': 2, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=79776) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}} 2022-09-01T13:52:44.356954+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.provider_tree [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Updating inventory in ProviderTree for provider 838d258c-c254-4357-b5f9-1cc3e6255169 with inventory: {'MEMORY_MB': {'total': 3923, 'reserved': 512, 'min_unit': 1, 'max_unit': 3923, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}, 'PCPU': {'total': 2, 'reserved': 0, 'min_unit': 1, 'max_unit': 2, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=79776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} 2022-09-01T13:52:44.373018+0000 devstack0a nova-compute[79776]: DEBUG nova.scheduler.client.report [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Refreshing aggregate associations for resource provider 838d258c-c254-4357-b5f9-1cc3e6255169, aggregates: None {{(pid=79776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}} 2022-09-01T13:52:44.403603+0000 devstack0a nova-compute[79776]: DEBUG nova.scheduler.client.report [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Refreshing trait associations for resource provider 838d258c-c254-4357-b5f9-1cc3e6255169, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=79776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}} 2022-09-01T13:52:44.409120+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.provider_tree [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Inventory has not changed in ProviderTree for provider: 838d258c-c254-4357-b5f9-1cc3e6255169 {{(pid=79776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} 2022-09-01T13:52:44.420248+0000 devstack0a nova-compute[79776]: DEBUG nova.scheduler.client.report [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Inventory has not changed for provider 838d258c-c254-4357-b5f9-1cc3e6255169 based on inventory data: {'MEMORY_MB': {'total': 3923, 'reserved': 512, 'min_unit': 1, 'max_unit': 3923, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 28, 'reserved': 0, 'min_unit': 1, 'max_unit': 28, 'step_size': 1, 'allocation_ratio': 1.0}, 'PCPU': {'total': 2, 'reserved': 0, 'min_unit': 1, 'max_unit': 2, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=79776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}} 2022-09-01T13:52:44.420615+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.resource_tracker [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Compute_service record updated for devstack0a:devstack0a {{(pid=79776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1008}} 2022-09-01T13:52:44.420785+0000 devstack0a nova-compute[79776]: DEBUG oslo_concurrency.lockutils [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=79776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} 2022-09-01T13:52:44.842161+0000 devstack0a nova-compute[79776]: DEBUG oslo_service.periodic_task [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=79776) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} 2022-09-01T13:52:44.842799+0000 devstack0a nova-compute[79776]: DEBUG oslo_service.periodic_task [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=79776) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} 2022-09-01T13:52:45.301878+0000 devstack0a nova-compute[79776]: DEBUG oslo_service.periodic_task [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=79776) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} 2022-09-01T13:52:45.304116+0000 devstack0a nova-compute[79776]: DEBUG oslo_service.periodic_task [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=79776) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} 2022-09-01T13:52:45.305943+0000 devstack0a nova-compute[79776]: DEBUG nova.compute.manager [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=79776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10091}} 2022-09-01T13:52:49.304010+0000 devstack0a nova-compute[79776]: DEBUG oslo_service.periodic_task [None req-f1b145f9-3b2f-49d1-9a99-414fa3c90216 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=79776) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}