1. Exact version of Nova/OpenStack you are running:
Kilo
2. Relevant log files:
nce: 3c061dbd-70ae-452f-a309-ec24b9f58998] Setting instance vm_state to ERROR
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998] Traceback (most recent call last):
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2875, in do_terminate_instance
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998] self._delete_instance(context, instance, bdms, quotas)
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998] File "/usr/lib/python2.7/site-packages/nova/hooks.py", line 149, in inner
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998] rv = f(*args, **kwargs)
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2844, in _delete_instance
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998] quotas.rollback()
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998] File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998] six.reraise(self.type_, self.value, self.tb)
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2839, in _delete_instance
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998] self._update_resource_tracker(context, instance)
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 790, in _update_resource_tracker
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998] rt.update_usage(context, instance)
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998] File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 445, in inner
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998] return f(*args, **kwargs)
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998] File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 351, in update_usage
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998] instance)
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998] File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 840, in _update_usage_from_instance
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998] self._update_usage(context, resources, instance, sign=sign)
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998] File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 710, in _update_usage
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998] resources, usage, free)
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998] File "/usr/lib/python2.7/site-packages/nova/virt/hardware.py", line 1227, in get_host_numa_usage_from_instance
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998] host_numa_topology, instance_numa_topology, free=free))
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998] File "/usr/lib/python2.7/site-packages/nova/virt/hardware.py", line 1099, in numa_usage_from_instances
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998] newcell.unpin_cpus(pinned_cpus)
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998] File "/usr/lib/python2.7/site-packages/nova/objects/numa.py", line 95, in unpin_cpus
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998] pinned=list(self.pinned_cpus))
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998] CPUPinningInvalid: Cannot pin/unpin cpus [1, 9] from the following pinned set [0, 1, 2, 3, 8, 10, 11]
2015-11-06 15:48:11.470 8436 TRACE nova.compute.manager [instance: 3c061dbd-70ae-452f-a309-ec24b9f58998]
2015-11-06 15:48:11.681 8436 ERROR oslo_messaging.rpc.dispatcher [req-adb93087-7936-4705-a0e9-9e2697c87348 9c67877ee37b47e989148a776862c7b8 40fc54dc632c4a02b44bf31d7ff15c82 - - -] Exception during message handling: Cannot pin/unpin cpus [1, 9] from the following pinned set [0, 1, 2, 3, 8, 10, 11]
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher Traceback (most recent call last):
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 142, in _dispatch_and_reply
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher executor_callback))
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 186, in _dispatch
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher executor_callback)
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 130, in _do_dispatch
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher result = func(ctxt, **new_args)
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 7695, in terminate_instance
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher reservations=reservations)
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/exception.py", line 88, in wrapped
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher payload)
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/exception.py", line 71, in wrapped
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher return f(self, context, *args, **kw)
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 366, in decorated_function
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher LOG.warning(msg, e, instance_uuid=instance_uuid)
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 337, in decorated_function
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher return function(self, context, *args, **kwargs)
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 416, in decorated_function
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher return function(self, context, *args, **kwargs)
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 394, in decorated_function
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher kwargs['instance'], e, sys.exc_info())
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 382, in decorated_function
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher return function(self, context, *args, **kwargs)
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2887, in terminate_instance
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher do_terminate_instance(instance, bdms)
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 445, in inner
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher return f(*args, **kwargs)
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2885, in do_terminate_instance
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher self._set_instance_error_state(context, instance)
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2875, in do_terminate_instance
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher self._delete_instance(context, instance, bdms, quotas)
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/hooks.py", line 149, in inner
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher rv = f(*args, **kwargs)
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2844, in _delete_instance
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher quotas.rollback()
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2839, in _delete_instance
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher self._update_resource_tracker(context, instance)
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 790, in _update_resource_tracker
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher rt.update_usage(context, instance)
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 445, in inner
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher return f(*args, **kwargs)
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 351, in update_usage
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher instance)
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 840, in _update_usage_from_instance
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher self._update_usage(context, resources, instance, sign=sign)
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 710, in _update_usage
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher resources, usage, free)
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/virt/hardware.py", line 1227, in get_host_numa_usage_from_instance
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher host_numa_topology, instance_numa_topology, free=free))
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/virt/hardware.py", line 1099, in numa_usage_from_instances
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher newcell.unpin_cpus(pinned_cpus)
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/objects/numa.py", line 95, in unpin_cpus
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher pinned=list(self.pinned_cpus))
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher CPUPinningInvalid: Cannot pin/unpin cpus [1, 9] from the following pinned set [0, 1, 2, 3, 8, 10, 11]
2015-11-06 15:48:11.681 8436 TRACE oslo_messaging.rpc.dispatcher
[root@nail-SBCJ-5-3-3 ~]#
[root@nail-SBCJ-5-3-3 ~]#
3. Reproduce steps:
1) [root@nail-SBCJ-5-3-13 compute(keystone_admin)]# nova flavor-show hanrong_numa
+----------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+
| Property | Value |
+----------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+
| OS-FLV-DISABLED:disabled | False |
| OS-FLV-EXT-DATA:ephemeral | 0 |
| disk | 1 |
| extra_specs | {"hw:cpu_policy": "dedicated", "hw:numa_mem.1": "512", "hw:numa_mem.0": "512", "hw:numa_nodes": "2", "hw:numa_cpus.0": "0,1", "hw:numa_cpus.1": "2,3"} |
| id | e54b01d6-fd71-418d-b312-bc643fcaf7e0 |
| name | hanrong_numa |
| os-flavor-access:is_public | True |
| ram | 1024 |
| rxtx_factor | 1.0 |
| swap | |
| vcpus | 4 |
+----------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+
[root@nail-SBCJ-5-3-13 compute(keystone_admin)]#
2)boot a instance with numa flavor
3)live migration this instance
4) delete this instance
