Chck out this log, it clearly states that the issue is Numa topology requirments.
2015-11-26 10:08:39.604 2899 DEBUG nova.scheduler.filters.numa_topology_filter [req-9688c526-0f54-43f3-ba1a-7fe1d1bc63d4 d525cf27fd9c4782a20363f65bed9795 f77fb93ac01c488f8cfd1eb4ebe7c2f0 - - -] sbezverk-osp-4.sbezverk.cisco.com, sbezverk-osp-4.sbezverk.cisco.com fails NUMA topologyrequirements. The instance does not fit on this host. host_passes /usr/lib/python2.7/site-packages/nova/scheduler/filters/numa_topology_filter.py:48
2015-11-26 10:08:39.605 2899 INFO nova.filters [req-9688c526-0f54-43f3-ba1a-7fe1d1bc63d4 d525cf27fd9c4782a20363f65bed9795 f77fb93ac01c488f8cfd1eb4ebe7c2f0 - - -] Filter NUMATopologyFilter returned 0 hosts
2015-11-26 10:08:39.605 2899 DEBUG nova.filters [req-9688c526-0f54-43f3-ba1a-7fe1d1bc63d4 d525cf27fd9c4782a20363f65bed9795 f77fb93ac01c488f8cfd1eb4ebe7c2f0 - - -] Filtering removed all hosts for the request with reservation ID 'r-tfsr0m79' and instance ID 'd4643825-0893-45b9-904d-b5a6bbd1ec30'. Filter results: [('RetryFilter', [(u'sbezverk-osp-4.sbezverk.cisco.com', u'sbezverk-osp-4.sbezverk.cisco.com')]), ('AvailabilityZoneFilter', [(u'sbezverk-osp-4.sbezverk.cisco.com', u'sbezverk-osp-4.sbezverk.cisco.com')]), ('RamFilter', [(u'sbezverk-osp-4.sbezverk.cisco.com', u'sbezverk-osp-4.sbezverk.cisco.com')]), ('ComputeFilter', [(u'sbezverk-osp-4.sbezverk.cisco.com', u'sbezverk-osp-4.sbezverk.cisco.com')]), ('ComputeCapabilitiesFilter', [(u'sbezverk-osp-4.sbezverk.cisco.com', u'sbezverk-osp-4.sbezverk.cisco.com')]), ('ImagePropertiesFilter', [(u'sbezverk-osp-4.sbezverk.cisco.com', u'sbezverk-osp-4.sbezverk.cisco.com')]), ('ServerGroupAntiAffinityFilter', [(u'sbezverk-osp-4.sbezverk.cisco.com', u'sbezverk-osp-4.sbezverk.cisco.com')]), ('ServerGroupAffinityFilter', [(u'sbezverk-osp-4.sbezverk.cisco.com', u'sbezverk-osp-4.sbezverk.cisco.com')]), ('PciPassthroughFilter', [(u'sbezverk-osp-4.sbezverk.cisco.com', u'sbezverk-osp-4.sbezverk.cisco.com')]), ('NUMATopologyFilter', None)] get_filtered_objects /usr/lib/python2.7/site-packages/nova/filters.py:122
2015-11-26 10:08:39.605 2899 INFO nova.filters [req-9688c526-0f54-43f3-ba1a-7fe1d1bc63d4 d525cf27fd9c4782a20363f65bed9795 f77fb93ac01c488f8cfd1eb4ebe7c2f0 - - -] Filtering removed all hosts for the request with reservation ID 'r-tfsr0m79' and instance ID 'd4643825-0893-45b9-904d-b5a6bbd1ec30'. Filter results: ['RetryFilter: (start: 1, end: 1)', 'AvailabilityZoneFilter: (start: 1, end: 1)', 'RamFilter: (start: 1, end: 1)', 'ComputeFilter: (start: 1, end: 1)', 'ComputeCapabilitiesFilter: (start: 1, end: 1)', 'ImagePropertiesFilter: (start: 1, end: 1)', 'ServerGroupAntiAffinityFilter: (start: 1, end: 1)', 'ServerGroupAffinityFilter: (start: 1, end: 1)', 'PciPassthroughFilter: (start: 1, end: 1)', 'NUMATopologyFilter: (start: 1, end: 0)']
-----Original Message-----
From: <email address hidden> [mailto:<email address hidden>] On Behalf Of Nikola Ðipanov
Sent: Thursday, November 26, 2015 11:04 AM
To: Serguei Bezverkhi (sbezverk) <email address hidden>
Subject: [Bug 1519878] Re: numatopology filter incorrectly returns no resources
Hey so I was not able to reproduce this - the Nova pinning logic seems to pass this (I was testing it with 12.0.0 tag checked out) see the attached patch.
Are you sure that it's the NUMA topology filter that was failing. It might be best to turn on debug logging in the scheduler and make sure that it's the NUMATopologyFilter that is returning 0 hosts
Title:
numatopology filter incorrectly returns no resources
Status in OpenStack Compute (nova):
Incomplete
Bug description:
When launching a new instance, in some cases NUmaTopology Filter does
not return available compute nodes, but according to the content of
numa_topology in compute_nodes tables, there are sufficient resources
to satisfy requirements.
I started three instances, attached log show changes in numa_topology,
when I try to start 4th instance which is requesting 4vCPU and
according to numa_topology I have left 8 vCPU, NumaTopology filter
incorrectly returns 0 hosts. If I delete existing instances, I can
launch failed one without any modification.
Chck out this log, it clearly states that the issue is Numa topology requirments.
2015-11-26 10:08:39.604 2899 DEBUG nova.scheduler. filters. numa_topology_ filter [req-9688c526- 0f54-43f3- ba1a-7fe1d1bc63 d4 d525cf27fd9c478 2a20363f65bed97 95 f77fb93ac01c488 f8cfd1eb4ebe7c2 f0 - - -] sbezverk- osp-4.sbezverk. cisco.com, sbezverk- osp-4.sbezverk. cisco.com fails NUMA topologyrequire ments. The instance does not fit on this host. host_passes /usr/lib/ python2. 7/site- packages/ nova/scheduler/ filters/ numa_topology_ filter. py:48
2015-11-26 10:08:39.605 2899 INFO nova.filters [req-9688c526- 0f54-43f3- ba1a-7fe1d1bc63 d4 d525cf27fd9c478 2a20363f65bed97 95 f77fb93ac01c488 f8cfd1eb4ebe7c2 f0 - - -] Filter NUMATopologyFilter returned 0 hosts 0f54-43f3- ba1a-7fe1d1bc63 d4 d525cf27fd9c478 2a20363f65bed97 95 f77fb93ac01c488 f8cfd1eb4ebe7c2 f0 - - -] Filtering removed all hosts for the request with reservation ID 'r-tfsr0m79' and instance ID 'd4643825- 0893-45b9- 904d-b5a6bbd1ec 30'. Filter results: [('RetryFilter', [(u'sbezverk- osp-4.sbezverk. cisco.com' , u'sbezverk- osp-4.sbezverk. cisco.com' )]), ('AvailabilityZ oneFilter' , [(u'sbezverk- osp-4.sbezverk. cisco.com' , u'sbezverk- osp-4.sbezverk. cisco.com' )]), ('RamFilter', [(u'sbezverk- osp-4.sbezverk. cisco.com' , u'sbezverk- osp-4.sbezverk. cisco.com' )]), ('ComputeFilter', [(u'sbezverk- osp-4.sbezverk. cisco.com' , u'sbezverk- osp-4.sbezverk. cisco.com' )]), ('ComputeCapabi litiesFilter' , [(u'sbezverk- osp-4.sbezverk. cisco.com' , u'sbezverk- osp-4.sbezverk. cisco.com' )]), ('ImageProperti esFilter' , [(u'sbezverk- osp-4.sbezverk. cisco.com' , u'sbezverk- osp-4.sbezverk. cisco.com' )]), ('ServerGroupAn tiAffinityFilte r', [(u'sbezverk- osp-4.sbezverk. cisco.com' , u'sbezverk- osp-4.sbezverk. cisco.com' )]), ('ServerGroupAf finityFilter' , [(u'sbezverk- osp-4.sbezverk. cisco.com' , u'sbezverk- osp-4.sbezverk. cisco.com' )]), ('PciPassthroug hFilter' , [(u'sbezverk- osp-4.sbezverk. cisco.com' , u'sbezverk- osp-4.sbezverk. cisco.com' )]), ('NUMATopologyF ilter', None)] get_filtered_ objects /usr/lib/ python2. 7/site- packages/ nova/filters. py:122 0f54-43f3- ba1a-7fe1d1bc63 d4 d525cf27fd9c478 2a20363f65bed97 95 f77fb93ac01c488 f8cfd1eb4ebe7c2 f0 - - -] Filtering removed all hosts for the request with reservation ID 'r-tfsr0m79' and instance ID 'd4643825- 0893-45b9- 904d-b5a6bbd1ec 30'. Filter results: ['RetryFilter: (start: 1, end: 1)', 'AvailabilityZo neFilter: (start: 1, end: 1)', 'RamFilter: (start: 1, end: 1)', 'ComputeFilter: (start: 1, end: 1)', 'ComputeCapabil itiesFilter: (start: 1, end: 1)', 'ImagePropertie sFilter: (start: 1, end: 1)', 'ServerGroupAnt iAffinityFilter : (start: 1, end: 1)', 'ServerGroupAff inityFilter: (start: 1, end: 1)', 'PciPassthrough Filter: (start: 1, end: 1)', 'NUMATopologyFi lter: (start: 1, end: 0)']
2015-11-26 10:08:39.605 2899 DEBUG nova.filters [req-9688c526-
2015-11-26 10:08:39.605 2899 INFO nova.filters [req-9688c526-
-----Original Message-----
From: <email address hidden> [mailto:<email address hidden>] On Behalf Of Nikola Ðipanov
Sent: Thursday, November 26, 2015 11:04 AM
To: Serguei Bezverkhi (sbezverk) <email address hidden>
Subject: [Bug 1519878] Re: numatopology filter incorrectly returns no resources
Hey so I was not able to reproduce this - the Nova pinning logic seems to pass this (I was testing it with 12.0.0 tag checked out) see the attached patch.
Are you sure that it's the NUMA topology filter that was failing. It might be best to turn on debug logging in the scheduler and make sure that it's the NUMATopologyFilter that is returning 0 hosts
-- /bugs.launchpad .net/bugs/ 1519878
You received this bug notification because you are subscribed to the bug report.
https:/
Title:
numatopology filter incorrectly returns no resources
Status in OpenStack Compute (nova):
Incomplete
Bug description:
When launching a new instance, in some cases NUmaTopology Filter does
not return available compute nodes, but according to the content of
numa_topology in compute_nodes tables, there are sufficient resources
to satisfy requirements.
I started three instances, attached log show changes in numa_topology,
when I try to start 4th instance which is requesting 4vCPU and
according to numa_topology I have left 8 vCPU, NumaTopology filter
incorrectly returns 0 hosts. If I delete existing instances, I can
launch failed one without any modification.
rpm -qa | grep nova nova-conductor- 12.0.0- 1.el7.noarch novaclient- 2.30.1- 1.el7.noarch nova-console- 12.0.0- 1.el7.noarch nova-common- 12.0.0- 1.el7.noarch nova-scheduler- 12.0.0- 1.el7.noarch nova-compute- 12.0.0- 1.el7.noarch nova-12. 0.0-1.el7. noarch nova-novncproxy -12.0.0- 1.el7.noarch nova-api- 12.0.0- 1.el7.noarch nova-cert- 12.0.0- 1.el7.noarch
openstack-
python-
openstack-
openstack-
openstack-
openstack-
python-
openstack-
openstack-
openstack-
To manage notifications about this bug go to: /bugs.launchpad .net/nova/ +bug/1519878/ +subscriptions
https:/