SchedulerHostFilterNotFound: Scheduler Host Filter AvailabilityZoneFilter, CapacityFilter, CapabilitiesFilter could not be found.

Bug #1126378 reported by James Page
40
This bug affects 9 people
Affects Status Importance Assigned to Milestone
Cinder
Invalid
High
Unassigned
cinder (Ubuntu)
Fix Released
High
James Page
Raring
Fix Released
High
James Page
rtslib (Ubuntu)
Fix Released
High
Unassigned
Raring
Fix Released
High
Unassigned

Bug Description

Scheduler fails to create volumes resulting in 'error':

2013-02-15 11:11:36 WARNING cinder.scheduler.host_manager [req-e125a9b4-5b04-4ad8-aad5-fdcc1c9523e7 c8cbbfa7ec5849d0896b1ce4d479e27e 81b7c70adebc456196a9d0e2abb9ffe5] service is down or disabled.
2013-02-15 11:11:36 WARNING cinder.scheduler.host_manager [req-e125a9b4-5b04-4ad8-aad5-fdcc1c9523e7 c8cbbfa7ec5849d0896b1ce4d479e27e 81b7c70adebc456196a9d0e2abb9ffe5] service is down or disabled.
2013-02-15 11:11:36 WARNING cinder.scheduler.manager [req-e125a9b4-5b04-4ad8-aad5-fdcc1c9523e7 c8cbbfa7ec5849d0896b1ce4d479e27e 81b7c70adebc456196a9d0e2abb9ffe5] Failed to schedule_create_volume: Scheduler Host Filter AvailabilityZoneFilter, CapacityFilter, CapabilitiesFilter could not be found.
2013-02-15 11:11:36 12992 ERROR cinder.openstack.common.rpc.amqp [-] Exception during message handling
2013-02-15 11:11:36 12992 TRACE cinder.openstack.common.rpc.amqp Traceback (most recent call last):
2013-02-15 11:11:36 12992 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/rpc/amqp.py", line 276, in _process_data
2013-02-15 11:11:36 12992 TRACE cinder.openstack.common.rpc.amqp rval = self.proxy.dispatch(ctxt, version, method, **args)
2013-02-15 11:11:36 12992 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/rpc/dispatcher.py", line 145, in dispatch
2013-02-15 11:11:36 12992 TRACE cinder.openstack.common.rpc.amqp return getattr(proxyobj, method)(ctxt, **kwargs)
2013-02-15 11:11:36 12992 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/scheduler/manager.py", line 114, in create_volume
2013-02-15 11:11:36 12992 TRACE cinder.openstack.common.rpc.amqp context, ex, request_spec)
2013-02-15 11:11:36 12992 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
2013-02-15 11:11:36 12992 TRACE cinder.openstack.common.rpc.amqp self.gen.next()
2013-02-15 11:11:36 12992 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/scheduler/manager.py", line 103, in create_volume
2013-02-15 11:11:36 12992 TRACE cinder.openstack.common.rpc.amqp filter_properties)
2013-02-15 11:11:36 12992 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/scheduler/filter_scheduler.py", line 66, in schedule_create_volume
2013-02-15 11:11:36 12992 TRACE cinder.openstack.common.rpc.amqp filter_properties)
2013-02-15 11:11:36 12992 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/scheduler/filter_scheduler.py", line 118, in _schedule
2013-02-15 11:11:36 12992 TRACE cinder.openstack.common.rpc.amqp filter_properties)
2013-02-15 11:11:36 12992 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/scheduler/host_manager.py", line 217, in get_filtered_hosts
2013-02-15 11:11:36 12992 TRACE cinder.openstack.common.rpc.amqp filter_classes = self._choose_host_filters(filter_class_names)
2013-02-15 11:11:36 12992 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/scheduler/host_manager.py", line 184, in _choose_host_filters
2013-02-15 11:11:36 12992 TRACE cinder.openstack.common.rpc.amqp raise exception.SchedulerHostFilterNotFound(filter_name=msg)
2013-02-15 11:11:36 12992 TRACE cinder.openstack.common.rpc.amqp SchedulerHostFilterNotFound: Scheduler Host Filter AvailabilityZoneFilter, CapacityFilter, CapabilitiesFilter could not be found.
2013-02-15 11:11:36 12992 TRACE cinder.openstack.common.rpc.amqp

I think this is probably fixed in master branch for grizzly; will check

ProblemType: Bug
DistroRelease: Ubuntu 13.04
Package: cinder-scheduler 2013.1~g2-0ubuntu2
ProcVersionSignature: Ubuntu 3.8.0-6.13-generic 3.8.0-rc7
Uname: Linux 3.8.0-6-generic x86_64
ApportVersion: 2.8-0ubuntu4
Architecture: amd64
Date: Fri Feb 15 11:12:16 2013
MarkForUpload: True
PackageArchitecture: all
SourcePackage: cinder
UpgradeStatus: No upgrade log present (probably fresh install)

Revision history for this message
James Page (james-page) wrote :
Revision history for this message
James Page (james-page) wrote :

Fixed in trunk.

Changed in cinder (Ubuntu Raring):
status: New → Fix Committed
importance: Undecided → High
Revision history for this message
James Page (james-page) wrote :

OK - so not fixed in trunk anymore

Changed in cinder (Ubuntu Raring):
status: Fix Committed → Triaged
Revision history for this message
James Page (james-page) wrote :

Found in latest cinder testing packages from the Grizzly trunk testing PPA.

Revision history for this message
John Griffith (john-griffith) wrote :

I believe this will be addressed by: https://review.openstack.org/#/c/22195/

Revision history for this message
James Page (james-page) wrote :

Really? I see this issue in deployed cinder, not during testing.

Revision history for this message
Andreas Hasenack (ahasenack) wrote :

I also have this problem in my deployment. cinder packages are at 2013.1~g2-0ubuntu2~cloud0

Revision history for this message
James Page (james-page) wrote :

Still see the same issue with g3 as well

Revision history for this message
John Griffith (john-griffith) wrote :

Hi James,

Can you share your cinder.conf? I can't seem to reproduce this still although I'm using source not packages.

Revision history for this message
James Page (james-page) wrote :

John

Cinder conf as requested.

[DEFAULT]
rootwrap_config = /etc/cinder/rootwrap.conf
api_paste_confg = /etc/cinder/api-paste.ini
iscsi_helper = tgtadm
volume_name_template = volume-%s
volume_group = cinder-volumes
verbose = True
auth_strategy = keystone
state_path = /var/lib/cinder
volumes_dir = /var/lib/cinder/volumes
osapi_volume_listen_port = 8766
volume_driver = cinder.volume.driver.RBDDriver
rbd_pool = cinder
rabbit_host = <redacted>
rabbit_userid = cinder
rabbit_password = <redacted>
rabbit_virtual_host = cinder
sql_connection = mysql://<redacted>/cinder

Revision history for this message
James Page (james-page) wrote :

OK - so got to the bottom of this on irc with John.

Stevedore fails to load the filter/weight extensions due to broken requires.

1) Babel

not a dependency of the package - should it be?

2) rtslib

Package is broken and provides no PKG-INFO so pkg_resources has no idea.

The source package is generated from upstream git - maybe using published tarballs on pypi would be better.

Changed in cinder:
status: New → Confirmed
status: Confirmed → Triaged
importance: Undecided → High
milestone: none → grizzly-rc1
James Page (james-page)
Changed in rtslib (Ubuntu Raring):
importance: Undecided → High
status: New → Triaged
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package rtslib - 2.1.fb27-0ubuntu2

---------------
rtslib (2.1.fb27-0ubuntu2) raring; urgency=low

  * Fix package build so that it ships egginfo (LP: #1126378):
    - d/rules: Use more of dh_python2 automagic.
    - d/python-rtslib.dirs: Don't create pyshared dir.
     -d/python-rtslib.install: Dropped - handled by dh_python2.
  * d/control: Dropped python-netaddr, python-ipaddr, python-configobj
    and python-simpleparse as no longer needed.
  * d/watch: Added watch on pypi.python.org for release tarballs.
  * d/python-rtslib.dirs: Create /var/lib/target/fabric not
    /var/target/fabric inline with code.
  * d/control,copyright: Updated to point to free-branch upstream.
 -- James Page <email address hidden> Wed, 27 Feb 2013 09:50:43 +0000

Changed in rtslib (Ubuntu Raring):
status: Triaged → Fix Released
Revision history for this message
Sean Dague (sdague) wrote :

I get this on a blank ubuntu 12.10 trying to run devstack + tempest out of the box

Revision history for this message
Sean Dague (sdague) wrote :

This is 100% reproducable for me on Ubuntu 12.10.

Start from a blank environment.

git clone devstack
cd devstack
./stack.sh

cd /opt/stack/tempest
./run_tests.sh tempest/tests/compute/volumes/test_volumes_list.py

James Page (james-page)
Changed in cinder (Ubuntu Raring):
status: Triaged → Fix Committed
assignee: nobody → James Page (james-page)
Revision history for this message
John Griffith (john-griffith) wrote :

So this specific issue was due to the fact that there were some issues with the packages which has now been fixed (Precise, Quantal and Raring).

A new bug has been opened to address the fact that any failure in dependencies list will result in this generic message from the cinder scheduler with no real good explanation or detail of what the real problem is.

https://bugs.launchpad.net/cinder/+bug/1131322

Changed in cinder:
status: Triaged → Invalid
Thierry Carrez (ttx)
Changed in cinder:
milestone: grizzly-rc1 → none
James Page (james-page)
Changed in cinder (Ubuntu Raring):
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.