Simple scheduler with cephfs backend throws a stacktrace

Bug #2049528 reported by Kris Lindgren
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Shared File Systems Service (Manila)
Triaged
Medium
Goutham Pacha Ravi

Bug Description

Under 2023.1 when using the simple scheduler, with a single cephfs native backend configured, scheduling fails with a stack trace.

2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message)
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args)
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args)
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib64/python3.9/site-packages/manila/scheduler/manager.py", line 131, in create_share_instance
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server self._set_share_state_and_notify(
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_utils/excutils.py", line 227, in __exit__
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server self.force_reraise()
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server raise self.value
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib64/python3.9/site-packages/manila/scheduler/manager.py", line 122, in create_share_instance
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server self.driver.schedule_create_share(context, request_spec,
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib64/python3.9/site-packages/manila/scheduler/drivers/simple.py", line 56, in schedule_create_share
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server results = db.service_get_all_share_sorted(elevated)
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib64/python3.9/site-packages/manila/db/api.py", line 114, in service_get_all_share_sorted
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server return IMPL.service_get_all_share_sorted(context)
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib64/python3.9/site-packages/manila/db/sqlalchemy/api.py", line 154, in wrapper
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server return f(*args, **kwargs)
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 1022, in wrapper
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server return fn(*args, **kwargs)
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib64/python3.9/site-packages/manila/db/sqlalchemy/api.py", line 618, in service_get_all_share_sorted
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server return _service_get_all_topic_subquery(
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib64/python3.9/site-packages/manila/db/sqlalchemy/api.py", line 154, in wrapper
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server return f(*args, **kwargs)
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib64/python3.9/site-packages/manila/db/sqlalchemy/api.py", line 584, in _service_get_all_topic_subquery
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server model_query(
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib64/python3.9/site-packages/sqlalchemy/orm/query.py", line 1806, in filter_by
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server clauses = [
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib64/python3.9/site-packages/sqlalchemy/orm/query.py", line 1807, in <listcomp>
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server _entity_namespace_key(from_entity, key) == value
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib64/python3.9/site-packages/sqlalchemy/sql/base.py", line 1696, in _entity_namespace_key
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server util.raise_(
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib64/python3.9/site-packages/sqlalchemy/util/compat.py", line 208, in raise_
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server raise exception
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server sqlalchemy.exc.InvalidRequestError: Entity namespace for "coalesce(anon_1.share_gigabytes, :coalesce_1)" has no property "topic"
2024-01-12 20:59:38.489 7 ERROR oslo_messaging.rpc.server

Looks like the 'results = db.service_get_all_share_sorted(elevated)' call in the simple scheduler is broken.

Revision history for this message
Vida Haririan (vhariria) wrote (last edit ):

Is this issue reproducible? if so please provide recreate steps and logs if available

tags: added: cephfs scheduler
Changed in manila:
status: New → Triaged
Revision history for this message
Vida Haririan (vhariria) wrote :
Changed in manila:
importance: Undecided → Medium
assignee: nobody → Goutham Pacha Ravi (gouthamr)
milestone: none → caracal-rc1
Changed in manila:
milestone: caracal-rc1 → dalmation-1
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.