I think this is a bug ===================== (masakari-engine)[masakari@controller1 masakari]$ cat masakari-engine.log 2021-04-13 04:21:14.382 7 INFO masakari.engine.driver [-] Loading masakari notification driver 'taskflow_driver' 2021-04-13 04:21:15.529 7 INFO masakari.service [-] Starting ha_engine (version 10.0.2) 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task [req-7a61257c-c0cf-488e-9db1-b5b357859267 - - - - -] Error during MasakariManager._process_unfinished_notifications: oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (1047, 'WSREP has not yet prepared node for application use') [SQL: SELECT notifications.deleted_at AS notifications_deleted_at, notifications.deleted AS notifications_deleted, notifications.created_at AS notifications_created_at, notifications.updated_at AS notifications_updated_at, notifications.id AS notifications_id, notifications.notification_uuid AS notifications_notification_uuid, notifications.generated_time AS notifications_generated_time, notifications.type AS notifications_type, notifications.payload AS notifications_payload, notifications.status AS notifications_status, notifications.source_host_uuid AS notifications_source_host_uuid FROM notifications WHERE notifications.deleted = %(deleted_1)s AND notifications.status IN (%(status_1)s, %(status_2)s) ORDER BY notifications.created_at DESC, notifications.id DESC] [parameters: {'deleted_1': 0, 'status_1': 'error', 'status_2': 'new'}] (Background on this error at: http://sqlalche.me/e/13/e3q8) 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task Traceback (most recent call last): 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task self.dialect.do_execute( 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 593, in do_execute 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task cursor.execute(statement, parameters) 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/pymysql/cursors.py", line 163, in execute 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task result = self._query(query) 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/pymysql/cursors.py", line 321, in _query 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task conn.query(q) 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/pymysql/connections.py", line 505, in query 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task self._affected_rows = self._read_query_result(unbuffered=unbuffered) 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/pymysql/connections.py", line 724, in _read_query_result 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task result.read() 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/pymysql/connections.py", line 1069, in read 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task first_packet = self.connection._read_packet() 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/pymysql/connections.py", line 676, in _read_packet 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task packet.raise_for_error() 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/pymysql/protocol.py", line 223, in raise_for_error 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task err.raise_mysql_exception(self._data) 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/pymysql/err.py", line 107, in raise_mysql_exception 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task raise errorclass(errno, errval) 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task pymysql.err.OperationalError: (1047, 'WSREP has not yet prepared node for application use') 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task The above exception was the direct cause of the following exception: 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task Traceback (most recent call last): 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task task(self, context) 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/masakari/engine/manager.py", line 340, in _process_unfinished_notifications 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task notifications_list = objects.NotificationList.get_all(context, 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/oslo_versionedobjects/base.py", line 184, in wrapper 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task result = fn(cls, context, *args, **kwargs) 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/masakari/objects/notification.py", line 153, in get_all 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task groups = db.notifications_get_all_by_filters(context, filters=filters, 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/masakari/db/api.py", line 293, in notifications_get_all_by_filters 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task return IMPL.notifications_get_all_by_filters(context, filters=filters, 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/oslo_db/api.py", line 154, in wrapper 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task ectxt.value = e.inner_exc 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task self.force_reraise() 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task six.reraise(self.type_, self.value, self.tb) 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task raise value 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/oslo_db/api.py", line 142, in wrapper 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task return f(*args, **kwargs) 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 1014, in wrapper 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task return fn(*args, **kwargs) 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/masakari/db/sqlalchemy/api.py", line 548, in notifications_get_all_by_filters 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task return query.all() 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 3346, in all 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task return list(self) 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 3508, in __iter__ 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task return self._execute_and_instances(context) 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 3533, in _execute_and_instances 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task result = conn.execute(querycontext.statement, self._params) 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1011, in execute 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task return meth(self, multiparams, params) 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task return connection._execute_clauseelement(self, multiparams, params) 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task ret = self._execute_context( 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task self._handle_dbapi_exception( 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1508, in _handle_dbapi_exception 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task util.raise_(newraise, with_traceback=exc_info[2], from_=e) 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task raise exception 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task self.dialect.do_execute( 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 593, in do_execute 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task cursor.execute(statement, parameters) 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/pymysql/cursors.py", line 163, in execute 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task result = self._query(query) 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/pymysql/cursors.py", line 321, in _query 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task conn.query(q) 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/pymysql/connections.py", line 505, in query 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task self._affected_rows = self._read_query_result(unbuffered=unbuffered) 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/pymysql/connections.py", line 724, in _read_query_result 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task result.read() 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/pymysql/connections.py", line 1069, in read 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task first_packet = self.connection._read_packet() 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/pymysql/connections.py", line 676, in _read_packet 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task packet.raise_for_error() 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/pymysql/protocol.py", line 223, in raise_for_error 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task err.raise_mysql_exception(self._data) 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task File "/var/lib/kolla/venv/lib/python3.8/site-packages/pymysql/err.py", line 107, in raise_mysql_exception 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task raise errorclass(errno, errval) 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (1047, 'WSREP has not yet prepared node for application use') 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task [SQL: SELECT notifications.deleted_at AS notifications_deleted_at, notifications.deleted AS notifications_deleted, notifications.created_at AS notifications_created_at, notifications.updated_at AS notifications_updated_at, notifications.id AS notifications_id, notifications.notification_uuid AS notifications_notification_uuid, notifications.generated_time AS notifications_generated_time, notifications.type AS notifications_type, notifications.payload AS notifications_payload, notifications.status AS notifications_status, notifications.source_host_uuid AS notifications_source_host_uuid 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task FROM notifications 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task WHERE notifications.deleted = %(deleted_1)s AND notifications.status IN (%(status_1)s, %(status_2)s) ORDER BY notifications.created_at DESC, notifications.id DESC] 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task [parameters: {'deleted_1': 0, 'status_1': 'error', 'status_2': 'new'}] 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task (Background on this error at: http://sqlalche.me/e/13/e3q8) 2021-04-13 04:43:29.921 7 ERROR oslo_service.periodic_task 2021-04-13 13:01:04.331 7 INFO masakari.engine.manager [req-c9475abf-a2d9-4848-ae8a-585d53f311d7 4da9d36116764624bb6a73dca7af78d8 27c00acc6f51451b8eecadfbb0db4588 - - -] Processing notification c681a7ad-1d51-41ef-a765-5568c5769b0a of type: VM 2021-04-13 13:01:04.830 7 INFO masakari.compute.nova [req-7ce91898-e0e5-4802-be83-ea28872899b0 nova - - - -] Call get server command for instance 85bf585b-e674-43ae-bd29-5d13b74d3b03 2021-04-13 13:01:07.376 7 INFO masakari.compute.nova [req-06e4312c-75f3-4eb9-8538-351d43922ecf nova - - - -] Call stop server command for instance 85bf585b-e674-43ae-bd29-5d13b74d3b03 2021-04-13 13:01:11.383 7 INFO masakari.compute.nova [req-556f5492-7969-47b0-81e3-ead6e2f1f4c4 nova - - - -] Call get server command for instance 85bf585b-e674-43ae-bd29-5d13b74d3b03 2021-04-13 13:01:13.074 7 INFO masakari.compute.nova [req-01f53cb5-c435-4c08-8fea-d37dac167741 nova - - - -] Call get server command for instance 85bf585b-e674-43ae-bd29-5d13b74d3b03 2021-04-13 13:01:15.349 7 INFO masakari.compute.nova [req-0a92c212-161c-4cca-8aa2-ae048365bac3 nova - - - -] Call start server command for instance 85bf585b-e674-43ae-bd29-5d13b74d3b03 2021-04-13 13:01:16.510 7 INFO masakari.compute.nova [req-1f086249-2ce6-484f-a3a7-4a1117fe2354 nova - - - -] Call get server command for instance 85bf585b-e674-43ae-bd29-5d13b74d3b03 2021-04-13 13:01:19.045 7 WARNING oslo.service.loopingcall [req-1f086249-2ce6-484f-a3a7-4a1117fe2354 nova - - - -] Function 'masakari.engine.drivers.taskflow.instance_failure.ConfirmInstanceActiveTask.execute.._wait_for_active' run outlasted interval by 1.54 sec 2021-04-13 13:01:19.051 7 INFO masakari.compute.nova [req-5755e718-a333-4d4e-ac20-cc65f5533900 nova - - - -] Call get server command for instance 85bf585b-e674-43ae-bd29-5d13b74d3b03 2021-04-13 13:01:25.114 7 INFO masakari.engine.manager [req-0a92c212-161c-4cca-8aa2-ae048365bac3 nova - - - -] Notification c681a7ad-1d51-41ef-a765-5568c5769b0a exits with status: finished. 2021-04-13 13:02:45.243 7 ERROR masakari.engine.manager [req-013bd0f2-cd80-46a6-a14b-18d6611d0638 d6e378d53609401fbe1cd85092d50627 4716aeefe53d42a4b5e54c2fe75f5196 - - -] Failed to fetch notification recovery workflow details for c681a7ad-1d51-41ef-a765-5568c5769b0a: TypeError: 'NoneType' object is not subscriptable 2021-04-13 13:02:45.243 7 ERROR masakari.engine.manager Traceback (most recent call last): 2021-04-13 13:02:45.243 7 ERROR masakari.engine.manager File "/var/lib/kolla/venv/lib/python3.8/site-packages/masakari/engine/manager.py", line 408, in get_notification_recovery_workflow_details 2021-04-13 13:02:45.243 7 ERROR masakari.engine.manager self.driver.get_notification_recovery_workflow_details( 2021-04-13 13:02:45.243 7 ERROR masakari.engine.manager File "/var/lib/kolla/venv/lib/python3.8/site-packages/masakari/engine/drivers/taskflow/driver.py", line 275, in get_notification_recovery_workflow_details 2021-04-13 13:02:45.243 7 ERROR masakari.engine.manager backend = backends.fetch(PERSISTENCE_BACKEND) 2021-04-13 13:02:45.243 7 ERROR masakari.engine.manager File "/var/lib/kolla/venv/lib/python3.8/site-packages/taskflow/persistence/backends/__init__.py", line 53, in fetch 2021-04-13 13:02:45.243 7 ERROR masakari.engine.manager backend, conf = misc.extract_driver_and_conf(conf, 'connection') 2021-04-13 13:02:45.243 7 ERROR masakari.engine.manager File "/var/lib/kolla/venv/lib/python3.8/site-packages/taskflow/utils/misc.py", line 123, in extract_driver_and_conf 2021-04-13 13:02:45.243 7 ERROR masakari.engine.manager maybe_uri = conf[conf_key] 2021-04-13 13:02:45.243 7 ERROR masakari.engine.manager TypeError: 'NoneType' object is not subscriptable 2021-04-13 13:02:45.243 7 ERROR masakari.engine.manager 2021-04-13 13:02:45.246 7 ERROR oslo_messaging.rpc.server [req-013bd0f2-cd80-46a6-a14b-18d6611d0638 d6e378d53609401fbe1cd85092d50627 4716aeefe53d42a4b5e54c2fe75f5196 - - -] Exception during message handling: masakari.exception.MasakariException: Failed to fetch notification recovery workflow details for c681a7ad-1d51-41ef-a765-5568c5769b0a 2021-04-13 13:02:45.246 7 ERROR oslo_messaging.rpc.server Traceback (most recent call last): 2021-04-13 13:02:45.246 7 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.8/site-packages/masakari/engine/manager.py", line 408, in get_notification_recovery_workflow_details 2021-04-13 13:02:45.246 7 ERROR oslo_messaging.rpc.server self.driver.get_notification_recovery_workflow_details( 2021-04-13 13:02:45.246 7 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.8/site-packages/masakari/engine/drivers/taskflow/driver.py", line 275, in get_notification_recovery_workflow_details 2021-04-13 13:02:45.246 7 ERROR oslo_messaging.rpc.server backend = backends.fetch(PERSISTENCE_BACKEND) 2021-04-13 13:02:45.246 7 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.8/site-packages/taskflow/persistence/backends/__init__.py", line 53, in fetch 2021-04-13 13:02:45.246 7 ERROR oslo_messaging.rpc.server backend, conf = misc.extract_driver_and_conf(conf, 'connection') 2021-04-13 13:02:45.246 7 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.8/site-packages/taskflow/utils/misc.py", line 123, in extract_driver_and_conf 2021-04-13 13:02:45.246 7 ERROR oslo_messaging.rpc.server maybe_uri = conf[conf_key] 2021-04-13 13:02:45.246 7 ERROR oslo_messaging.rpc.server TypeError: 'NoneType' object is not subscriptable 2021-04-13 13:02:45.246 7 ERROR oslo_messaging.rpc.server 2021-04-13 13:02:45.246 7 ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: 2021-04-13 13:02:45.246 7 ERROR oslo_messaging.rpc.server 2021-04-13 13:02:45.246 7 ERROR oslo_messaging.rpc.server Traceback (most recent call last): 2021-04-13 13:02:45.246 7 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.8/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming 2021-04-13 13:02:45.246 7 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) 2021-04-13 13:02:45.246 7 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.8/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch 2021-04-13 13:02:45.246 7 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) 2021-04-13 13:02:45.246 7 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.8/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch 2021-04-13 13:02:45.246 7 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) 2021-04-13 13:02:45.246 7 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.8/site-packages/masakari/engine/manager.py", line 415, in get_notification_recovery_workflow_details 2021-04-13 13:02:45.246 7 ERROR oslo_messaging.rpc.server raise exception.MasakariException(msg) 2021-04-13 13:02:45.246 7 ERROR oslo_messaging.rpc.server masakari.exception.MasakariException: Failed to fetch notification recovery workflow details for c681a7ad-1d51-41ef-a765-5568c5769b0a 2021-04-13 13:02:45.246 7 ERROR oslo_messaging.rpc.server