Cannot issue "openstack notification show <uuid>"

[Liam Young]

Issuing "openstack notification show <uuid>" results in:

$ openstack notification show 6f7a9f29-7f7b-4179-a433-6f14f16ca389
No Notification found for 6f7a9f29-7f7b-4179-a433-6f14f16ca389: Server Error for url: http://10.0.5.29:15868/v1/16837944f905444b9d9b26c1f06a221e/notifications/6f7a9f29-7f7b-4179-a433-6f14f16ca389, Unexpected API Error. Please report this at https://bugs.launchpad.net/masakari/ and attach the Masakari API log if possible.
<class 'masakari.exception_Remote.MasakariException_Remote'

and in the engine log:

2020-06-04 08:50:48.997 482700 DEBUG masakari.context [req-3aa6b333-c266-4039-aaa7-205dc39f7d4f 5c685854510342ac92f7539e7fb578ce 16837944f905444b9d9b26c1f06a221e - - -] Arguments dropped when creating context: {'system_scope': None, 'project': '16837944f905444b9d9b26c1f06a221e', 'client_timeout': None} __init__ /usr/lib/python3/dist-packages/masakari/context.py:113
2020-06-04 08:50:49.020 482700 ERROR masakari.engine.manager [req-3aa6b333-c266-4039-aaa7-205dc39f7d4f 5c685854510342ac92f7539e7fb578ce 16837944f905444b9d9b26c1f06a221e - - -] Failed to fetch notification recovery workflow details for 6f7a9f29-7f7b-4179-a433-6f14f16ca389: TypeError: 'NoneType' object is not subscriptable
2020-06-04 08:50:49.020 482700 ERROR masakari.engine.manager Traceback (most recent call last):
2020-06-04 08:50:49.020 482700 ERROR masakari.engine.manager File "/usr/lib/python3/dist-packages/masakari/engine/manager.py", line 371, in get_notification_recovery_workflow_details
2020-06-04 08:50:49.020 482700 ERROR masakari.engine.manager context, recovery_method, notification))
2020-06-04 08:50:49.020 482700 ERROR masakari.engine.manager File "/usr/lib/python3/dist-packages/masakari/engine/drivers/taskflow/driver.py", line 275, in get_notification_recovery_workflow_details
2020-06-04 08:50:49.020 482700 ERROR masakari.engine.manager backend = backends.fetch(PERSISTENCE_BACKEND)
2020-06-04 08:50:49.020 482700 ERROR masakari.engine.manager File "/usr/lib/python3/dist-packages/taskflow/persistence/backends/__init__.py", line 53, in fetch
2020-06-04 08:50:49.020 482700 ERROR masakari.engine.manager backend, conf = misc.extract_driver_and_conf(conf, 'connection')
2020-06-04 08:50:49.020 482700 ERROR masakari.engine.manager File "/usr/lib/python3/dist-packages/taskflow/utils/misc.py", line 124, in extract_driver_and_conf
2020-06-04 08:50:49.020 482700 ERROR masakari.engine.manager maybe_uri = conf[conf_key]
2020-06-04 08:50:49.020 482700 ERROR masakari.engine.manager TypeError: 'NoneType' object is not subscriptable
2020-06-04 08:50:49.020 482700 ERROR masakari.engine.manager
2020-06-04 08:50:49.023 482700 ERROR oslo_messaging.rpc.server [req-3aa6b333-c266-4039-aaa7-205dc39f7d4f 5c685854510342ac92f7539e7fb578ce 16837944f905444b9d9b26c1f06a221e - - -] Exception during message handling: masakari.exception.MasakariException: Failed to fetch notification recovery workflow details for 6f7a9f29-7f7b-4179-a433-6f14f16ca389
2020-06-04 08:50:49.023 482700 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2020-06-04 08:50:49.023 482700 ERROR oslo_messaging.rpc.server File "/usr/lib/python3/dist-packages/masakari/engine/manager.py", line 371, in get_notification_recovery_workflow_details
2020-06-04 08:50:49.023 482700 ERROR oslo_messaging.rpc.server context, recovery_method, notification))
2020-06-04 08:50:49.023 482700 ERROR oslo_messaging.rpc.server File "/usr/lib/python3/dist-packages/masakari/engine/drivers/taskflow/driver.py", line 275, in get_notification_recovery_workflow_details
2020-06-04 08:50:49.023 482700 ERROR oslo_messaging.rpc.server backend = backends.fetch(PERSISTENCE_BACKEND)
2020-06-04 08:50:49.023 482700 ERROR oslo_messaging.rpc.server File "/usr/lib/python3/dist-packages/taskflow/persistence/backends/__init__.py", line 53, in fetch
2020-06-04 08:50:49.023 482700 ERROR oslo_messaging.rpc.server backend, conf = misc.extract_driver_and_conf(conf, 'connection')
2020-06-04 08:50:49.023 482700 ERROR oslo_messaging.rpc.server File "/usr/lib/python3/dist-packages/taskflow/utils/misc.py", line 124, in extract_driver_and_conf
2020-06-04 08:50:49.023 482700 ERROR oslo_messaging.rpc.server maybe_uri = conf[conf_key]

[Liam Young (gnuoy)]

This appears to be down to the 'taskflow' section missing from the masakari config file *1. This was introduced in stein *2

*1 https://docs.openstack.org/masakari/latest/configuration/sample_config.html
*2 https://docs.openstack.org/releasenotes/masakari/stein.html#new-features

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/734450

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/734450
Committed: https://git.openstack.org/cgit/openstack/charm-masakari/commit/?id=f051c76cf3971b08bd561b5256812fe09d45d14b
Submitter: Zuul
Branch: master

commit f051c76cf3971b08bd561b5256812fe09d45d14b
Author: Liam Young <email address hidden>
Date: Tue Jun 9 08:48:39 2020 +0000

    Add missing taskflow section

    The 'taskflow' section was missing from the masakari config file *1.
    Without this notification details cannot be retrieved. The 'taskflow'
    section was introduced in stein *2

    Adding the taskflow section causes masakari db sync to initialize new
    tables which have exposed a missing dep on sqlalchemy-utils (Bug 1882900). So
    until that is fixed ensure sqlalchemy-utils is installed too.

    *1 https://docs.openstack.org/masakari/latest/configuration/sample_config.html
    *2 https://docs.openstack.org/releasenotes/masakari/stein.html#new-features

    Change-Id: I850b9978d879cecbcfd2b03491779d31c676b235
    Closes-Bug: #1882656

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/20.05
Review: https://review.opendev.org/735106

[David Ames (thedac)]

Can we determine if https://bugs.launchpad.net/charm-masakari/+bug/1882113 is a duplicate of this bug?

[David Ames (thedac)]

Confirmed 1882113 is not a dup of this bug. Please ignore comment #5.

The stable back-port is landing now.
https://review.opendev.org/735106

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/735106
Committed: https://git.openstack.org/cgit/openstack/charm-masakari/commit/?id=81799bd784acac3ee88ea2d750fddc7e98b11fa3
Submitter: Zuul
Branch: stable/20.05

commit 81799bd784acac3ee88ea2d750fddc7e98b11fa3
Author: Liam Young <email address hidden>
Date: Tue Jun 9 08:48:39 2020 +0000

    Add missing taskflow section

    The 'taskflow' section was missing from the masakari config file *1.
    Without this notification details cannot be retrieved. The 'taskflow'
    section was introduced in stein *2

    Adding the taskflow section causes masakari db sync to initialize new
    tables which have exposed a missing dep on sqlalchemy-utils (Bug 1882900). So
    until that is fixed ensure sqlalchemy-utils is installed too.

    *1 https://docs.openstack.org/masakari/latest/configuration/sample_config.html
    *2 https://docs.openstack.org/releasenotes/masakari/stein.html#new-features

    Change-Id: I850b9978d879cecbcfd2b03491779d31c676b235
    Closes-Bug: #1882656
    (cherry picked from commit f051c76cf3971b08bd561b5256812fe09d45d14b)

[Radosław Piliszek (yoctozepto)]

I have targetted this against Masakari because the error message is super unhelpful here.