nova rbd_secret_uuid behavior

[Satish Patel]

I have deployed Zed stable release of kolla-ansible and when I am looking at nova virsh secret-list this is what I have.

# ssh -t os-comp2 docker exec -it nova_libvirt virsh secret-list
 UUID Usage
-------------------------------------------------------------------
 aa9fb7a7-1246-4452-b214-4903cc7b6d66 ceph client.cinder secret
 ba95b0ee-4cea-44e5-8262-8e4de197bb00 ceph client.nova secret

Later I have integrated with external ceph storage. Now when I attached cinder volume I started getting following error

2023-08-27 20:16:17.990 7 ERROR nova.virt.libvirt.driver [None req-61720cbd-626f-46bf-86c7-fda469b5e7f7 6e3d673b8733470ebc4a72dabea86f2f 1ed68ab792854dc99c1b2d31bf90019b - - default default] [instance: 78d5bf05-0702-4ce6-9a82-750319a89769] Failed to start libvirt guest: libvirt.libvirtError: Secret not found: no secret with matching uuid '69552194-41e6-11ee-8a82-cd5d1643511f'

69552194-41e6-11ee-8a82-cd5d1643511f is my Ceph fsid.

my nova.conf on compute nodes has rbd_secret_uuid=ba95b0ee-4cea-44e5-8262-8e4de197bb00

This is what I did to fix, I have override /etc/kolla/globals.yml and added rbd_secret_uuid: 69552194-41e6-11ee-8a82-cd5d1643511f and destroyed all nova_libvert container and deleted /etc/kolla/nova-libvirt/ directory to get proper rbd_secret_uuid in nova libvirt.

Does anyone know what is going on and is this right fix?

[Przemysław Kuczyński (przemekkuczynski)]

Did You followed https://docs.openstack.org/kolla-ansible/zed/reference/storage/external-ceph-guide.html
Uuid is in cat /etc/kolla/passwords.yml | grep -i uuid

Why old realease of openstack ?

[Satish Patel (satish-txt)]

Yes I am following that doc, I've noticed in /etc/kolla/passwords.yml file rbd_secret_uuid was random generated number before ceph. But after ceph nova started looking for ceph fsid.

I haven't seen this issue in yoga related when I deployed and later added ceph storage. That is why I am clueless why in Zed this behavior is different.

Why nova started care about fsid for libvirt secert uuid? It can be anything not specific to ceph fsid right?