The placement service for keystone.openstack.maas:RegionOne exists but does not have any supported versions

[Mario Chirinos]

I am currently unable to create or delete instances in my OpenStack Cloud (the cloud was working properly before, for a long time) .
Everything seams to be working properly acording to [juju status](https://pastebin.ubuntu.com/p/q8PGBGbDWB/), but I am unable to create instances, they get stuck in Building status and when I try t delete an instance I got the following error.

    mchc@ubuntu:/data/git/openstack-cfg/client$ openstack server delete --wait 45f3f3ff-8f72-4953-8894-3eab2c3affe8
    Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
    <class 'openstack.exceptions.NotSupported'> (HTTP 500) (Request-ID: req-f3eec74d-a733-4104-8282-801deb88136d)

Login into nova-cloud-controler I can see the [following error for nova-conductor.log](https://pastebin.ubuntu.com/p/7bFWYhqvtc/)

`2023-03-22 17:59:05.006 1201203 ERROR nova openstack.exceptions.NotSupported: The placement service for keystone.openstack.maas:RegionOne exists but does not have any supported versions.`

This [error for nova-scheduler.log](https://pastebin.ubuntu.com/p/kGQXR5CPGw/)

    2023-03-22 18:10:26.812 1208781 WARNING keystoneauth.discover [req-cef0bf8c-0590-445c-ae6f-b019724166cd - - - - -] Failed to contact the endpoint at https://placement.openstack.maas:8778 for discovery. Fallback to using that endpoint as the base url.
    2023-03-22 18:10:26.828 1208781 WARNING keystoneauth.discover [req-cef0bf8c-0590-445c-ae6f-b019724166cd - - - - -] Failed to contact the endpoint at https://placement.openstack.maas:8778 for discovery. Fallback to using that endpoint as the base url.
    2023-03-22 18:10:26.828 1208781 CRITICAL nova [req-cef0bf8c-0590-445c-ae6f-b019724166cd - - - - -] Unhandled error: openstack.exceptions.NotSupported: The placement service for keystone.openstack.maas:RegionOne exists but does not have any supported versions.

And the following [error on the nova-compute node](https://pastebin.ubuntu.com/p/7cg65sKgdr/)

`2023-03-22 18:03:55.673 3837073 WARNING nova.conductor.api [req-b044d3a6-a656-407f-9018-20ecfcc1dee4 - - - - -] Timed out waiting for nova-conductor. Is it running? Or did this service start before nova-conductor? Reattempting establishment of nova-conductor connection...: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 44661288325d486fb41cb9b81c310d71`

keystone_error.log is empty

[Felipe Reyes (freyes)]

Hi Mario,

Thanks for filing this bug.

> The placement service for keystone.openstack.maas:RegionOne exists but does not have any supported versions

> nova-cloud-controller 24.0.0 active 3 nova-cloud-controller stable 363 no Unit is ready
> placement 6.0.0 active 3 placement stable 32 no Unit is ready

according to the versions from juju status you are running focal-xena, although the current version of python3-nova in the archive is 24.2.0 , I don't think this is the root cause, but this is something you should consider.

what's the endpoint registered for the placement service?, you can run "openstack endpoint list | grep placement" to get it.

Also check, in the placement units, the logs available at /var/log/placement/placement_*.log .

I will mark the bug as 'incomplete', but feel free to change it back to 'New' once you have more insights to share about your cloud.

Best,

[Mario Chirinos (mario-chirinos)]

Felipe Thanks for the replay,i guess nova version 24.2.0 was the original one the installation because I haven't done any upgrade.

the endpoint output is:

mchc@ubuntu:/data/git/openstack-cfg/client$ openstack endpoint list | grep placement
| 4200556382d443378486ea591dcc5254 | RegionOne | placement | placement | True | public | https://placement.openstack.maas:8778 |
| 5f7d5ed9b184468695b4d406533f01a7 | RegionOne | placement | placement | True | internal | https://placement.openstack.maas:8778 |
| bc57d061f8ca4768b5441c675667397f | RegionOne | placement | placement | True | admin | https://placement.openstack.maas:8778 |
mchc@ubuntu:/data/git/openstack-cfg/client$

the endpoints semas to be working
mchc@ubuntu:~$ nslookup placement.openstack.maas
Server: 127.0.0.53
Address: 127.0.0.53#53

Non-authoritative answer:
Name: placement.openstack.maas
Address: 10.2.101.207

The directory /var/log/placement/ is empty and the file /var/log/apache2/placement_error.log is also empty

Apache2 log in the placement unit has
ubuntu@juju-5025f7-0-lxd-5:~$ tail -n 50 /var/log/apache2/error.log
[Thu Mar 23 00:00:01.505042 2023] [mpm_event:notice] [pid 558633:tid 140396909460544] AH00489: Apache/2.4.41 (Ubuntu) OpenSSL/1.1.1f mod_wsgi/4.6.8 Python/3.8 configured -- resuming normal operations
[Thu Mar 23 00:00:01.505082 2023] [core:notice] [pid 558633:tid 140396909460544] AH00094: Command line: '/usr/sbin/apache2'
[Thu Mar 23 19:44:31.036090 2023] [mpm_event:notice] [pid 558633:tid 140396909460544] AH00491: caught SIGTERM, shutting down
[Thu Mar 23 19:44:31.125271 2023] [mpm_event:notice] [pid 2296203:tid 139806177664064] AH00489: Apache/2.4.41 (Ubuntu) OpenSSL/1.1.1f mod_wsgi/4.6.8 Python/3.8 configured -- resuming normal operations
[Thu Mar 23 19:44:31.125376 2023] [core:notice] [pid 2296203:tid 139806177664064] AH00094: Command line: '/usr/sbin/apache2'
[Thu Mar 23 19:46:10.439490 2023] [mpm_event:notice] [pid 2296203:tid 139806177664064] AH00491: caught SIGTERM, shutting down
[Thu Mar 23 19:46:10.584593 2023] [mpm_event:notice] [pid 2297877:tid 140300412759104] AH00489: Apache/2.4.41 (Ubuntu) OpenSSL/1.1.1f mod_wsgi/4.6.8 Python/3.8 configured -- resuming normal operations
[Thu Mar 23 19:46:10.584687 2023] [core:notice] [pid 2297877:tid 140300412759104] AH00094: Command line: '/usr/sbin/apache2'