Glance multistore config makes image service inaccessible

[swogat pradhan]

Hi,
Openstack wallaby | tripleo

I am trying to setup DCN where i want to setup a glance multistore config in both central and edge sites as per the documentation.
But when ever i run stack update with the following config for multistore:

[stack@hkg2director ~]$ cat workplace/glance.yaml
parameter_defaults:
  GlanceShowMultipleLocations: true
  GlanceBackend: rbd
  GlanceEnabledImportMethods: web-download,copy-image
  GlanceBackendID: ceph
  GlanceMultistoreConfig:
    dcn01:
      GlanceBackend: rbd
      GlanceStoreDescription: 'dcn01 rbd glance store'
      CephClusterName: dcn01

The image service becomes inaccessible. Giving the following error:

(overcloud) [stack@hkg2director ~]$ openstack image list
Failed to contact the endpoint at https://bolt.bdxworld.com:13292 for discovery. Fallback to using that endpoint as the base url.
Failed to contact the endpoint at https://bolt.bdxworld.com:13292 for discovery. Fallback to using that endpoint as the base url.
The image service for :regionOne exists but does not have any supported versions.

glance api.log from controller nodes:

2023-02-13 13:02:19.878 7 INFO glance.async_ [-] Threadpool model set to 'EventletThreadPoolModel'
2023-02-13 13:02:19.969 7 INFO keyring.backend [-] Loading KWallet
2023-02-13 13:02:19.977 7 INFO keyring.backend [-] Loading SecretService
2023-02-13 13:02:19.982 7 INFO keyring.backend [-] Loading Windows
2023-02-13 13:02:19.983 7 INFO keyring.backend [-] Loading chainer
2023-02-13 13:02:19.983 7 INFO keyring.backend [-] Loading macOS
2023-02-13 13:02:20.571 7 WARNING keystonemiddleware.auth_token [-] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True.
2023-02-13 13:02:20.711 7 ERROR stevedore.extension [-] Could not load 'glance.store.s3.Store': No module named 'boto3': ModuleNotFoundError: No module named 'boto3'
2023-02-13 13:02:20.719 7 ERROR stevedore.extension [-] Could not load 's3': No module named 'boto3': ModuleNotFoundError: No module named 'boto3'

Is there a patch to fix this issue??

[swogat pradhan (swogat)]

The container glance_api is in unhealthy state and keeps on rebooting

[swogat pradhan (swogat)]

Hi,
Can someone please suggest a way forward for this issue?
Setting glance multistore makes glance services(endpoint) inaccesible, for cloud to return to normal. i am removing the multistore config and updating the stack as below:

[stack@hkg2director ~]$ cat workplace/glance.yaml
parameter_defaults:
  GlanceShowMultipleLocations: true
  GlanceBackend: rbd
  GlanceEnabledImportMethods: web-download,copy-image
  GlanceBackendID: ceph

Is there any other way to upload images to dcn sites directly without using glance multistore?

[Cyril Roelandt (cyril-roelandt)]

Hello,

The error at the end of your log is harmless, and will not even show up in future versions of glance_store (see https://review.opendev.org/c/openstack/glance_store/+/874534).

Regarding your issue:
1) Are you sure you can reach https://bolt.bdxworld.com:13292 (no DNS issues, firewall issues, etc.)?
2) Can you give us your tripleo config, Glance config and glance logs?