[2023.2] tempest fails to build servers: Image has no associated data

Bug #2044819 reported by Bas de Bruijne
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Snap
Fix Released
Medium
Unassigned

Bug Description

In test run https://solutions.qa.canonical.com/testruns/25fe91d1-4f5d-4a07-b33a-301495c37dfd/, which tests sunbeam 2023.2 in the dedicated_control config, tempest fails serval test with:

=========
Traceback (most recent call last):
  File "/home/ubuntu/snap/fcbtest/50/.rally/verification/verifier-dce811f6-f89a-40cb-8665-fd808cdc19de/repo/tempest/test.py", line 206, in setUpClass
    raise value.with_traceback(trace)
  File "/home/ubuntu/snap/fcbtest/50/.rally/verification/verifier-dce811f6-f89a-40cb-8665-fd808cdc19de/repo/tempest/test.py", line 199, in setUpClass
    cls.resource_setup()
  File "/home/ubuntu/snap/fcbtest/50/.rally/verification/verifier-dce811f6-f89a-40cb-8665-fd808cdc19de/repo/tempest/api/compute/images/test_images_oneserver.py", line 30, in resource_setup
    cls.server_id = cls.create_test_server(wait_until='ACTIVE')['id']
  File "/home/ubuntu/snap/fcbtest/50/.rally/verification/verifier-dce811f6-f89a-40cb-8665-fd808cdc19de/repo/tempest/api/compute/base.py", line 272, in create_test_server
    body, servers = compute.create_test_server(
  File "/home/ubuntu/snap/fcbtest/50/.rally/verification/verifier-dce811f6-f89a-40cb-8665-fd808cdc19de/repo/tempest/common/compute.py", line 334, in create_test_server
    with excutils.save_and_reraise_exception():
  File "/snap/fcbtest/50/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
    self.force_reraise()
  File "/snap/fcbtest/50/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
    raise self.value
  File "/home/ubuntu/snap/fcbtest/50/.rally/verification/verifier-dce811f6-f89a-40cb-8665-fd808cdc19de/repo/tempest/common/compute.py", line 317, in create_test_server
    server = waiters.wait_for_server_status(
  File "/home/ubuntu/snap/fcbtest/50/.rally/verification/verifier-dce811f6-f89a-40cb-8665-fd808cdc19de/repo/tempest/common/waiters.py", line 81, in wait_for_server_status
    raise exceptions.BuildErrorException(details, server_id=server_id)
tempest.exceptions.BuildErrorException: Server 0d997e0e-7dc1-4bf5-a47e-8c305322098e failed to build and is in ERROR status
Details: Fault: {'code': 500, 'created': '2023-11-25T21:54:03Z', 'message': 'Build of instance 0d997e0e-7dc1-4bf5-a47e-8c305322098e aborted: Image c87a30cc-708a-44f9-bb33-e2f0d7c357bf is unacceptable: Image has no associated data'}. Server boot request ID: req-d2ad9501-0a75-495a-b143-b153092c31b6.
=========

Full tempest output is shown here: https://oil-jenkins.canonical.com/artifacts/25fe91d1-4f5d-4a07-b33a-301495c37dfd/generated/generated/sunbeam/tempest/tempest_result.html
Full collection of logs shown here: https://oil-jenkins.canonical.com/artifacts/25fe91d1-4f5d-4a07-b33a-301495c37dfd/index.html

tags: added: cdo-qa
Revision history for this message
James Page (james-page) wrote :

This is only happening when storage/compute is split from control.

sunbeam configure is run directly after bootstrap; this includes uploading an image to glance.

In this topology glance is using local disk storage in single unit mode until additional nodes are added and the control plane is resized.

As such once resize has been completed, only 1/3 glance units can actually access the underlying image that was uploaded directly after the bootstrap step.

A) we should update the docs to configure the cloud after additional nodes have been added.

B) tests need to be updated to follow this change.

Revision history for this message
James Page (james-page) wrote :

I've updated https://microstack.run/docs/multi-node to re-order the configure step to later in the process.

Revision history for this message
James Page (james-page) wrote :

C) we could also look to see if we could migration the disk based image to the ceph backend during that transition.

Changed in snap-openstack:
status: New → Fix Committed
importance: Undecided → Medium
tags: added: documentation
James Page (james-page)
Changed in snap-openstack:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.