Master featureset020/fs039 failed while trying to upload image, HttpException: 500: Server Error for url: https://192.168.24.2:13292/v2/images/b898eee8-66c3-4a27-bbad-e6ca19d1f8d8/file, Internal Server Error

[Sandeep Yadav]

Master featureset020/fs039 failed while trying to upload image, HttpException: 500: Server Error for url: https://192.168.24.2:13292/v2/images/b898eee8-66c3-4a27-bbad-e6ca19d1f8d8/file, Internal Server Error

Description:-
Master featureset020/fs039 failed while trying to upload image, HttpException: 500: Server Error for url: https://192.168.24.2:13292/v2/images/b898eee8-66c3-4a27-bbad-e6ca19d1f8d8/file, Internal Server Error

This started after we disabled swift by default on undercloud, Because in some featureset we are still using nova we need to explicitly enable swift on those featureset.

Logs:-

https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-master/2cbf4df/logs/undercloud/home/zuul/overcloud_image_upload.log.txt.gz

~~~
2021-02-05 02:13:04 | + openstack overcloud image upload --http-boot=/var/lib/ironic/httpboot
2021-02-05 02:13:16 | /usr/lib/python3.6/site-packages/barbicanclient/__init__.py:61: UserWarning: The secrets module is moved to barbicanclient/v1 directory, direct import of barbicanclient.secrets will be deprecated. Please import barbicanclient.v1.secrets instead.
2021-02-05 02:13:16 | % (name, name, name))
2021-02-05 02:13:16 | Exception occured while running the command
2021-02-05 02:13:16 | Traceback (most recent call last):
2021-02-05 02:13:16 | File "/usr/lib/python3.6/site-packages/tripleoclient/command.py", line 34, in run
2021-02-05 02:13:16 | super(Command, self).run(parsed_args)
2021-02-05 02:13:16 | File "/usr/lib/python3.6/site-packages/osc_lib/command/command.py", line 39, in run
2021-02-05 02:13:16 | return super(Command, self).run(parsed_args)
2021-02-05 02:13:16 | File "/usr/lib/python3.6/site-packages/cliff/command.py", line 185, in run
2021-02-05 02:13:16 | return_code = self.take_action(parsed_args) or 0
2021-02-05 02:13:16 | File "/usr/lib/python3.6/site-packages/tripleoclient/v1/overcloud_image.py", line 582, in take_action
2021-02-05 02:13:16 | disk_format='aki'
2021-02-05 02:13:16 | File "/usr/lib/python3.6/site-packages/tripleoclient/v1/overcloud_image.py", line 396, in update_or_upload
2021-02-05 02:13:16 | data=data)
2021-02-05 02:13:16 | File "/usr/lib/python3.6/site-packages/tripleoclient/v1/overcloud_image.py", line 359, in _upload_image
2021-02-05 02:13:16 | validate_checksum=False
2021-02-05 02:13:16 | File "/usr/lib/python3.6/site-packages/openstack/image/_base_proxy.py", line 208, in create_image
2021-02-05 02:13:16 | **image_kwargs)
2021-02-05 02:13:16 | File "/usr/lib/python3.6/site-packages/openstack/image/v2/_proxy.py", line 235, in _upload_image
2021-02-05 02:13:16 | **kwargs)
2021-02-05 02:13:16 | File "/usr/lib/python3.6/site-packages/openstack/image/v2/_proxy.py", line 293, in _upload_image_put
2021-02-05 02:13:16 | exceptions.raise_from_response(response)
2021-02-05 02:13:16 | File "/usr/lib/python3.6/site-packages/openstack/exceptions.py", line 238, in raise_from_response
2021-02-05 02:13:16 | http_status=http_status, request_id=request_id
2021-02-05 02:13:16 | openstack.exceptions.HttpException: HttpException: 500: Server Error for url: https://192.168.24.2:13292/v2/images/b898eee8-66c3-4a27-bbad-e6ca19d1f8d8/file, Internal Server Error
2021-02-05 02:13:16 | HttpException: 500: Server Error for url: https://192.168.24.2:13292/v2/images/b898eee8-66c3-4a27-bbad-e6ca19d1f8d8/file, Internal Server Error
~~~

Another example:-
https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-master/8bc1500/logs/undercloud/home/zuul/overcloud_image_upload.log.txt.gz

Patches are up:

https://review.opendev.org/c/openstack/tripleo-quickstart/+/773560
https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/773559

[Sandeep Yadav (sandeepyadav93)]

For featureset20 we have a patch up which disables nova/glance:-

https://review.opendev.org/c/openstack/tripleo-quickstart/+/773648

Running fs020 agasint testproject here https://review.rdoproject.org/r/#/c/28446/

[Sandeep Yadav (sandeepyadav93)]

Jobs are back to green after merge of above patches.

https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-master

https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-master