component glance master scenario1 standalone fails tempestconf
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
tripleo |
Fix Released
|
Critical
|
Unassigned |
Bug Description
At [1][2][3] the periodic-
2021-07-30 10:02:03.936 280634 INFO config_
2021-07-30 10:02:04.009 280634 INFO tempest.
2021-07-30 10:02:10.659 280634 WARNING urllib3.
2021-07-30 10:02:14.831 280634 INFO tempest.
2021-07-30 10:02:14.831 280634 CRITICAL tempest [-] Unhandled error: tempest.
Details: b'500 Internal Server Error\n\nThe server has either erred or is incapable of performing the requested operation.\n\n '
2021-07-30 10:02:14.831 280634 ERROR tempest Traceback (most recent call last):
2021-07-30 10:02:14.831 280634 ERROR tempest File "/bin/discover-
2021-07-30 10:02:14.831 280634 ERROR tempest sys.exit(main())
2021-07-30 10:02:14.831 280634 ERROR tempest File "/usr/lib/
2021-07-30 10:02:14.831 280634 ERROR tempest retry_image=
2021-07-30 10:02:14.831 280634 ERROR tempest File "/usr/lib/
2021-07-30 10:02:14.831 280634 ERROR tempest image.create_
2021-07-30 10:02:14.831 280634 ERROR tempest File "/usr/lib/
2021-07-30 10:02:14.831 280634 ERROR tempest retry_alt=
2021-07-30 10:02:14.831 280634 ERROR tempest File "/usr/lib/
2021-07-30 10:02:14.831 280634 ERROR tempest image = self._upload_
2021-07-30 10:02:14.831 280634 ERROR tempest File "/usr/lib/
2021-07-30 10:02:14.831 280634 ERROR tempest self.client.
2021-07-30 10:02:14.831 280634 ERROR tempest File "/usr/lib/
2021-07-30 10:02:14.831 280634 ERROR tempest body=data, chunked=True)
2021-07-30 10:02:14.831 280634 ERROR tempest File "/usr/lib/
2021-07-30 10:02:14.831 280634 ERROR tempest self._error_
2021-07-30 10:02:14.831 280634 ERROR tempest File "/usr/lib/
2021-07-30 10:02:14.831 280634 ERROR tempest message=message)
2021-07-30 10:02:14.831 280634 ERROR tempest tempest.
2021-07-30 10:02:14.831 280634 ERROR tempest Details: b'500 Internal Server Error\n\nThe server has either erred or is incapable of performing the requested operation.\n\n '
2021-07-30 10:02:14.831 280634 ERROR tempest [00m
This is blocking the master glance component promotions. The issue started happening on the 23rd (last successful run 22nd July @ [4])
[1] https:/
[2] https:/
[3] https:/
[4] https:/
seeing errors in the glance container logs which seems to line up with the error seen in tempestconf timewise
https:/ /logserver. rdoproject. org/openstack- component- glance/ opendev. org/openstack/ tripleo- ci/master/ periodic- tripleo- ci-centos- 8-scenario001- standalone- glance- master/ f778547/ logs/undercloud /var/log/ containers/ glance/ api.log. txt.gz
2021-07-30 10:02:10.477 180 DEBUG oslo_concurrenc y.processutils [-] 'blkid overlay -s UUID -o value' failed. Not Retrying. execute /usr/lib/ python3. 6/site- packages/ oslo_concurrenc y/processutils. py:474 7003306d- 4ba2-48e9- a117-88a3272686 41]: Unexpected error while running command. python3. 6/site- packages/ oslo_privsep/ daemon. py:482 python3. 6/site- packages/ oslo_privsep/ daemon. py", line 477, in _process_cmd python3. 6/site- packages/ oslo_privsep/ priv_context. py", line 274, in _wrap python3. 6/site- packages/ os_brick/ privileged/ rootwrap. py", line 197, in execute_root execute( *cmd, shell=False, run_as_root=False, **kwargs) python3. 6/site- packages/ os_brick/ privileged/ rootwrap. py", line 146, in custom_execute completion= on_completion, *cmd, **kwargs) python3. 6/site- packages/ oslo_concurrenc y/processutils. py", line 441, in execute sanitized_ cmd) y.processutils. ProcessExecutio nError: Unexpected error while running command.
2021-07-30 10:02:10.477 180 DEBUG oslo.privsep.daemon [-] privsep: Exception during request[
Command: blkid overlay -s UUID -o value
Exit code: 2
Stdout: ''
Stderr: '' _process_cmd /usr/lib/
Traceback (most recent call last):
File "/usr/lib/
ret = func(*f_args, **f_kwargs)
File "/usr/lib/
return func(*args, **kwargs)
File "/usr/lib/
return custom_
File "/usr/lib/
on_
File "/usr/lib/
cmd=
oslo_concurrenc
Command: blkid overlay -s UUID -o value
Exit code: 2
Stdout: ''
Stderr: ''