During rally test nova.boot we got
rally.exceptions.GetResourceErrorStatus: Resource <Server: s_rally_b0b59fb8_aFI457Bo_0-1> has ERROR status.
Fault: {'code': 500, 'created': '2021-02-01T13:13:04Z', 'message': 'JSONDecodeError'}
So far it is just one-off error, we had other passing runs
Example run here:
https://solutions.qa.canonical.com/testruns/testRun/c6084abb-640a-42de-9efa-de44e0358fae
Console output during failure
https://oil-jenkins.canonical.com/job/fce_build/9462/console
All artifacts here:
https://oil-jenkins.canonical.com/artifacts/c6084abb-640a-42de-9efa-de44e0358fae/index.html
Crashdump here:
https://oil-jenkins.canonical.com/artifacts/c6084abb-640a-42de-9efa-de44e0358fae/generated/generated/openstack/juju-crashdump-openstack-2021-02-01-15.15.25.tar.gz
nova-cloud-controller on 0/lxd/8 contains the error
2021-02-01 13:13:03.623 161051 WARNING keystoneauth.discover [req-8df9368e-f136-49f6-ac1f-32067bcfda47 0a2c31f5b9494868a9f873996f93ab5c 164e361274c5469a93807b1b3abd8e16 - cf7456b6eb4947428da7b71a046e04ed cf7456b6eb4947428da7b71a046e04ed] Failed to contact the endpoint at http://192.168.33.145:8778 for discovery. Fallback to using that endpoint as the base url.
2021-02-01 13:13:03.632 161051 WARNING keystoneauth.discover [req-8df9368e-f136-49f6-ac1f-32067bcfda47 0a2c31f5b9494868a9f873996f93ab5c 164e361274c5469a93807b1b3abd8e16 - cf7456b6eb4947428da7b71a046e04ed cf7456b6eb4947428da7b71a046e04ed] Failed to contact the endpoint at http://192.168.33.145:8778 for discovery. Fallback to using that endpoint as the base url.
2021-02-01 13:13:03.636 161051 WARNING nova.scheduler.client.report [req-8df9368e-f136-49f6-ac1f-32067bcfda47 0a2c31f5b9494868a9f873996f93ab5c 164e361274c5469a93807b1b3abd8e16 - cf7456b6eb4947428da7b71a046e04ed cf7456b6eb4947428da7b71a046e04ed] Failed to save allocation for 9ec19836-172c-46c7-8a36-a4c1e90683f3. Got HTTP 400: <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>400 Bad Request</title>
</head><body>
<h1>Bad Request</h1>
<p>Your browser sent a request that this server could not understand.<br />
Reason: You're speaking plain HTTP to an SSL-enabled server port.<br />
Instead use the HTTPS scheme to access this URL, please.<br />
</p>
<hr>
<address>Apache/2.4.41 (Ubuntu) Server at 192.168.33.145 Port 80</address>
</body></html>
2021-02-01 13:13:03.637 161051 WARNING nova.scheduler.utils [req-8df9368e-f136-49f6-ac1f-32067bcfda47 0a2c31f5b9494868a9f873996f93ab5c 164e361274c5469a93807b1b3abd8e16 - cf7456b6eb4947428da7b71a046e04ed cf7456b6eb4947428da7b71a046e04ed] Failed to compute_task_build_instances: Expecting value: line 1 column 1 (char 0): simplejson.errors.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
2021-02-01 13:13:03.637 161051 WARNING nova.scheduler.utils [req-8df9368e-f136-49f6-ac1f-32067bcfda47 0a2c31f5b9494868a9f873996f93ab5c 164e361274c5469a93807b1b3abd8e16 - cf7456b6eb4947428da7b71a046e04ed cf7456b6eb4947428da7b71a046e04ed] [instance: 9ec19836-172c-46c7-8a36-a4c1e90683f3] Setting instance to ERROR state.: simplejson.errors.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
There were other tests in the same Rally run creating and booting server which passed
