api: '1.0'
astute_sha: cff84956fbe8ac8f95020aa04d326230cae92158
auth_required: true
build_id: 2014-11-06_21-29-20
build_number: '82'
feature_groups:
- mirantis
fuellib_sha: ef9f6407d0d555346ac34b9f29ee004083f8e6d2
fuelmain_sha: 0d3f16254760999f90564c384f34fda8d6c82f51
nailgun_sha: 172c1acadabf59b9434718d9a1c27a3a4db5f3cc
ostf_sha: 9c6fadca272427bb933bc459e14bb1bad7f614aa
production: docker
release: '6.0'
Steps to reproduce
1. Deploy 100 nodes cluster with 3 controllers in HA and 97 computes with Cinder with ISCSI with neutron GRE
2. Run rally tests
config
{
"kw": {
"runner": {
"type": "constant",
"concurrency": 5,
"times": 97
},
"args": {
"flavor": {
"name": "m1.nano"
},
"image": {
"name": "TestVM"
}
},
"context": {
"quotas": {
"nova": {
"ram": -1,
"floating_ips": -1,
"security_group_rules": -1,
"instances": -1,
"cores": -1,
"security_groups": -1
}
},
"users": {
"project_domain": "default",
"concurrent": 30,
"user_domain": "default",
"tenants": 2,
"users_per_tenant": 2
}
}
},
"name": "NovaServers.snapshot_server",
"pos": 0
}
One test failed with error - 'ClientException: The server has either erred or is incapable of performing the requested operation. (HTTP 500)'
results
+------------------------+--------+--------+--------+----------+-------+--------+
| Action | min | avg | max | failures | total | result |
+------------------------+--------+--------+--------+----------+-------+--------+
| nova.boot_server | 2.984 | 3.163 | 3.670 | 0 | 97 | :) |
| nova.boot_server (2) | 3.888 | 5.512 | 66.162 | 0 | 97 | :) |
| nova.create_image | 4.827 | 5.197 | 7.407 | 0 | 97 | :) |
| nova.delete_image | 0.598 | 0.785 | 1.423 | 1 | 97 | :( |
| nova.delete_server | 2.420 | 2.539 | 2.900 | 0 | 97 | :) |
| nova.delete_server (2) | 2.445 | 2.533 | 2.773 | 0 | 97 | :) |
| ~total | 17.625 | 19.731 | 79.878 | 1 | 97 | :( |
+------------------------+--------+--------+--------+----------+-------+--------+
stderr-0003
<class 'novaclient.exceptions.ClientException'>
The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-3d8dca49-d324-4e62-93f5-84b71aead152)
Traceback (most recent call last):
File "/opt/stack/.venv/lib/python2.7/site-packages/rally/benchmark/runners/base.py", line 73, in _run_scenario_once
method_name)(**kwargs) or scenario_output
File "/opt/stack/.venv/lib/python2.7/site-packages/rally/benchmark/scenarios/nova/servers.py", line 137, in snapshot_server
self._delete_image(image)
File "/opt/stack/.venv/lib/python2.7/site-packages/rally/benchmark/scenarios/base.py", line 256, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/opt/stack/.venv/lib/python2.7/site-packages/rally/benchmark/scenarios/nova/utils.py", line 279, in _delete_image
image.delete()
File "/opt/stack/.venv/lib/python2.7/site-packages/novaclient/v1_1/images.py", line 37, in delete
self.manager.delete(self)
File "/opt/stack/.venv/lib/python2.7/site-packages/novaclient/v1_1/images.py", line 80, in delete
self._delete("/images/%s" % base.getid(image))
File "/opt/stack/.venv/lib/python2.7/site-packages/novaclient/base.py", line 109, in _delete
_resp, _body = self.api.client.delete(url)
File "/opt/stack/.venv/lib/python2.7/site-packages/novaclient/client.py", line 496, in delete
return self._cs_request(url, 'DELETE', **kwargs)
File "/opt/stack/.venv/lib/python2.7/site-packages/novaclient/client.py", line 465, in _cs_request
resp, body = self._time_request(url, method, **kwargs)
File "/opt/stack/.venv/lib/python2.7/site-packages/novaclient/client.py", line 439, in _time_request
resp, body = self.request(url, method, **kwargs)
File "/opt/stack/.venv/lib/python2.7/site-packages/novaclient/client.py", line 433, in request
raise exceptions.from_response(resp, body, url, method)
ClientException: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-3d8dca49-d324-4e62-93f5-84b71aead152)
I can't attach snapshot because
du -sh /var/log/
22G /var/log/
Seems to be failing in glance-registry:
http://