| 2016-09-28 13:48:45 |
Pavel |
bug |
|
|
added bug |
| 2016-09-28 13:50:04 |
Michael Semenov |
mos: milestone |
|
9.1 |
|
| 2016-09-28 13:50:14 |
Michael Semenov |
mos: importance |
Undecided |
High |
|
| 2016-09-28 13:50:24 |
Michael Semenov |
mos: assignee |
|
MOS Keystone (mos-keystone) |
|
| 2016-09-28 13:53:10 |
Pavel |
description |
Looks like we got Keystone's performance degradation in 9.1 MU.
Here you can see fresh test results for 9.0 (build 945)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/22023&group_by=cases:section_id&group_order=asc
As you can see we have about 30% degradation for both authentication and validation time in compare with 9.0 release.
Test run were performed on ENV-14 Lab of Performance QA Team.
---------------------------
And here you can see fresh test results for 9.1 snapshot 315:
---------------------------
- short run: https://mirantis.testrail.com/index.php?/runs/view/22009&group_by=cases:section_id&group_order=asc
- long run: https://mirantis.testrail.com/index.php?/runs/view/22004&group_by=cases:section_id&group_order=asc
The results are almost the same for both runs. Test runs were performed on ENV-12 Lab of Performance QA Team.
---------------------------
The same test were also performed for earlier 9.1 snapshot (form 14.09.2016-16:43:22)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/20843&group_by=cases:section_id&group_order=asc
No regression as you can see.
Test run were performed on ENV-13 Lab of Performance QA Team.
---------------------------
ENV-12 (master node ip: 172.16.44.12), ENV-14 (master node ip: 172.16.44.14) and ENV-13 (master node ip: 172.16.44.13) have the same hardware and configuraton of controlers. Hardware description can be found here:
https://mirantis.jira.com/wiki/display/QA/Scale+lab+HW
A bit later I'll provide results of test run for 9.1 on ENV-14 and comparative hardware resources consuming stats for 9.0 and 9.1 during Keystone tests were run. |
Looks like we got Keystone's performance degradation in 9.1 MU.
Here you can see fresh test results for 9.0 (build 945)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/22023&group_by=cases:section_id&group_order=asc
Test run were performed on ENV-14 Lab of Performance QA Team.
---------------------------
And here you can see fresh test results for 9.1 snapshot 315:
---------------------------
- short run: https://mirantis.testrail.com/index.php?/runs/view/22009&group_by=cases:section_id&group_order=asc
- long run: https://mirantis.testrail.com/index.php?/runs/view/22004&group_by=cases:section_id&group_order=asc
As you can see we have about 30% degradation for both authentication and validation time in compare with 9.0 release.
The results are almost the same for both runs. Test runs were performed on ENV-12 Lab of Performance QA Team.
---------------------------
The same test were also performed for earlier 9.1 snapshot (form 14.09.2016-16:43:22)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/20843&group_by=cases:section_id&group_order=asc
No regression as you can see.
Test run were performed on ENV-13 Lab of Performance QA Team.
---------------------------
ENV-12 (master node ip: 172.16.44.12), ENV-14 (master node ip: 172.16.44.14) and ENV-13 (master node ip: 172.16.44.13) have the same hardware and configuraton of controlers. Hardware description can be found here:
https://mirantis.jira.com/wiki/display/QA/Scale+lab+HW
A bit later I'll provide results of test run for 9.1 on ENV-14 and comparative hardware resources consuming stats for 9.0 and 9.1 during Keystone tests were run. |
|
| 2016-09-28 13:53:30 |
Pavel |
description |
Looks like we got Keystone's performance degradation in 9.1 MU.
Here you can see fresh test results for 9.0 (build 945)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/22023&group_by=cases:section_id&group_order=asc
Test run were performed on ENV-14 Lab of Performance QA Team.
---------------------------
And here you can see fresh test results for 9.1 snapshot 315:
---------------------------
- short run: https://mirantis.testrail.com/index.php?/runs/view/22009&group_by=cases:section_id&group_order=asc
- long run: https://mirantis.testrail.com/index.php?/runs/view/22004&group_by=cases:section_id&group_order=asc
As you can see we have about 30% degradation for both authentication and validation time in compare with 9.0 release.
The results are almost the same for both runs. Test runs were performed on ENV-12 Lab of Performance QA Team.
---------------------------
The same test were also performed for earlier 9.1 snapshot (form 14.09.2016-16:43:22)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/20843&group_by=cases:section_id&group_order=asc
No regression as you can see.
Test run were performed on ENV-13 Lab of Performance QA Team.
---------------------------
ENV-12 (master node ip: 172.16.44.12), ENV-14 (master node ip: 172.16.44.14) and ENV-13 (master node ip: 172.16.44.13) have the same hardware and configuraton of controlers. Hardware description can be found here:
https://mirantis.jira.com/wiki/display/QA/Scale+lab+HW
A bit later I'll provide results of test run for 9.1 on ENV-14 and comparative hardware resources consuming stats for 9.0 and 9.1 during Keystone tests were run. |
Looks like we got Keystone's performance degradation in 9.1 MU.
Here you can see fresh test results for 9.0 (build 945)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/22023&group_by=cases:section_id&group_order=asc
Test run were performed on ENV-14 Lab of Performance QA Team.
---------------------------
And here you can see fresh test results for 9.1 snapshot 315:
---------------------------
- short run: https://mirantis.testrail.com/index.php?/runs/view/22009&group_by=cases:section_id&group_order=asc
- long run: https://mirantis.testrail.com/index.php?/runs/view/22004&group_by=cases:section_id&group_order=asc
As you can see we have about 30% degradation for both authentication and validation time in compare to 9.0 release.
The results are almost the same for both runs. Test runs were performed on ENV-12 Lab of Performance QA Team.
---------------------------
The same test were also performed for earlier 9.1 snapshot (form 14.09.2016-16:43:22)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/20843&group_by=cases:section_id&group_order=asc
No regression as you can see.
Test run were performed on ENV-13 Lab of Performance QA Team.
---------------------------
ENV-12 (master node ip: 172.16.44.12), ENV-14 (master node ip: 172.16.44.14) and ENV-13 (master node ip: 172.16.44.13) have the same hardware and configuraton of controlers. Hardware description can be found here:
https://mirantis.jira.com/wiki/display/QA/Scale+lab+HW
A bit later I'll provide results of test run for 9.1 on ENV-14 and comparative hardware resources consuming stats for 9.0 and 9.1 during Keystone tests were run. |
|
| 2016-09-28 13:55:13 |
Pavel |
description |
Looks like we got Keystone's performance degradation in 9.1 MU.
Here you can see fresh test results for 9.0 (build 945)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/22023&group_by=cases:section_id&group_order=asc
Test run were performed on ENV-14 Lab of Performance QA Team.
---------------------------
And here you can see fresh test results for 9.1 snapshot 315:
---------------------------
- short run: https://mirantis.testrail.com/index.php?/runs/view/22009&group_by=cases:section_id&group_order=asc
- long run: https://mirantis.testrail.com/index.php?/runs/view/22004&group_by=cases:section_id&group_order=asc
As you can see we have about 30% degradation for both authentication and validation time in compare to 9.0 release.
The results are almost the same for both runs. Test runs were performed on ENV-12 Lab of Performance QA Team.
---------------------------
The same test were also performed for earlier 9.1 snapshot (form 14.09.2016-16:43:22)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/20843&group_by=cases:section_id&group_order=asc
No regression as you can see.
Test run were performed on ENV-13 Lab of Performance QA Team.
---------------------------
ENV-12 (master node ip: 172.16.44.12), ENV-14 (master node ip: 172.16.44.14) and ENV-13 (master node ip: 172.16.44.13) have the same hardware and configuraton of controlers. Hardware description can be found here:
https://mirantis.jira.com/wiki/display/QA/Scale+lab+HW
A bit later I'll provide results of test run for 9.1 on ENV-14 and comparative hardware resources consuming stats for 9.0 and 9.1 during Keystone tests were run. |
Looks like we got Keystone's performance degradation in 9.1 MU.
Here you can see fresh test results for 9.0 (build 945)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/22023&group_by=cases:section_id&group_order=asc
Test run were performed on ENV-14 Lab of Performance QA Team.
---------------------------
And here you can see fresh test results for 9.1 snapshot 315:
---------------------------
- short run: https://mirantis.testrail.com/index.php?/runs/view/22009&group_by=cases:section_id&group_order=asc
- long run: https://mirantis.testrail.com/index.php?/runs/view/22004&group_by=cases:section_id&group_order=asc
As you can see we have about 30% degradation for both authentication and validation time in compare to 9.0 release.
The results are almost the same for both runs. Test runs were performed on ENV-12 Lab of Performance QA Team.
---------------------------
The same test were also performed nearly 2 weeks ago for earlier 9.1 snapshot (form 14.09.2016-16:43:22)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/20843&group_by=cases:section_id&group_order=asc
No regression as you can see.
Test run were performed on ENV-13 Lab of Performance QA Team.
---------------------------
ENV-12 (master node ip: 172.16.44.12), ENV-14 (master node ip: 172.16.44.14) and ENV-13 (master node ip: 172.16.44.13) have the same hardware and configuraton of controlers. Hardware description can be found here:
https://mirantis.jira.com/wiki/display/QA/Scale+lab+HW
A bit later I'll provide results of test run for 9.1 on ENV-14 and comparative hardware resources consuming stats for 9.0 and 9.1 during Keystone tests were run. |
|
| 2016-09-28 13:55:24 |
Pavel |
description |
Looks like we got Keystone's performance degradation in 9.1 MU.
Here you can see fresh test results for 9.0 (build 945)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/22023&group_by=cases:section_id&group_order=asc
Test run were performed on ENV-14 Lab of Performance QA Team.
---------------------------
And here you can see fresh test results for 9.1 snapshot 315:
---------------------------
- short run: https://mirantis.testrail.com/index.php?/runs/view/22009&group_by=cases:section_id&group_order=asc
- long run: https://mirantis.testrail.com/index.php?/runs/view/22004&group_by=cases:section_id&group_order=asc
As you can see we have about 30% degradation for both authentication and validation time in compare to 9.0 release.
The results are almost the same for both runs. Test runs were performed on ENV-12 Lab of Performance QA Team.
---------------------------
The same test were also performed nearly 2 weeks ago for earlier 9.1 snapshot (form 14.09.2016-16:43:22)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/20843&group_by=cases:section_id&group_order=asc
No regression as you can see.
Test run were performed on ENV-13 Lab of Performance QA Team.
---------------------------
ENV-12 (master node ip: 172.16.44.12), ENV-14 (master node ip: 172.16.44.14) and ENV-13 (master node ip: 172.16.44.13) have the same hardware and configuraton of controlers. Hardware description can be found here:
https://mirantis.jira.com/wiki/display/QA/Scale+lab+HW
A bit later I'll provide results of test run for 9.1 on ENV-14 and comparative hardware resources consuming stats for 9.0 and 9.1 during Keystone tests were run. |
Looks like we got Keystone's performance degradation in 9.1 MU.
Here you can see fresh test results for 9.0 (build 945)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/22023&group_by=cases:section_id&group_order=asc
Test run were performed on ENV-14 Lab of Performance QA Team.
---------------------------
And here you can see fresh test results for 9.1 snapshot 315:
---------------------------
- short run: https://mirantis.testrail.com/index.php?/runs/view/22009&group_by=cases:section_id&group_order=asc
- long run: https://mirantis.testrail.com/index.php?/runs/view/22004&group_by=cases:section_id&group_order=asc
As you can see we have about 30% degradation for both authentication and validation time in compare to 9.0 release.
The results are almost the same for both runs. Test runs were performed on ENV-12 Lab of Performance QA Team.
---------------------------
The same tests were also performed nearly 2 weeks ago for earlier 9.1 snapshot (form 14.09.2016-16:43:22)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/20843&group_by=cases:section_id&group_order=asc
No regression as you can see.
Test run were performed on ENV-13 Lab of Performance QA Team.
---------------------------
ENV-12 (master node ip: 172.16.44.12), ENV-14 (master node ip: 172.16.44.14) and ENV-13 (master node ip: 172.16.44.13) have the same hardware and configuraton of controlers. Hardware description can be found here:
https://mirantis.jira.com/wiki/display/QA/Scale+lab+HW
A bit later I'll provide results of test run for 9.1 on ENV-14 and comparative hardware resources consuming stats for 9.0 and 9.1 during Keystone tests were run. |
|
| 2016-09-28 13:55:58 |
Pavel |
description |
Looks like we got Keystone's performance degradation in 9.1 MU.
Here you can see fresh test results for 9.0 (build 945)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/22023&group_by=cases:section_id&group_order=asc
Test run were performed on ENV-14 Lab of Performance QA Team.
---------------------------
And here you can see fresh test results for 9.1 snapshot 315:
---------------------------
- short run: https://mirantis.testrail.com/index.php?/runs/view/22009&group_by=cases:section_id&group_order=asc
- long run: https://mirantis.testrail.com/index.php?/runs/view/22004&group_by=cases:section_id&group_order=asc
As you can see we have about 30% degradation for both authentication and validation time in compare to 9.0 release.
The results are almost the same for both runs. Test runs were performed on ENV-12 Lab of Performance QA Team.
---------------------------
The same tests were also performed nearly 2 weeks ago for earlier 9.1 snapshot (form 14.09.2016-16:43:22)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/20843&group_by=cases:section_id&group_order=asc
No regression as you can see.
Test run were performed on ENV-13 Lab of Performance QA Team.
---------------------------
ENV-12 (master node ip: 172.16.44.12), ENV-14 (master node ip: 172.16.44.14) and ENV-13 (master node ip: 172.16.44.13) have the same hardware and configuraton of controlers. Hardware description can be found here:
https://mirantis.jira.com/wiki/display/QA/Scale+lab+HW
A bit later I'll provide results of test run for 9.1 on ENV-14 and comparative hardware resources consuming stats for 9.0 and 9.1 during Keystone tests were run. |
Looks like we got Keystone's performance degradation in 9.1 MU.
Here you can see fresh test results for 9.0 (build 945)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/22023&group_by=cases:section_id&group_order=asc
Test run were performed on ENV-14 Lab of Performance QA Team.
---------------------------
And here you can see fresh test results for 9.1 snapshot 315:
---------------------------
- short run: https://mirantis.testrail.com/index.php?/runs/view/22009&group_by=cases:section_id&group_order=asc
- long run: https://mirantis.testrail.com/index.php?/runs/view/22004&group_by=cases:section_id&group_order=asc
As you can see we have about 30% degradation for both authentication and validation time in compare to 9.0 release.
The results are almost the same for both runs. Test runs were performed on ENV-12 Lab of Performance QA Team.
---------------------------
The same tests were also performed nearly 2 weeks ago for the earlier 9.1 snapshot (form 14.09.2016-16:43:22)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/20843&group_by=cases:section_id&group_order=asc
No performance regression as you can see.
Test run were performed on ENV-13 Lab of Performance QA Team.
---------------------------
ENV-12 (master node ip: 172.16.44.12), ENV-14 (master node ip: 172.16.44.14) and ENV-13 (master node ip: 172.16.44.13) have the same hardware and configuraton of controlers. Hardware description can be found here:
https://mirantis.jira.com/wiki/display/QA/Scale+lab+HW
A bit later I'll provide results of test run for 9.1 on ENV-14 and comparative hardware resources consuming stats for 9.0 and 9.1 during Keystone tests were run. |
|
| 2016-09-28 13:56:21 |
Pavel |
description |
Looks like we got Keystone's performance degradation in 9.1 MU.
Here you can see fresh test results for 9.0 (build 945)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/22023&group_by=cases:section_id&group_order=asc
Test run were performed on ENV-14 Lab of Performance QA Team.
---------------------------
And here you can see fresh test results for 9.1 snapshot 315:
---------------------------
- short run: https://mirantis.testrail.com/index.php?/runs/view/22009&group_by=cases:section_id&group_order=asc
- long run: https://mirantis.testrail.com/index.php?/runs/view/22004&group_by=cases:section_id&group_order=asc
As you can see we have about 30% degradation for both authentication and validation time in compare to 9.0 release.
The results are almost the same for both runs. Test runs were performed on ENV-12 Lab of Performance QA Team.
---------------------------
The same tests were also performed nearly 2 weeks ago for the earlier 9.1 snapshot (form 14.09.2016-16:43:22)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/20843&group_by=cases:section_id&group_order=asc
No performance regression as you can see.
Test run were performed on ENV-13 Lab of Performance QA Team.
---------------------------
ENV-12 (master node ip: 172.16.44.12), ENV-14 (master node ip: 172.16.44.14) and ENV-13 (master node ip: 172.16.44.13) have the same hardware and configuraton of controlers. Hardware description can be found here:
https://mirantis.jira.com/wiki/display/QA/Scale+lab+HW
A bit later I'll provide results of test run for 9.1 on ENV-14 and comparative hardware resources consuming stats for 9.0 and 9.1 during Keystone tests were run. |
Looks like we got Keystone's performance degradation in 9.1 MU.
Here you can see fresh test results for 9.0 (build 945)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/22023&group_by=cases:section_id&group_order=asc
Test run was performed on ENV-14 Lab of Performance QA Team.
---------------------------
And here you can see fresh test results for 9.1 snapshot 315:
---------------------------
- short run: https://mirantis.testrail.com/index.php?/runs/view/22009&group_by=cases:section_id&group_order=asc
- long run: https://mirantis.testrail.com/index.php?/runs/view/22004&group_by=cases:section_id&group_order=asc
As you can see we have about 30% degradation for both authentication and validation time in compare to 9.0 release.
The results are almost the same for both runs. Test runs were performed on ENV-12 Lab of Performance QA Team.
---------------------------
The same tests were also performed nearly 2 weeks ago for the earlier 9.1 snapshot (form 14.09.2016-16:43:22)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/20843&group_by=cases:section_id&group_order=asc
No performance regression as you can see.
Test run was performed on ENV-13 Lab of Performance QA Team.
---------------------------
ENV-12 (master node ip: 172.16.44.12), ENV-14 (master node ip: 172.16.44.14) and ENV-13 (master node ip: 172.16.44.13) have the same hardware and configuraton of controlers. Hardware description can be found here:
https://mirantis.jira.com/wiki/display/QA/Scale+lab+HW
A bit later I'll provide results of test run for 9.1 on ENV-14 and comparative hardware resources consuming stats for 9.0 and 9.1 during Keystone tests were run. |
|
| 2016-09-28 13:57:42 |
Pavel |
description |
Looks like we got Keystone's performance degradation in 9.1 MU.
Here you can see fresh test results for 9.0 (build 945)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/22023&group_by=cases:section_id&group_order=asc
Test run was performed on ENV-14 Lab of Performance QA Team.
---------------------------
And here you can see fresh test results for 9.1 snapshot 315:
---------------------------
- short run: https://mirantis.testrail.com/index.php?/runs/view/22009&group_by=cases:section_id&group_order=asc
- long run: https://mirantis.testrail.com/index.php?/runs/view/22004&group_by=cases:section_id&group_order=asc
As you can see we have about 30% degradation for both authentication and validation time in compare to 9.0 release.
The results are almost the same for both runs. Test runs were performed on ENV-12 Lab of Performance QA Team.
---------------------------
The same tests were also performed nearly 2 weeks ago for the earlier 9.1 snapshot (form 14.09.2016-16:43:22)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/20843&group_by=cases:section_id&group_order=asc
No performance regression as you can see.
Test run was performed on ENV-13 Lab of Performance QA Team.
---------------------------
ENV-12 (master node ip: 172.16.44.12), ENV-14 (master node ip: 172.16.44.14) and ENV-13 (master node ip: 172.16.44.13) have the same hardware and configuraton of controlers. Hardware description can be found here:
https://mirantis.jira.com/wiki/display/QA/Scale+lab+HW
A bit later I'll provide results of test run for 9.1 on ENV-14 and comparative hardware resources consuming stats for 9.0 and 9.1 during Keystone tests were run. |
Looks like we got Keystone's performance degradation in 9.1 MU.
Here you can see fresh test results for 9.0 (build 945)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/22023&group_by=cases:section_id&group_order=asc
Test run was performed on ENV-14 Lab of Performance QA Team.
---------------------------
And here you can see fresh test results for 9.1 snapshot 315:
---------------------------
- short run: https://mirantis.testrail.com/index.php?/runs/view/22009&group_by=cases:section_id&group_order=asc
- long run: https://mirantis.testrail.com/index.php?/runs/view/22004&group_by=cases:section_id&group_order=asc
As you can see we have about 30% degradation for both authentication and validation time in compare to 9.0 release.
The results are almost the same for both runs. Test runs were performed on ENV-12 Lab of Performance QA Team.
---------------------------
The same tests were also performed nearly 2 weeks ago for the earlier 9.1 snapshot (form 14.09.2016-16:43:22)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/20843&group_by=cases:section_id&group_order=asc
No performance regression as you can see.
Test run was performed on ENV-13 Lab of Performance QA Team.
---------------------------
ENV-12 (master node ip: 172.16.44.12), ENV-14 (master node ip: 172.16.44.14) and ENV-13 (master node ip: 172.16.44.13) have the same hardware and configuraton of controlers. Hardware description can be found here:
https://mirantis.jira.com/wiki/display/QA/Scale+lab+HW
A bit later I'll provide results of test run for 9.1 on ENV-14 and comparative stats of hardware resources consuming for 9.0 and 9.1 during Keystone tests were run. |
|
| 2016-09-28 14:11:21 |
Pavel |
description |
Looks like we got Keystone's performance degradation in 9.1 MU.
Here you can see fresh test results for 9.0 (build 945)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/22023&group_by=cases:section_id&group_order=asc
Test run was performed on ENV-14 Lab of Performance QA Team.
---------------------------
And here you can see fresh test results for 9.1 snapshot 315:
---------------------------
- short run: https://mirantis.testrail.com/index.php?/runs/view/22009&group_by=cases:section_id&group_order=asc
- long run: https://mirantis.testrail.com/index.php?/runs/view/22004&group_by=cases:section_id&group_order=asc
As you can see we have about 30% degradation for both authentication and validation time in compare to 9.0 release.
The results are almost the same for both runs. Test runs were performed on ENV-12 Lab of Performance QA Team.
---------------------------
The same tests were also performed nearly 2 weeks ago for the earlier 9.1 snapshot (form 14.09.2016-16:43:22)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/20843&group_by=cases:section_id&group_order=asc
No performance regression as you can see.
Test run was performed on ENV-13 Lab of Performance QA Team.
---------------------------
ENV-12 (master node ip: 172.16.44.12), ENV-14 (master node ip: 172.16.44.14) and ENV-13 (master node ip: 172.16.44.13) have the same hardware and configuraton of controlers. Hardware description can be found here:
https://mirantis.jira.com/wiki/display/QA/Scale+lab+HW
A bit later I'll provide results of test run for 9.1 on ENV-14 and comparative stats of hardware resources consuming for 9.0 and 9.1 during Keystone tests were run. |
Looks like we got Keystone's performance degradation in 9.1 MU.
Here you can see fresh test results for 9.0 (build 945)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/22023&group_by=cases:section_id&group_order=asc
Test run was performed on ENV-14 Lab of Performance QA Team.
---------------------------
And here you can see fresh test results for 9.1 RC2 (snapshot 315):
---------------------------
- short run: https://mirantis.testrail.com/index.php?/runs/view/22009&group_by=cases:section_id&group_order=asc
- long run: https://mirantis.testrail.com/index.php?/runs/view/22004&group_by=cases:section_id&group_order=asc
As you can see we have about 30% degradation for both authentication and validation time in compare to 9.0 release.
The results are almost the same for both runs. Test runs were performed on ENV-12 Lab of Performance QA Team.
---------------------------
The same tests were also performed nearly 2 weeks ago for the earlier 9.1 snapshot (form 14.09.2016-16:43:22)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/20843&group_by=cases:section_id&group_order=asc
No performance regression as you can see.
Test run was performed on ENV-13 Lab of Performance QA Team.
---------------------------
ENV-12 (master node ip: 172.16.44.12), ENV-14 (master node ip: 172.16.44.14) and ENV-13 (master node ip: 172.16.44.13) have the same hardware and configuraton of controlers. Hardware description can be found here:
https://mirantis.jira.com/wiki/display/QA/Scale+lab+HW
A bit later I'll provide results of test run for 9.1 on ENV-14 and comparative stats of hardware resources consuming for 9.0 and 9.1 during Keystone tests were run. |
|
| 2016-09-28 15:19:07 |
Pavel |
description |
Looks like we got Keystone's performance degradation in 9.1 MU.
Here you can see fresh test results for 9.0 (build 945)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/22023&group_by=cases:section_id&group_order=asc
Test run was performed on ENV-14 Lab of Performance QA Team.
---------------------------
And here you can see fresh test results for 9.1 RC2 (snapshot 315):
---------------------------
- short run: https://mirantis.testrail.com/index.php?/runs/view/22009&group_by=cases:section_id&group_order=asc
- long run: https://mirantis.testrail.com/index.php?/runs/view/22004&group_by=cases:section_id&group_order=asc
As you can see we have about 30% degradation for both authentication and validation time in compare to 9.0 release.
The results are almost the same for both runs. Test runs were performed on ENV-12 Lab of Performance QA Team.
---------------------------
The same tests were also performed nearly 2 weeks ago for the earlier 9.1 snapshot (form 14.09.2016-16:43:22)
---------------------------
https://mirantis.testrail.com/index.php?/runs/view/20843&group_by=cases:section_id&group_order=asc
No performance regression as you can see.
Test run was performed on ENV-13 Lab of Performance QA Team.
---------------------------
ENV-12 (master node ip: 172.16.44.12), ENV-14 (master node ip: 172.16.44.14) and ENV-13 (master node ip: 172.16.44.13) have the same hardware and configuraton of controlers. Hardware description can be found here:
https://mirantis.jira.com/wiki/display/QA/Scale+lab+HW
A bit later I'll provide results of test run for 9.1 on ENV-14 and comparative stats of hardware resources consuming for 9.0 and 9.1 during Keystone tests were run. |
Looks like we got Keystone's performance degradation in 9.1 MU.
Here you can see fresh test results for 9.0 (build 945)
---------------------------
<substitute this part with TestRail host address>/index.php?/runs/view/22023&group_by=cases:section_id&group_order=asc
Test run was performed on ENV-14 Lab of Performance QA Team.
---------------------------
And here you can see fresh test results for 9.1 RC2 (snapshot 315):
---------------------------
- short run: <substitute this part with TestRail host address>/index.php?/runs/view/22009&group_by=cases:section_id&group_order=asc
- long run: <substitute this part with TestRail host address>/index.php?/runs/view/22004&group_by=cases:section_id&group_order=asc
As you can see we have about 30% degradation for both authentication and validation time in compare to 9.0 release.
The results are almost the same for both runs. Test runs were performed on ENV-12 Lab of Performance QA Team.
---------------------------
The same tests were also performed nearly 2 weeks ago for the earlier 9.1 snapshot (form 14.09.2016-16:43:22)
---------------------------
<substitute this part with TestRail host address>/index.php?/runs/view/20843&group_by=cases:section_id&group_order=asc
No performance regression as you can see.
Test run was performed on ENV-13 Lab of Performance QA Team.
---------------------------
ENV-12 (master node ip: 172.16.44.12), ENV-14 (master node ip: 172.16.44.14) and ENV-13 (master node ip: 172.16.44.13) have the same hardware and configuraton of controlers. Hardware description can be found here:
<substitute this part with JIRA host address>/wiki/display/QA/Scale+lab+HW
A bit later I'll provide results of test run for 9.1 on ENV-14 and comparative stats of hardware resources consuming for 9.0 and 9.1 during Keystone tests were run. |
|
| 2016-09-28 15:19:54 |
Pavel |
description |
Looks like we got Keystone's performance degradation in 9.1 MU.
Here you can see fresh test results for 9.0 (build 945)
---------------------------
<substitute this part with TestRail host address>/index.php?/runs/view/22023&group_by=cases:section_id&group_order=asc
Test run was performed on ENV-14 Lab of Performance QA Team.
---------------------------
And here you can see fresh test results for 9.1 RC2 (snapshot 315):
---------------------------
- short run: <substitute this part with TestRail host address>/index.php?/runs/view/22009&group_by=cases:section_id&group_order=asc
- long run: <substitute this part with TestRail host address>/index.php?/runs/view/22004&group_by=cases:section_id&group_order=asc
As you can see we have about 30% degradation for both authentication and validation time in compare to 9.0 release.
The results are almost the same for both runs. Test runs were performed on ENV-12 Lab of Performance QA Team.
---------------------------
The same tests were also performed nearly 2 weeks ago for the earlier 9.1 snapshot (form 14.09.2016-16:43:22)
---------------------------
<substitute this part with TestRail host address>/index.php?/runs/view/20843&group_by=cases:section_id&group_order=asc
No performance regression as you can see.
Test run was performed on ENV-13 Lab of Performance QA Team.
---------------------------
ENV-12 (master node ip: 172.16.44.12), ENV-14 (master node ip: 172.16.44.14) and ENV-13 (master node ip: 172.16.44.13) have the same hardware and configuraton of controlers. Hardware description can be found here:
<substitute this part with JIRA host address>/wiki/display/QA/Scale+lab+HW
A bit later I'll provide results of test run for 9.1 on ENV-14 and comparative stats of hardware resources consuming for 9.0 and 9.1 during Keystone tests were run. |
Looks like we got Keystone's performance degradation in 9.1 MU.
Here you can see fresh test results for 9.0 (build 945)
---------------------------
<substitute this part with TestRail host address>/index.php?/runs/view/22023&group_by=cases:section_id&group_order=asc
---------------------------
Test run was performed on ENV-14 Lab of Performance QA Team.
And here you can see fresh test results for 9.1 RC2 (snapshot 315):
---------------------------
- short run: <substitute this part with TestRail host address>/index.php?/runs/view/22009&group_by=cases:section_id&group_order=asc
- long run: <substitute this part with TestRail host address>/index.php?/runs/view/22004&group_by=cases:section_id&group_order=asc
---------------------------
As you can see we have about 30% degradation for both authentication and validation time in compare to 9.0 release.
The results are almost the same for both runs. Test runs were performed on ENV-12 Lab of Performance QA Team.
The same tests were also performed nearly 2 weeks ago for the earlier 9.1 snapshot (form 14.09.2016-16:43:22)
---------------------------
<substitute this part with TestRail host address>/index.php?/runs/view/20843&group_by=cases:section_id&group_order=asc
---------------------------
No performance regression as you can see.
Test run was performed on ENV-13 Lab of Performance QA Team.
ENV-12 (master node ip: 172.16.44.12), ENV-14 (master node ip: 172.16.44.14) and ENV-13 (master node ip: 172.16.44.13) have the same hardware and configuraton of controlers. Hardware description can be found here:
---------------------------
<substitute this part with JIRA host address>/wiki/display/QA/Scale+lab+HW
---------------------------
A bit later I'll provide results of test run for 9.1 on ENV-14 and comparative stats of hardware resources consuming for 9.0 and 9.1 during Keystone tests were run. |
|
| 2016-09-28 15:23:42 |
Boris Bobrov |
mos: assignee |
MOS Keystone (mos-keystone) |
Pavel (p.petrov) |
|
| 2016-09-28 16:19:36 |
Michael Semenov |
mos: importance |
High |
Critical |
|
| 2016-09-28 16:51:06 |
Sergey Philippov |
bug |
|
|
added subscriber Sergey Philippov |
| 2016-09-28 21:58:21 |
Pavel |
description |
Looks like we got Keystone's performance degradation in 9.1 MU.
Here you can see fresh test results for 9.0 (build 945)
---------------------------
<substitute this part with TestRail host address>/index.php?/runs/view/22023&group_by=cases:section_id&group_order=asc
---------------------------
Test run was performed on ENV-14 Lab of Performance QA Team.
And here you can see fresh test results for 9.1 RC2 (snapshot 315):
---------------------------
- short run: <substitute this part with TestRail host address>/index.php?/runs/view/22009&group_by=cases:section_id&group_order=asc
- long run: <substitute this part with TestRail host address>/index.php?/runs/view/22004&group_by=cases:section_id&group_order=asc
---------------------------
As you can see we have about 30% degradation for both authentication and validation time in compare to 9.0 release.
The results are almost the same for both runs. Test runs were performed on ENV-12 Lab of Performance QA Team.
The same tests were also performed nearly 2 weeks ago for the earlier 9.1 snapshot (form 14.09.2016-16:43:22)
---------------------------
<substitute this part with TestRail host address>/index.php?/runs/view/20843&group_by=cases:section_id&group_order=asc
---------------------------
No performance regression as you can see.
Test run was performed on ENV-13 Lab of Performance QA Team.
ENV-12 (master node ip: 172.16.44.12), ENV-14 (master node ip: 172.16.44.14) and ENV-13 (master node ip: 172.16.44.13) have the same hardware and configuraton of controlers. Hardware description can be found here:
---------------------------
<substitute this part with JIRA host address>/wiki/display/QA/Scale+lab+HW
---------------------------
A bit later I'll provide results of test run for 9.1 on ENV-14 and comparative stats of hardware resources consuming for 9.0 and 9.1 during Keystone tests were run. |
Looks like we got Keystone's performance degradation in 9.1 MU.
Here you can see fresh test results for 9.0 (build 945)
---------------------------
<substitute this part with TestRail host address>/index.php?/runs/view/22023&group_by=cases:section_id&group_order=asc
---------------------------
Test run was performed on ENV-14 Lab of Performance QA Team.
And here you can see fresh test results for 9.1 RC2 (snapshot 315):
---------------------------
- short run: <substitute this part with TestRail host address>/index.php?/runs/view/22009&group_by=cases:section_id&group_order=asc
- long run: <substitute this part with TestRail host address>/index.php?/runs/view/22004&group_by=cases:section_id&group_order=asc
---------------------------
As you can see we have about 30% degradation for both authentication and validation time in compare to 9.0 release.
The results are almost the same for both runs. Test runs were performed on ENV-12 Lab of Performance QA Team.
The same tests were also performed nearly 2 weeks ago for the earlier 9.1 snapshot (form 14.09.2016-16:43:22)
---------------------------
<substitute this part with TestRail host address>/index.php?/runs/view/20843&group_by=cases:section_id&group_order=asc
---------------------------
No performance regression as you can see.
Test run was performed on ENV-13 Lab of Performance QA Team.
ENV-12, ENV-14 and ENV-13 have the same hardware and configuraton of controlers. Hardware description can be found here:
---------------------------
<substitute this part with JIRA host address>/wiki/display/QA/Scale+lab+HW
---------------------------
A bit later I'll provide results of test run for 9.1 on ENV-14 and comparative stats of hardware resources consuming for 9.0 and 9.1 during Keystone tests were run. |
|
| 2016-09-29 07:15:15 |
Alexander Petrov |
bug |
|
|
added subscriber Alexander Petrov |
| 2016-09-29 09:51:53 |
Vitaly Sedelnik |
mos: status |
New |
Confirmed |
|
| 2016-09-30 13:19:28 |
Boris Bobrov |
mos: assignee |
Pavel (p.petrov) |
Boris Bobrov (bbobrov) |
|
| 2016-09-30 15:40:16 |
Boris Bobrov |
mos: status |
Confirmed |
In Progress |
|
| 2016-10-03 12:08:40 |
Alexander Makarov |
mos: status |
In Progress |
Fix Committed |
|
| 2016-10-03 12:26:54 |
Boris Bobrov |
mos: status |
Fix Committed |
In Progress |
|
| 2016-10-03 15:32:59 |
Boris Bobrov |
mos: status |
In Progress |
Fix Committed |
|
| 2016-10-05 10:53:53 |
Timur Nurlygayanov |
mos: status |
Fix Committed |
Fix Released |
|
| 2017-04-20 15:47:27 |
Boris Bobrov |
mos: assignee |
Boris Bobrov (bbobrov) |
|
|
