Brief Description
-----------------
It takes more than 1.5 minutes for 'openstack server list' to recover after a uncontrolled swact on a standard system
Severity
--------
Major
Steps to Reproduce
------------------
Test pre-conditions:
- ensure stx-openstack application is applied via system application-list
- helm list –a shows all releases (eg: garbd, cinder, nova, etc) are in status = DEPLOYED state
- kubectl get pods -n openstack -o wide -w |grep -iEv "running|completed|cinder-volume-usage-audit|heat-engine-cleaner" shows no pods
- openstack server list --all-projects command works
Test steps:
# On active controller (it was controller-0 for the test):
$ sudo su
$ date;reboot -f
Fri Jul 26 15:38:56 UTC 2019
# On controller-1:
$ while true; do date; timeout 10s openstack server list --all-projects; done
Fri Jul 26 15:39:33 UTC 2019
Fri Jul 26 15:39:43 UTC 2019
Fri Jul 26 15:39:53 UTC 2019
Fri Jul 26 15:40:03 UTC 2019
Fri Jul 26 15:40:13 UTC 2019
Fri Jul 26 15:40:23 UTC 2019
+--------------------------------------+-----------------+--------+-----------------------------------------------------------------------------------------+-------+--------+
| ID | Name | Status | Networks | Image | Flavor |
+--------------------------------------+-----------------+--------+-----------------------------------------------------------------------------------------+-------+--------+
| d1aa58d2-7238-4781-a7d3-aef712222980 | tenant1-virtio1 | ACTIVE | internal0-net0-2=10.2.2.207; tenant1-mgmt-net=192.168.116.53; tenant1-net2=172.16.2.220 | | small |
+--------------------------------------+-----------------+--------+-----------------------------------------------------------------------------------------+-------+--------+
Fri Jul 26 15:40:25 UTC 2019
TC-name:
KPI - uncontrolled swact
Expected Behavior
------------------
Less than 1 minute
Actual Behavior
----------------
Total time for 'openstack server list' to recover after uncontrolled swact: ~1m29s
Reproducibility
---------------
Reproducible
System Configuration
--------------------
Standard system
Lab-name:
ironpass-33-36
Branch/Pull Time/Commit
-----------------------
stx master as of 20190725T013000Z
Last Pass
---------
STX R1
Timestamp/Logs
--------------
See Test Steps for timestamps
Brief Description
-----------------
It takes more than 1.5 minutes for 'openstack server list' to recover after a uncontrolled swact on a standard system
Severity
--------
Major
Steps to Reproduce completed| cinder- volume- usage-audit| heat-engine- cleaner" shows no pods
------------------
Test pre-conditions:
- ensure stx-openstack application is applied via system application-list
- helm list –a shows all releases (eg: garbd, cinder, nova, etc) are in status = DEPLOYED state
- kubectl get pods -n openstack -o wide -w |grep -iEv "running|
- openstack server list --all-projects command works
Test steps: ------- ------- ------- ------- ----+-- ------- ------- -+----- ---+--- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- --+---- ---+--- -----+ ------- ------- ------- ------- ----+-- ------- ------- -+----- ---+--- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- --+---- ---+--- -----+ 7238-4781- a7d3-aef7122229 80 | tenant1-virtio1 | ACTIVE | internal0- net0-2= 10.2.2. 207; tenant1- mgmt-net= 192.168. 116.53; tenant1- net2=172. 16.2.220 | | small | ------- ------- ------- ------- ----+-- ------- ------- -+----- ---+--- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- ------- --+---- ---+--- -----+
# On active controller (it was controller-0 for the test):
$ sudo su
$ date;reboot -f
Fri Jul 26 15:38:56 UTC 2019
# On controller-1:
$ while true; do date; timeout 10s openstack server list --all-projects; done
Fri Jul 26 15:39:33 UTC 2019
Fri Jul 26 15:39:43 UTC 2019
Fri Jul 26 15:39:53 UTC 2019
Fri Jul 26 15:40:03 UTC 2019
Fri Jul 26 15:40:13 UTC 2019
Fri Jul 26 15:40:23 UTC 2019
+------
| ID | Name | Status | Networks | Image | Flavor |
+------
| d1aa58d2-
+------
Fri Jul 26 15:40:25 UTC 2019
TC-name:
KPI - uncontrolled swact
Expected Behavior
------------------
Less than 1 minute
Actual Behavior
----------------
Total time for 'openstack server list' to recover after uncontrolled swact: ~1m29s
Reproducibility
---------------
Reproducible
System Configuration ------- ------
-------
Standard system
Lab-name:
ironpass-33-36
Branch/Pull Time/Commit ------- ------- --
-------
stx master as of 20190725T013000Z
Last Pass
---------
STX R1
Timestamp/Logs
--------------
See Test Steps for timestamps
Test Activity
-------------
Regression Testing