Activity log for bug #1838411

Date Who What changed Old value New value Message
2019-07-30 13:04:20 Yang Liu bug added bug
2019-07-30 13:04:20 Yang Liu attachment added ALL_NODES_20190726.172307.tar https://bugs.launchpad.net/bugs/1838411/+attachment/5280014/+files/ALL_NODES_20190726.172307.tar
2019-07-30 13:04:37 Yang Liu description Brief Description ----------------- It takes more than 1.5 minutes for 'openstack server list' to recover after a uncontrolled swact on a standard system Severity -------- Major Steps to Reproduce ------------------ Test pre-conditions: - ensure stx-openstack application is applied via system application-list - helm list –a shows all releases (eg: garbd, cinder, nova, etc) are in status = DEPLOYED state - kubectl get pods -n openstack -o wide -w |grep -iEv "running|completed|cinder-volume-usage-audit|heat-engine-cleaner" shows no pods - openstack server list --all-projects command works Test steps: # On active controller (it was controller-0 for the test): $ sudo su $ date;reboot -f Fri Jul 26 15:38:56 UTC 2019 # On controller-1: $ while true; do date; timeout 10s openstack server list --all-projects; done Fri Jul 26 15:39:33 UTC 2019 Fri Jul 26 15:39:43 UTC 2019 Fri Jul 26 15:39:53 UTC 2019 Fri Jul 26 15:40:03 UTC 2019 Fri Jul 26 15:40:13 UTC 2019 Fri Jul 26 15:40:23 UTC 2019 +--------------------------------------+-----------------+--------+-----------------------------------------------------------------------------------------+-------+--------+ | ID | Name | Status | Networks | Image | Flavor | +--------------------------------------+-----------------+--------+-----------------------------------------------------------------------------------------+-------+--------+ | d1aa58d2-7238-4781-a7d3-aef712222980 | tenant1-virtio1 | ACTIVE | internal0-net0-2=10.2.2.207; tenant1-mgmt-net=192.168.116.53; tenant1-net2=172.16.2.220 | | small | +--------------------------------------+-----------------+--------+-----------------------------------------------------------------------------------------+-------+--------+ Fri Jul 26 15:40:25 UTC 2019 TC-name: KPI - uncontrolled swact Expected Behavior ------------------ Less than 1 minute Actual Behavior ---------------- Total time for 'openstack server list' to recover after uncontrolled swact: ~1m29s Reproducibility --------------- Reproducible System Configuration -------------------- Standard system Lab-name: ironpass-33-36 Branch/Pull Time/Commit ----------------------- stx master as of 20190725T013000Z Last Pass --------- STX R1 Timestamp/Logs -------------- See Test Steps for timestamps Test Activity ------------- Regression Testing Brief Description ----------------- It takes about 1.5 minutes for 'openstack server list' to recover after a uncontrolled swact on a standard system Severity -------- Major Steps to Reproduce ------------------ Test pre-conditions: - ensure stx-openstack application is applied via system application-list - helm list –a shows all releases (eg: garbd, cinder, nova, etc) are in status = DEPLOYED state - kubectl get pods -n openstack -o wide -w |grep -iEv "running|completed|cinder-volume-usage-audit|heat-engine-cleaner" shows no pods - openstack server list --all-projects command works Test steps: # On active controller (it was controller-0 for the test): $ sudo su $ date;reboot -f Fri Jul 26 15:38:56 UTC 2019 # On controller-1: $ while true; do date; timeout 10s openstack server list --all-projects; done Fri Jul 26 15:39:33 UTC 2019 Fri Jul 26 15:39:43 UTC 2019 Fri Jul 26 15:39:53 UTC 2019 Fri Jul 26 15:40:03 UTC 2019 Fri Jul 26 15:40:13 UTC 2019 Fri Jul 26 15:40:23 UTC 2019 +--------------------------------------+-----------------+--------+-----------------------------------------------------------------------------------------+-------+--------+ | ID | Name | Status | Networks | Image | Flavor | +--------------------------------------+-----------------+--------+-----------------------------------------------------------------------------------------+-------+--------+ | d1aa58d2-7238-4781-a7d3-aef712222980 | tenant1-virtio1 | ACTIVE | internal0-net0-2=10.2.2.207; tenant1-mgmt-net=192.168.116.53; tenant1-net2=172.16.2.220 | | small | +--------------------------------------+-----------------+--------+-----------------------------------------------------------------------------------------+-------+--------+ Fri Jul 26 15:40:25 UTC 2019 TC-name: KPI - uncontrolled swact Expected Behavior ------------------ Less than 1 minute Actual Behavior ---------------- Total time for 'openstack server list' to recover after uncontrolled swact: ~1m29s Reproducibility --------------- Reproducible System Configuration -------------------- Standard system Lab-name: ironpass-33-36 Branch/Pull Time/Commit ----------------------- stx master as of 20190725T013000Z Last Pass --------- STX R1 Timestamp/Logs -------------- See Test Steps for timestamps Test Activity ------------- Regression Testing
2019-07-30 22:40:39 Maria Guadalupe Perez Ibara tags stx.regression
2019-07-31 12:35:18 Numan Waheed tags stx.regression stx.regression stx.retestneeded
2019-07-31 17:36:33 Ghada Khalil tags stx.regression stx.retestneeded stx.2.0 stx.containers stx.regression stx.retestneeded
2019-07-31 17:36:37 Ghada Khalil starlingx: importance Undecided Medium
2019-07-31 17:36:39 Ghada Khalil starlingx: status New Triaged
2019-07-31 17:37:27 Ghada Khalil starlingx: assignee Tao Liu (tliu88)
2019-08-01 18:22:45 Frank Miller starlingx: assignee Tao Liu (tliu88) Daniel Badea (daniel.badea)
2019-08-09 17:51:03 Frank Miller starlingx: assignee Daniel Badea (daniel.badea) Bart Wensley (bartwensley)
2019-08-15 13:55:53 Frank Miller tags stx.2.0 stx.containers stx.regression stx.retestneeded stx.3.0 stx.containers stx.regression stx.retestneeded
2019-08-31 12:16:57 haitao wang bug added subscriber haitao wang
2019-09-10 17:37:30 Bill Zvonar bug added subscriber Bill Zvonar
2019-10-16 18:06:48 Bill Zvonar removed subscriber Bill Zvonar
2019-12-11 15:30:33 Frank Miller tags stx.3.0 stx.containers stx.regression stx.retestneeded stx.4.0 stx.containers stx.regression stx.retestneeded
2019-12-13 18:03:42 Frank Miller tags stx.4.0 stx.containers stx.regression stx.retestneeded stx.containers stx.regression stx.retestneeded
2019-12-13 18:03:49 Frank Miller starlingx: importance Medium Low
2020-06-02 14:10:20 Bart Wensley starlingx: assignee Bart Wensley (bartwensley) Frank Miller (sensfan22)
2023-02-07 14:35:37 Ramaswamy Subramanian starlingx: status Triaged Won't Fix