"openstack server list" cmd hangs after standby controller reboot
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
StarlingX |
Fix Released
|
Medium
|
Bart Wensley |
Bug Description
Brief Description
-----------------
in DX system after "sudo reboot -f" standby controller, "openstack server list" cmd stop working
Severity
--------
Major
Steps to Reproduce
------------------
as description
TC-name: test_evacuate.
Expected Behavior
------------------
"openstack server list" cmd should keep working when rebooting standby controller
Actual Behavior
----------------
not working
Reproducibility
---------------
Intermittent
System Configuration
-------
Two node system
Lab-name: WP_1-2
Branch/Pull Time/Commit
-------
stx master as of 20190621T013000Z
Last Pass
---------
Lab: WCP_71_75
Load: 20190620T013000Z
Timestamp/Logs
--------------
[2019-06-21 12:55:53,533] 423 DEBUG MainThread ssh.exec_cmd:: Executing command...
[2019-06-21 12:55:53,533] 268 DEBUG MainThread ssh.send :: Send 'openstack --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://
[2019-06-21 12:55:55,959] 387 DEBUG MainThread ssh.expect :: Output:
+------
| ID | Name | Status | Networks | Image | Flavor |
+------
| 3c06d27a-
| 5235d268-
| 9b9aa4a3-
| 9efe809a-
+------
controller-1:~$
[2019-06-21 12:58:01,981] 137 INFO MainThread host_helper.
[2019-06-21 12:58:01,981] 268 DEBUG MainThread ssh.send :: Send 'sudo reboot -f'
[2019-06-21 12:58:53,140] 268 DEBUG MainThread ssh.send :: Send 'openstack --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://
[2019-06-21 13:08:53,248] 358 WARNING MainThread ssh.expect :: No match found for ['.*controller\
expect timeout.
[2019-06-21 13:12:12,854] 268 DEBUG MainThread ssh.send :: Send 'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://
[2019-06-21 13:12:15,490] 387 DEBUG MainThread ssh.expect :: Output:
+----+-
| id | hostname | personality | administrative | operational | availability |
+----+-
| 1 | controller-0 | controller | unlocked | enabled | available |
| 2 | controller-1 | controller | unlocked | enabled | available |
+----+-
[2019-06-21 13:15:45,834] 268 DEBUG MainThread ssh.send :: Send 'openstack --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://
[2019-06-21 13:15:48,301] 387 DEBUG MainThread ssh.expect :: Output:
+------
| ID | Name | Status | Networks | Image | Flavor |
+------
| 3c06d27a-
Test Activity
-------------
Sanity
tags: | added: stx.retestneeded |
the tar file attached is only for controller-0. Please provide the controller-1 logs as well.