Steps to repsroduce:
1. Deploy Ha (Centos, ubuntu)
2. shot down one of the controller
3. Run ostf
Actual result:
Ha tests failed:
Check amount of tables in databases is the same on each node -
Time limit exceeded while waiting for detect mysql node to finish. Please refer to OpenStack logs for more details.
Check data replication over mysql
- Time limit exceeded while waiting for detect mysql node to finish. Please refer to OpenStack logs for more details.
But this tests fails according test data was not replicated (SSHExecCommandFailed: Command 'mysql -e 'DROP DATABASE ost1484'', exit status: 1, Error:
ERROR 1008 (HY000) at line 1: Can't drop database 'ost1484'; database doesn't exist)
Expected:
1. Tests may fails but descriptive message must show
2. for those tests where we ssh on controller and examine status on mysql on each controller - we should use here only online nodes
We should first determine if a node is online or not and then if mysql is up. If there is a quorum between the remaining nodes, we should warn that all nodes aren't online instead of a vague failure message