[Update] MySQL server is not reachable after update cluster from 9.1 to 9.2

[Ilya Bumarskov]

Fuel 9.2 snapshot-id#616

Steps to reproduce:
   - Deploy 9.1 env with following nodes:
         * Controller
         * Compute, cinder
         * Compute, cinder
   - Install mos-playbooks tool on master (yum install -y http://mirror.fuel-infra.org/mos-repos/centos/mos9.0-centos7/snapshots/proposed-latest/x86_64/Packages/mos-release-9.2-0.1.beta.el7.noarch.rpm && yum install -y mos-playbooks)
   - Execute preparation playbooks (ansible-playbook playbooks/mos9_prepare_fuel.yml && ansible-playbook playbooks/mos9_prepare_env.yml -e '{"env_id":1, "snapshot_repo":"9.0-2016-12-09-192322"}')
   - Update fuel node (ansible-playbook playbooks/update_fuel.yml -e '{"rebuild_bootstrap":false}')
   - Update env (fuel2 update install --env 1 --repos mos9.2)
   - Upgrade kernel on 4.4 (ansible-playbook playbooks/mos9_env_upgrade_kernel_4.4.yml -e '{"env_id":1}')
   - Restart all nodes in environment (ansible-playbook playbooks/restart_env.yml -e '{"env_id":1}')
   - Run OSTF

Observed behavior:
Failed 6 OSTF tests; should fail 0 tests. Names of failed tests:
  - Create volume and boot instance from it (failure) Instance creation failed. Please refer to OpenStack logs for more details.
  - Create volume and attach it to instance (failure) Instance creation failed. Please refer to OpenStack logs for more details.
  - Check network connectivity from instance via floating IP (failure) Server can not be created. Please refer to OpenStack logs for more details.
  - Launch instance (failure) Creating instance using the new security group has failed. Please refer to OpenStack logs for more details.
  - Launch instance with file injection (failure) Creating instance using the new security group has failed. Please refer to OpenStack logs for more details.
  - Launch instance, create snapshot, launch instance from snapshot (failure) Image can not be booted. Please refer to OpenStack logs for more details.

Nova and neutron can't connect to MySQL server: http://paste.openstack.org/show/592179/
Horizon also doesn't available.

[Anton Chevychalov (achevychalov)]

Wee need a timeout after env restart because it takes a time for pacemaker to start all services.

[Ilya Bumarskov (ibumarskov)]

Can't reproduce on snpashot-id #631