failed deploy of one of controllers: "failed to open gcomm backend connection: 98: error while trying to listen 'tcp://192.168.0.185:4567?socket.non_blocking=1', asio error 'Address already in use': 98 (Address already in use)"

[Leontii Istomin]

Detailed bug description:
Deployment has been failed on one of controller nodes:
from astute.log: http://paste.openstack.org/show/495896/
from puppet.log on controller node-172: http://paste.openstack.org/show/495897/
root@node-172:~# mysql -e "show status like 'wsrep%'";
ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (111)
On other two controller nodes I can successfully execute the command above:
node-131: http://paste.openstack.org/show/495898/
node-135: http://paste.openstack.org/show/495899/
from /var/log/mysqld.log on node-172: http://paste.openstack.org/show/495895/
root@node-172:~# netstat -antp | grep 4567
root@node-172:~#
Steps to reproduce:
1. deploy fuel-9.0-272
2. fuel-agent has been updated: http://paste.openstack.org/show/495327/ due https://bugs.launchpad.net/fuel/+bug/1543233
3. patch has been applied to keep rotated logs http://paste.openstack.org/show/495857/
4. curl -s 'https://review.openstack.org/gitweb?p=openstack/fuel-web.git;a=patch;h=225154b0e0f880a9395fa4e3583c2609db26ad19' | patch -b -d /usr/lib/python2.7/site-packages -p2 due https://bugs.launchpad.net/fuel/+bug/1569859
5. curl -s 'https://review.openstack.org/gitweb?p=openstack/fuel-web.git;a=patch;h=56e8f17ad85dc25682212029cf2ac218036353c5' | patch -b -d /usr/lib/python2.7/site-packages -p2 due https://bugs.launchpad.net/fuel/+bug/1570509
6. service nailgun restart; service receiverd restart
7. LMA, ElasticSearch, Grafana plugins have been installed:
Expected results:
environment successfully deplyed
Actual result:
deployment failed
Reproducibility:
has been reproduced with 9.0-269 before
Workaround:
 <put your information here>
Impact:
deployment step
Description of the environment:
 Operation system: ubuntu
 Versions of components: MOS9.0
 Reference architecture: 3 controllers, 20 computes+Ceph, 175 computes, vxlan+dvr, ceph for all, LMA
 Network model: vxlan+dvr
 Related projects installed: lma
Additional information:
Diagnostic snapshot: http://mos-scale-share.mirantis.com/fuel-snapshot-2016-05-02_17-46-29.tar.gz

[Leontii Istomin (listomin)]

Diagnostic Snapshot from description is failed.
from repro with fuel-9.0-269:
from astute.log: http://paste.openstack.org/show/495855/
errors from puppet.log of controller node-145: http://paste.openstack.org/show/495854/
Diagnostic Snapshot: http://mos-scale-share.mirantis.com/fuel-snapshot-2016-05-02_06-45-53.tar.gz