[9.x][BVT] setup_master failed with "No route to host"

[Elena Ezhova]

The following BVT job [0] failed to setup master node due to connectivity issues.

<<<<<##############################[ setup_master ]##############################>>>>>
Create environment and set up master node

        Snapshot: empty

2016-12-04 18:01:15 - INFO environment.py:409 -- Waiting for admin node to start up
2016-12-04 18:01:15 - INFO environment.py:412 -- Proceed with installation
2016-12-04 18:21:21 - ERROR log_helpers.py:229 -- Failed:
'wait_for_provisioning'(
    'self'=[<class 'fuelweb_test.models.environment.EnvironmentModel'>(0x7f346d940f90), ip:None],
    'timeout'=1200,
)
Traceback (most recent call last):
  File "/home/jenkins/workspace/9.x.main.ubuntu.bvt_2/core/helpers/log_helpers.py", line 215, in wrapped
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/9.x.main.ubuntu.bvt_2/fuelweb_test/models/environment.py", line 492, in wait_for_provisioning
    ('admin'), 22), timeout=timeout)
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/devops/helpers/helpers.py", line 126, in wait_pass
    return raising_predicate()
  File "/home/jenkins/workspace/9.x.main.ubuntu.bvt_2/fuelweb_test/models/environment.py", line 492, in <lambda>
    ('admin'), 22), timeout=timeout)
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/devops/helpers/helpers.py", line 67, in tcp_ping_
    s.connect((str(host), int(port)))
  File "/usr/lib/python2.7/socket.py", line 224, in meth
    return getattr(self._sock,name)(*args)
error: [Errno 111] Connection refused
2016-12-04 18:21:21 - INFO environment.py:427 -- Master node restart: LP1587411
2016-12-04 18:21:21 - INFO environment.py:428 -- Exception is: [Errno 111] Connection refused
2016-12-04 18:21:21 - INFO environment.py:409 -- Waiting for admin node to start up
2016-12-04 18:21:21 - INFO environment.py:412 -- Proceed with installation
2016-12-04 18:41:29 - ERROR log_helpers.py:229 -- Failed:
'wait_for_provisioning'(
    'self'=[<class 'fuelweb_test.models.environment.EnvironmentModel'>(0x7f346d940f90), ip:None],
    'timeout'=1200,
)
Traceback (most recent call last):
  File "/home/jenkins/workspace/9.x.main.ubuntu.bvt_2/core/helpers/log_helpers.py", line 215, in wrapped
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/9.x.main.ubuntu.bvt_2/fuelweb_test/models/environment.py", line 492, in wait_for_provisioning
    ('admin'), 22), timeout=timeout)
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/devops/helpers/helpers.py", line 126, in wait_pass
    return raising_predicate()
  File "/home/jenkins/workspace/9.x.main.ubuntu.bvt_2/fuelweb_test/models/environment.py", line 492, in <lambda>
    ('admin'), 22), timeout=timeout)
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/devops/helpers/helpers.py", line 67, in tcp_ping_
    s.connect((str(host), int(port)))
  File "/usr/lib/python2.7/socket.py", line 224, in meth
    return getattr(self._sock,name)(*args)
error: [Errno 113] No route to host

[0] https://product-ci.infra.mirantis.net/job/9.x.main.ubuntu.bvt_2/596

[Dmitry Kaigarodеsev (dkaiharodsev)]

seems like not related to CI, same slave without mentioned error a bit later:
https://product-ci.infra.mirantis.net/job/9.x.main.ubuntu.bvt_2/614/console

[Elena Ezhova (eezhova)]

This bug can be related to https://bugs.launchpad.net/fuel/+bug/1587411
Perhaps Alexandr Kostrikov can verify this.