https://product-ci.infra.mirantis.net/view/8.0_swarm/job/8.0.system_test.ubuntu.cic_maintenance_mode/70/testReport/(root)/negative_auto_cic_maintenance_mode/negative_auto_cic_maintenance_mode/
Error Message
[Errno None] Unable to connect to port 22 on or 10.109.7.9
Stacktrace
Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/8.0.system_test.ubuntu.cic_maintenance_mode/fuelweb_test/helpers/decorators.py", line 81, in wrapper
result = func(*args, **kwargs)
File "/home/jenkins/workspace/8.0.system_test.ubuntu.cic_maintenance_mode/fuelweb_test/tests/tests_strength/test_cic_maintenance_mode.py", line 461, in negative_auto_cic_maintenance_mode
with self.fuel_web.get_ssh_for_node(devops_node.name) as remote:
File "/home/jenkins/workspace/8.0.system_test.ubuntu.cic_maintenance_mode/fuelweb_test/__init__.py", line 57, in wrapped
result = func(*args, **kwargs)
File "/home/jenkins/workspace/8.0.system_test.ubuntu.cic_maintenance_mode/fuelweb_test/models/fuel_web_client.py", line 963, in get_ssh_for_node
return self.environment.d_env.get_ssh_to_remote(node['ip'])
File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/devops/models/environment.py", line 394, in get_ssh_to_remote
private_keys=keys)
File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/devops/helpers/helpers.py", line 230, in __init__
self.reconnect()
File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/devops/helpers/helpers.py", line 273, in reconnect
self.connect()
File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/devops/helpers/retry.py", line 27, in wrapper
return func(*args, **kwargs)
File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/devops/helpers/helpers.py", line 260, in connect
password=self.password, pkey=private_key)
File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/paramiko/client.py", line 311, in connect
raise NoValidConnectionsError(errors)
NoValidConnectionsError: [Errno None] Unable to connect to port 22 on or 10.109.7.9
It looks like there is race condition: sometimes after executing command "reboot --force" target node doesn't keep pace with verification of establishment of ssh connection. and after it the next step of test fails because the target node is offline. The addition of waiter of losing of ssh connection will solve problem.