A Jenkins job https://packaging-ci.infra.mirantis.net/job/8.0-pkg-systest-ubuntu/1849/ failed.
In the sys_test.log I see this:
2016-01-15 14:06:13,572 - ERROR decorators.py:102 -- Fetching of raw logs failed: Traceback (most recent call last):
File "/home/jenkins/workspace/8.0-pkg-systest-ubuntu/fuel-qa/fuelweb_test/helpers/decorators.py", line 97, in wrapper
with args[0].env.d_env.get_admin_remote()\
File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/devops/models/environment.py", line 397, in get_admin_remote
password=password)
File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/devops/models/node.py", line 171, in remote
password=password, private_keys=private_keys)
File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/devops/helpers/helpers.py", line 230, in __init__
self.reconnect()
File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/devops/helpers/helpers.py", line 273, in reconnect
self.connect()
File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/devops/helpers/retry.py", line 27, in wrapper
return func(*args, **kwargs)
File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/devops/helpers/helpers.py", line 268, in connect
password=self.password)
File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/paramiko/client.py", line 311, in connect
raise NoValidConnectionsError(errors)
NoValidConnectionsError: [Errno None] Unable to connect to port 22 on or 10.109.10.2
2016-01-15 14:06:13,572 - DEBUG decorators.py:104 -- (<fuelweb_test.tests.base_test_case.SetupEnvironment object at 0x7f5cae901e10>,)
2016-01-15 14:06:24,422 - DEBUG __init__.py:54 -- Calling: get_admin_node_ip with args: ([<class 'fuelweb_test.models.environment.EnvironmentModel'>(0x7f5cae6a3710), ip:10.109.10.2],) {}
2016-01-15 14:06:24,427 - DEBUG __init__.py:59 -- Done: get_admin_node_ip with result: 10.109.10.2
2016-01-15 14:06:24,427 - INFO decorators.py:305 -- <<<<<****************************************************************************************************>>>>>
2016-01-15 14:06:24,427 - INFO decorators.py:306 -- Failed in method 'setup_master'. Make snapshot: error_setup_master
2016-01-15 14:06:24,427 - INFO decorators.py:316 -- You could revert and ssh to master node: [source /home/jenkins/venv-nailgun-tests-2.9/bin/activate; dos.py revert-resume 8.0-pkg-systest-ubuntu-trusty.1849.1849 error_setup_master && ssh root@10.109.10.2]
2016-01-15 14:06:24,427 - INFO decorators.py:318 -- <<<<<****************************************************************************************************>>>>>
From the job console:
Prepare master node ... SKIP: Failure in <function setup_master at 0x7f5cb1757b18>
Deploy ceph HA with RadosGW for objects ... SKIP: Failure in <function setup_master at 0x7f5cb1757b18>
And in the job console:
======================================================================
ERROR: Create environment and set up master node
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/8.0-pkg-systest-ubuntu/fuel-qa/fuelweb_test/helpers/decorators.py", line 83, in wrapper
result = func(*args, **kwargs)
File "/home/jenkins/workspace/8.0-pkg-systest-ubuntu/fuel-qa/fuelweb_test/tests/base_test_case.py", line 141, in setup_master
self.env.setup_environment()
File "/home/jenkins/workspace/8.0-pkg-systest-ubuntu/fuel-qa/fuelweb_test/models/environment.py", line 441, in setup_environment
self.wait_for_provisioning()
File "/home/jenkins/workspace/8.0-pkg-systest-ubuntu/fuel-qa/fuelweb_test/__init__.py", line 57, in wrapped
result = func(*args, **kwargs)
File "/home/jenkins/workspace/8.0-pkg-systest-ubuntu/fuel-qa/fuelweb_test/models/environment.py", line 517, in wait_for_provisioning
(self.d_env.admin_net), 22), timeout=timeout)
File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/devops/helpers/helpers.py", line 108, in _wait
return raising_predicate()
File "/home/jenkins/workspace/8.0-pkg-systest-ubuntu/fuel-qa/fuelweb_test/models/environment.py", line 517, in <lambda>
(self.d_env.admin_net), 22), timeout=timeout)
File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/devops/helpers/helpers.py", line 56, in _tcp_ping
s.connect((str(host), int(port)))
File "/usr/lib/python2.7/socket.py", line 224, in meth
return getattr(self._sock,name)(*args)
error: [Errno 111] Connection refused
https://paste.mirantis.net/show/1743/
Paul, I think it is sporadic issue, could you provide other failure with this error?