Admin node is not responding to any network interaction

Bug #1538542 reported by Alexandr Kostrikov
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Incomplete
High
Fuel QA Team

Bug Description

Due to CI servers cleaunup the only available logs are:

https://product-ci.infra.mirantis.net/job/8.0.system_test.ubuntu.offloading/118/console

2016-01-26 02:41:12,874 - INFO environment.py:434 -- Waiting for admin node to start up
2016-01-26 02:41:12,875 - INFO environment.py:436 -- Proceed with installation
2016-01-26 03:01:17,429 - INFO nailgun_client.py:28 -- Initiate Nailgun client with url http://10.109.10.2:8000
2016-01-26 03:01:17,429 - INFO http.py:28 -- Initiate HTTPClient with url http://10.109.10.2:8000
2016-01-26 03:01:17,439 - ERROR decorators.py:95 -- Fetching of diagnostic snapshot failed: Traceback (most recent call last):
  File "/home/jenkins/workspace/8.0.system_test.ubuntu.offloading/fuelweb_test/helpers/decorators.py", line 92, in wrapper
    create_diagnostic_snapshot(args[0].env, "fail", name)
  File "/home/jenkins/workspace/8.0.system_test.ubuntu.offloading/fuelweb_test/helpers/decorators.py", line 322, in create_diagnostic_snapshot
    task = env.fuel_web.task_wait(env.fuel_web.client.generate_logs(), 60 * 10)
  File "/home/jenkins/workspace/8.0.system_test.ubuntu.offloading/fuelweb_test/__init__.py", line 57, in wrapped
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/8.0.system_test.ubuntu.offloading/fuelweb_test/helpers/decorators.py", line 133, in wrapped
    response = func(*args, **kwargs)
  File "/home/jenkins/workspace/8.0.system_test.ubuntu.offloading/fuelweb_test/models/nailgun_client.py", line 355, in generate_logs
    return self.client.put("/api/logs/package")
  File "/home/jenkins/workspace/8.0.system_test.ubuntu.offloading/fuelweb_test/helpers/http.py", line 83, in put
    return self._open(req)
  File "/home/jenkins/workspace/8.0.system_test.ubuntu.offloading/fuelweb_test/helpers/http.py", line 92, in _open
    return self._get_response(req)
  File "/home/jenkins/workspace/8.0.system_test.ubuntu.offloading/fuelweb_test/helpers/http.py", line 116, in _get_response
    return self.opener.open(req)
  File "/usr/lib/python2.7/urllib2.py", line 404, in open
    response = self._open(req, data)
  File "/usr/lib/python2.7/urllib2.py", line 422, in _open
    '_open', req)
  File "/usr/lib/python2.7/urllib2.py", line 382, in _call_chain
    result = func(*args)
  File "/usr/lib/python2.7/urllib2.py", line 1214, in http_open
    return self.do_open(httplib.HTTPConnection, req)
  File "/usr/lib/python2.7/urllib2.py", line 1184, in do_open
    raise URLError(err)
URLError: <urlopen error [Errno 111] Connection refused>

2016-01-26 03:01:23,538 - ERROR decorators.py:102 -- Fetching of raw logs failed: Traceback (most recent call last):
  File "/home/jenkins/workspace/8.0.system_test.ubuntu.offloading/fuelweb_test/helpers/decorators.py", line 97, in wrapper
    with args[0].env.d_env.get_admin_remote()\
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/devops/models/environment.py", line 395, in get_admin_remote
    password=password)
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/devops/models/node.py", line 171, in remote
    password=password, private_keys=private_keys)
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/devops/helpers/helpers.py", line 237, in __init__
    self.reconnect()
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/devops/helpers/helpers.py", line 280, in reconnect
    self.connect()
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/devops/helpers/retry.py", line 27, in wrapper
    return func(*args, **kwargs)
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/devops/helpers/helpers.py", line 275, in connect
    password=self.password)
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/paramiko/client.py", line 311, in connect
    raise NoValidConnectionsError(errors)
NoValidConnectionsError: [Errno None] Unable to connect to port 22 on or 10.109.10.2

We need to wait for reproduce with available not-cleaned servers.

Tags: area-qa
Revision history for this message
Alexandr Kostrikov (akostrikov-mirantis) wrote :

We need further investigation.

Changed in fuel:
status: New → Incomplete
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.