verify-python-fuelclient job failing

[Ilya Kutukov]

Expected:
   job pass ok

Result:

Exception:
https://ci.fuel-infra.org/job/verify-python-fuelclient/1314/console

Traceback (most recent call last):
  File "/home/jenkins/workspace/verify-python-fuelclient_VENV/lib/python2.7/site-packages/virtualenv_support/pip-8.0.2-py2.py3-none-any.whl/pip/basecommand.py", line 209, in main
    status = self.run(options, args)
  File "/home/jenkins/workspace/verify-python-fuelclient_VENV/lib/python2.7/site-packages/virtualenv_support/pip-8.0.2-py2.py3-none-any.whl/pip/commands/install.py", line 299, in run
    requirement_set.prepare_files(finder)
  File "/home/jenkins/workspace/verify-python-fuelclient_VENV/lib/python2.7/site-packages/virtualenv_support/pip-8.0.2-py2.py3-none-any.whl/pip/req/req_set.py", line 359, in prepare_files
    ignore_dependencies=self.ignore_dependencies))
  File "/home/jenkins/workspace/verify-python-fuelclient_VENV/lib/python2.7/site-packages/virtualenv_support/pip-8.0.2-py2.py3-none-any.whl/pip/req/req_set.py", line 576, in _prepare_file
    session=self.session, hashes=hashes)
  File "/home/jenkins/workspace/verify-python-fuelclient_VENV/lib/python2.7/site-packages/virtualenv_support/pip-8.0.2-py2.py3-none-any.whl/pip/download.py", line 809, in unpack_url
    hashes=hashes
  File "/home/jenkins/workspace/verify-python-fuelclient_VENV/lib/python2.7/site-packages/virtualenv_support/pip-8.0.2-py2.py3-none-any.whl/pip/download.py", line 648, in unpack_http_url
    hashes)
  File "/home/jenkins/workspace/verify-python-fuelclient_VENV/lib/python2.7/site-packages/virtualenv_support/pip-8.0.2-py2.py3-none-any.whl/pip/download.py", line 841, in _download_http_url
    stream=True,
  File "/home/jenkins/workspace/verify-python-fuelclient_VENV/lib/python2.7/site-packages/virtualenv_support/pip-8.0.2-py2.py3-none-any.whl/pip/_vendor/requests/sessions.py", line 480, in get
    return self.request('GET', url, **kwargs)
  File "/home/jenkins/workspace/verify-python-fuelclient_VENV/lib/python2.7/site-packages/virtualenv_support/pip-8.0.2-py2.py3-none-any.whl/pip/download.py", line 377, in request
    return super(PipSession, self).request(method, url, *args, **kwargs)
  File "/home/jenkins/workspace/verify-python-fuelclient_VENV/lib/python2.7/site-packages/virtualenv_support/pip-8.0.2-py2.py3-none-any.whl/pip/_vendor/requests/sessions.py", line 468, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/jenkins/workspace/verify-python-fuelclient_VENV/lib/python2.7/site-packages/virtualenv_support/pip-8.0.2-py2.py3-none-any.whl/pip/_vendor/requests/sessions.py", line 576, in send
    r = adapter.send(request, **kwargs)
  File "/home/jenkins/workspace/verify-python-fuelclient_VENV/lib/python2.7/site-packages/virtualenv_support/pip-8.0.2-py2.py3-none-any.whl/pip/_vendor/cachecontrol/adapter.py", line 46, in send
    resp = super(CacheControlAdapter, self).send(request, **kw)
  File "/home/jenkins/workspace/verify-python-fuelclient_VENV/lib/python2.7/site-packages/virtualenv_support/pip-8.0.2-py2.py3-none-any.whl/pip/_vendor/requests/adapters.py", line 447, in send
    raise SSLError(e, request=request)
SSLError: [Errno 185090050] _ssl.c:344: error:0B084002:x509 certificate routines:X509_load_cert_crl_file:system lib
----------------------------------------
...Installing setuptools, pip, wheel...done.
Traceback (most recent call last):
  File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main
    "__main__", fname, loader, pkg_name)
  File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
    exec code in run_globals
  File "/home/jenkins/workspace/verify-python-fuelclient_VENV/lib/python2.7/site-packages/virtualenv.py", line 2284, in <module>
    main()
  File "/home/jenkins/workspace/verify-python-fuelclient_VENV/lib/python2.7/site-packages/virtualenv.py", line 703, in main
    symlink=options.symlink)
  File "/home/jenkins/workspace/verify-python-fuelclient_VENV/lib/python2.7/site-packages/virtualenv.py", line 904, in create_environment
    download=download,
  File "/home/jenkins/workspace/verify-python-fuelclient_VENV/lib/python2.7/site-packages/virtualenv.py", line 861, in install_wheel
    call_subprocess(cmd, show_stdout=False, extra_env=env)
  File "/home/jenkins/workspace/verify-python-fuelclient_VENV/lib/python2.7/site-packages/virtualenv.py", line 781, in call_subprocess
    % (cmd_desc, proc.returncode))
OSError: Command /home/jenkins/worksp...leanup/bin/python2.7 -c "import sys, pip; sys...d\"] + sys.argv[1:]))" setuptools pip wheel failed with error code 2

[Ilya Kutukov (ikutukov)]

Known issue for Ceph CI http://tracker.ceph.com/issues/14529

[Ilya Kutukov (ikutukov)]

There was a problem with a pypi repos.

https://status.python.org/incidents/nmjnchhjddjb

Monitoring
We have restored access to PyPI, but the search system may be flaky while we recover.
Posted about 9 hours ago. Feb 03, 2016 - 08:54 UTC

Investigating
PyPI is currently in static mode while we debug and outage on the frontend web servers.
Posted about 9 hours ago. Feb 03, 2016 - 08:08 UTC

[Ilya Kutukov (ikutukov)]

There was -> there is

[Roman Prykhodchenko (romcheg)]

Development is blocked by this issue, marking it as Critical

[Roman Prykhodchenko (romcheg)]

Looks like the bug is caused by old version of ndg-httpsclient that does not provide SNI support. After running pip install --upgrade ndg-httpsclient tests started working form me.

[Aleksandra Fedorova (bookwar)]

Adding root certificate file locally on the jenkins slave helps to workaround the problem currently. So moving to High

[Aleksandra Fedorova (bookwar)]

resolved in manifests