check-swift-devstack-vm-functional fails fetching requirements from pypi.python.org

[Peter Portante]

check-swift-devstack-vm-functional fails fetching requirements from pypi.python.org.

Aren't we supposed to be using pypi.openstack.org?

See: https://jenkins02.openstack.org/job/check-swift-devstack-vm-functional/1689/console

2013-11-23 14:19:20.483 | 2013-11-23 14:19:20 + curl -O https://pypi.python.org/packages/source/p/pip/pip-1.4.1.tar.gz
2013-11-23 14:19:20.483 | 2013-11-23 14:19:20 curl: (6) Couldn't resolve host 'pypi.python.org'
2013-11-23 14:19:20.484 | 2013-11-23 14:19:20 ++ failed
2013-11-23 14:19:20.485 | 2013-11-23 14:19:20 ++ local r=1
2013-11-23 14:19:20.486 | 2013-11-23 14:19:20 +++ jobs -p
2013-11-23 14:19:20.487 | 2013-11-23 14:19:20 ++ kill
2013-11-23 14:19:20.488 | 2013-11-23 14:19:20 ++ set +o xtrace
2013-11-23 14:19:20.488 | 2013-11-23 14:19:20 stack.sh failed: full log in /opt/stack/new/devstacklog.txt.2013-11-23-141705
2013-11-23 14:19:23.012 | Build step 'Execute shell' marked build as failure

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/58099

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/58106

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/58106
Committed: http://github.com/openstack-infra/devstack-gate/commit/4bfb0605bcc759927fcece42972a79eaa7dae5af
Submitter: Jenkins
Branch: master

commit 4bfb0605bcc759927fcece42972a79eaa7dae5af
Author: Monty Taylor <email address hidden>
Date: Sat Nov 23 13:06:57 2013 -0500

    Use get-pip for pip installation

    Changes in devstack and nodepool will allow for pre-cached get-pip
    script to be used, instead of downloading from the internets. Enable
    the flag so that the cached script and the local mirror will be used
    for pip installation.

    Closes-Bug: #1254275
    Change-Id: Ia5f69073f7f9bab9b5554185df5681fbd178b91d

[Jeremy Stanley (fungi)]

https://review.openstack.org/58099 is still open (and in WIP status), so get-pip.py is getting downloaded, sometimes poorly, leading to execution failures.

[Jeremy Stanley (fungi)]

2013-12-14 01:19:59.708 | 2013-12-14 01:19:59 + [[ -n 0 ]]
2013-12-14 01:19:59.709 | 2013-12-14 01:19:59 + install_get_pip
2013-12-14 01:19:59.710 | 2013-12-14 01:19:59 + [[ ! -r /opt/stack/new/devstack/files/get-pip.py ]]
2013-12-14 01:19:59.711 | 2013-12-14 01:19:59 + cd /opt/stack/new/devstack/files
2013-12-14 01:19:59.712 | 2013-12-14 01:19:59 + curl -O https://raw.github.com/pypa/pip/master/contrib/get-pip.py
2013-12-14 01:19:59.713 | 2013-12-14 01:19:59 % Total % Received % Xferd Average Speed Time Time Time Current
2013-12-14 01:19:59.713 | 2013-12-14 01:19:59 Dload Upload Total Spent Left Speed
2013-12-14 01:19:59.714 | 2013-12-14 01:19:59
  0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
  0 0 0 0 0 0 0 0 --:--:-- 0:00:01 --:--:-- 0
  0 0 0 0 0 0 0 0 --:--:-- 0:00:02 --:--:-- 0
  0 422 0 0 0 0 0 0 --:--:-- 0:00:02 --:--:-- 0
100 422 100 422 0 0 160 0 0:00:02 0:00:02 --:--:-- 162
2013-12-14 01:19:59.715 | 2013-12-14 01:19:59 + sudo -E python /opt/stack/new/devstack/files/get-pip.py
2013-12-14 01:19:59.716 | 2013-12-14 01:19:59 File "/opt/stack/new/devstack/files/get-pip.py", line 2
2013-12-14 01:19:59.735 | 2013-12-14 01:19:59 <?xml version="1.0" encoding="utf-8"?>
2013-12-14 01:19:59.737 | 2013-12-14 01:19:59 ^
2013-12-14 01:19:59.738 | 2013-12-14 01:19:59 SyntaxError: invalid syntax
2013-12-14 01:19:59.738 | 2013-12-14 01:19:59 ++ failed
2013-12-14 01:19:59.739 | 2013-12-14 01:19:59 ++ local r=1
2013-12-14 01:19:59.740 | 2013-12-14 01:19:59 +++ jobs -p
2013-12-14 01:19:59.741 | 2013-12-14 01:19:59 ++ kill
2013-12-14 01:19:59.742 | 2013-12-14 01:19:59 ++ set +o xtrace
2013-12-14 01:19:59.743 | 2013-12-14 01:19:59 stack.sh failed: full log in /opt/stack/new/devstacklog.txt.2013-12-14-011909
2013-12-14 01:20:02.088 | Build step 'Execute shell' marked build as failure

[Clark Boylan (cboylan)]

This has been resolved in a couple of ways. First we cache the install pip script on all of our slave images. Then devstack was updated to use that cached script if it is available. You can see the devstack change at https://review.openstack.org/#/c/97912/.