pip<10 does not support latest virtualenv (16.3.0)

[Arun S A G]

Devstack caps pip version to <10[1] and pip installed by devstack does not support 'pip config list' command. However the latest virtualenv(latest) force upgraded[2] by devstack requires this command to succeed[3]

[1] https://github.com/openstack-dev/devstack/blob/master/tools/cap-pip.txt
[2] https://github.com/openstack-dev/devstack/blob/master/tools/fixup_stuff.sh#L243
[3] https://github.com/pypa/virtualenv/blob/master/virtualenv.py#L1032

Steps to reproduce:

local.conf
==========
[[local|localrc]]

USE_VENV=True
RECLONE=False
PROJECT_VENV["glance"]=${GLANCE_DIR}.venv
PROJECT_VENV["nova"]=${NOVA_DIR}.venv
PROJECT_VENV["keystone"]=${KEYSTONE_DIR}.venv
PROJECT_VENV["neutron"]=${NEUTRON_DIR}.venv

GIT_BASE=https://github.com/openstack
KEYSTONE_REPO=$GIT_BASE/keystone.git
NOVA_REPO=$GIT_BASE/nova.git
GLANCE_REPO=$GIT_BASE/glance.git
NEUTRON_REPO=$GIT_BASE/neutron.git
REQUIREMENTS_REPO=$GIT_BASE/requirements.git
REQUIREMENTS_BRANCH=stable/ocata

KEYSTONE_BRANCH=stable/ocata
NOVA_BRANCH=stable/ocata
NEUTRON_BRANCH=stable/ocata
GLANCE_BRANCH=stable/ocata
#CINDER_BRANCH=stable/ocata
#HEAT_BRANCH=stable/ocata
DOWNLOAD_DEFAULT_IMAGES=True

ADMIN_PASSWORD=adminsecretpass
DATABASE_PASSWORD=stackdb
RABBIT_PASSWORD=stackqueue
SERVICE_PASSWORD=$ADMIN_PASSWORD
FIXED_RANGE=172.31.1.0/24
FIXED_NETWORK_SIZE=256
#IPV4_ADDRS_SAFE_TO_USE=172.31.1.0/24
FLOATING_RANGE=192.168.20.0/25

LOGFILE=$DEST/logs/stack.sh.log

LOGDAYS=2

disable_service n-novnc
disable_service horizon
disable_service cinder c-sch c-api c-vol
disable_service tempest
disable_service heat h-api h-api-cfn h-api-cw h-eng
disable_service ceilometer-acompute ceilometer-acentral ceilometer-collector ceilometer-api
disable_service s-proxy s-object s-container s-account
# Enable nova-network and disable neutron
disable_service neutron q-agt q-dhcp q-l3 q-meta q-svc
enable_service n-net
[[post-config|$NOVA_CONF]]
[DEFAULT]
osapi_compute_workers = 8

[conductor]
workers = 8

Run ./stack.sh (this local.conf uses stable/ocata, the problem should be still reproducible in masteR)

[Jay Pipes (jaypipes)]

Please note that upstream CI is likely hiding this issue due to this line in the fix_stuff.sh script:

https://github.com/openstack-dev/devstack/blob/master/tools/fixup_stuff.sh#L244

    if [[ ! -f /etc/ci/mirror_info.sh ]]; then

Clearly downstream CI systems don't have that file, and therefore the code that comes after it:

        pip_install -U --force-reinstall virtualenv

is problematic (since it upgrades to a version of virtualenv that, as Arun says, is incompatible with the version of pip that is locked by devstack).

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/634822

[OpenStack Infra (hudson-openstack)]

Change abandoned by Arun S A G (<email address hidden>) on branch: master
Review: https://review.openstack.org/634822
Reason: Abandoning in favor of https://review.openstack.org/#/c/561597/9

[Dr. Jens Harbott (j-harbott)]

We have finally uncapped pip again, so this should be fixed.