Tox exhausting /tmp partition

Bug #1490354 reported by Jamie Lennox
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Identity (keystone)
Fix Released
Medium
Jamie Lennox

Bug Description

So every time i tried to run tox i was getting the error message that /tmp was out of space when trying to create the virtual env which means that creating the virtualenv was filling a 3gb partition.

In our tox requirements we currently have:

deps = -r{toxinidir}/requirements.txt
       -r{toxinidir}/test-requirements.txt
       .[ldap]
       .[memcache]
       .[mongodb]

By having each of those additional dependencies listed as .[XXX] tox is installing . (the keystone working directory) into a virtualenv then determining the entry point. This created 3 seperate /tmp/pip-XXX-build directories. The other side of this is that my keystone/.testrepository folder is now 994M so when tox copied this to tmp 3 times and then tried to install all the dependencies it doesn't leave much space.

There are two fixes to this:
1. reset my .testrepository database
2. dependencies should be listed together like .[XXX,YYY,ZZZ] so . is only copied once

As an addition to this because we are installing dependencies with .[XXX] which means install . (working directory/keystone) + XXX dependencies there is no reason to specifically install -r requirements.txt as this will be handled for us.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to keystone (master)

Fix proposed to branch: master
Review: https://review.openstack.org/218693

Changed in keystone:
assignee: nobody → Jamie Lennox (jamielennox)
status: New → In Progress
Revision history for this message
Dolph Mathews (dolph) wrote :

Henry Nash and I ran into this as well; I didn't realize it was a problem in Keystone itself! Nice work.

Changed in keystone:
importance: Undecided → Medium
milestone: none → liberty-rc1
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to keystone (master)

Reviewed: https://review.openstack.org/218693
Committed: https://git.openstack.org/cgit/openstack/keystone/commit/?id=766f051856405f4fd86893c0afa771a25c1ccec3
Submitter: Jenkins
Branch: master

commit 766f051856405f4fd86893c0afa771a25c1ccec3
Author: Jamie Lennox <email address hidden>
Date: Mon Aug 31 10:41:11 2015 +1000

    Group tox optional dependencies

    Group the additional dependencies for tox. The way they are specified
    now means that the working directory is copied into /tmp 3 times, one
    for each . which can cause space issues.

    Also removes specifically installing requirements.txt as this will be
    handled for the dependencies of .

    Change-Id: Ia2c86c70f059c6352586221e13857e5bd17ae37c
    Closes-Bug: #1490354

Changed in keystone:
status: In Progress → Fix Committed
Thierry Carrez (ttx)
Changed in keystone:
status: Fix Committed → Fix Released
Thierry Carrez (ttx)
Changed in keystone:
milestone: liberty-rc1 → 8.0.0
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.