Failure when installing Dashboard - python tools/install_venv.py

[Rob Neff]

On RHEL6.1
1. Follow Instructions for Dashboard Installation here:
http://docs.openstack.org/diablo/openstack-compute/admin/content/install-dashboard.html

2. Run python tools/install_venv.py

Result:
InstallationError: No files/directores in /home/rneff/OpenStackDashboardSrc/horizon/openstack-dashboard/.dashboard-venv/src/quantum (from dependency_links.txt)

Log:
  Using version 3.5.1 (newest of versions: 3.5.1, 3.5.1b1, 3.5, 3.5b1, 3.4, 3.4b2, 3.4b1, 3.3.1, 3.3, 3.2, 3.2b4, 3.2b3, 3.2b2, 3.2b1, 3.1, 3.1b1, 3.0.1, 3.0, 3.0b3, 2.85, 2.80, 2.78, 2.77, 2.8)
  Downloading from URL http://pypi.python.org/packages/source/c/coverage/coverage-3.5.1.tar.gz#md5=410d4c8155a4dab222f2bc51212d4a24 (from http://pypi.python.org/simple/coverage/)
  Running setup.py egg_info for package coverage
    running egg_info
    creating pip-egg-info/coverage.egg-info
    writing pip-egg-info/coverage.egg-info/PKG-INFO
    writing top-level names to pip-egg-info/coverage.egg-info/top_level.txt
    writing dependency_links to pip-egg-info/coverage.egg-info/dependency_links.txt
    writing entry points to pip-egg-info/coverage.egg-info/entry_points.txt
    writing manifest file 'pip-egg-info/coverage.egg-info/SOURCES.txt'
    warning: manifest_maker: standard file '-c' not found
    reading manifest file 'pip-egg-info/coverage.egg-info/SOURCES.txt'
    reading manifest template 'MANIFEST.in'
    no previously-included directories found matching 'test'
    writing manifest file 'pip-egg-info/coverage.egg-info/SOURCES.txt'
  Source in ./.dashboard-venv/build/coverage has version 3.5.1, which satisfies requirement coverage (from -r /home/rneff/OpenStackDashboardSrc/horizon/openstack-dashboard/tools/pip-requires (line 19))
Downloading/unpacking glance (from -r /home/rneff/OpenStackDashboardSrc/horizon/openstack-dashboard/tools/pip-requires (line 20))
  Getting page http://pypi.python.org/simple/glance
  URLs to search for versions for glance (from -r /home/rneff/OpenStackDashboardSrc/horizon/openstack-dashboard/tools/pip-requires (line 20)):
  * http://pypi.python.org/simple/glance/
  Getting page http://glance.openstack.org/
  Getting page https://launchpad.net/glance
  Analyzing links from page http://pypi.python.org/simple/glance/
    Found link http://pypi.python.org/packages/source/g/glance/glance-2011.3.tar.gz#md5=6e9561c6bd1e5df1d08d84879792cecc (from http://pypi.python.org/simple/glance/), version: 2011.3
    Found link http://pypi.python.org/packages/source/g/glance/glance-2011.2.tar.gz#md5=780939ee6b6bc1132a7a203d72a0a210 (from http://pypi.python.org/simple/glance/), version: 2011.2
    Found link http://pypi.python.org/packages/source/g/glance/glance-0.1.5.tar.gz#md5=f7c18cfa5193ab3cdf645645a4059361 (from http://pypi.python.org/simple/glance/), version: 0.1.5
    Found link http://pypi.python.org/packages/source/g/glance/glance-0.1.7.tar.gz#md5=e733713ccd23e4a6253386a47971cfb5 (from http://pypi.python.org/simple/glance/), version: 0.1.7
    Found link http://pypi.python.org/packages/source/g/glance/glance-0.1.6.tar.gz#md5=e5ee84d55adc302950d99198329608ac (from http://pypi.python.org/simple/glance/), version: 0.1.6
    Skipping link http://glance.openstack.org/ (from http://pypi.python.org/simple/glance/); not a file
    Skipping link https://launchpad.net/glance (from http://pypi.python.org/simple/glance/); not a file
  Analyzing links from page http://glance.openstack.org/
    Skipping link http://glance.openstack.org/_static/sphinxdoc.css (from http://glance.openstack.org/); unknown archive format: .css
    Skipping link http://glance.openstack.org/_static/pygments.css (from http://glance.openstack.org/); unknown archive format: .css
    Skipping link http://glance.openstack.org/_static/tweaks.css (from http://glance.openstack.org/); unknown archive format: .css
    Skipping link http://glance.openstack.org/identifiers.html (from http://glance.openstack.org/); unknown archive format: .html
    Skipping link http://glance.openstack.org/genindex.html (from http://glance.openstack.org/); unknown archive format: .html
    Skipping link http://glance.openstack.org/#concepts (from http://glance.openstack.org/); not a file
    Skipping link http://glance.openstack.org/#using-glance (from http://glance.openstack.org/); not a file
    Skipping link http://glance.openstack.org/#developer-docs (from http://glance.openstack.org/); not a file
    Skipping link http://glance.openstack.org/#outstanding-documentation-tasks (from http://glance.openstack.org/); not a file
    Skipping link http://glance.openstack.org/#indices-and-tables (from http://glance.openstack.org/); not a file
    Skipping link http://glance.openstack.org/_sources/index.txt (from http://glance.openstack.org/); unknown archive format: .txt
    Skipping link http://glance.openstack.org/#welcome-to-glance-s-documentation (from http://glance.openstack.org/); not a file
    Skipping link http://wiki.openstack.org (from http://glance.openstack.org/); not a file
    Skipping link http://glance.openstack.org/community.html (from http://glance.openstack.org/); unknown archive format: .html
    Skipping link http://glance.openstack.org/registries.html (from http://glance.openstack.org/); unknown archive format: .html
    Skipping link http://glance.openstack.org/statuses.html (from http://glance.openstack.org/); unknown archive format: .html
    Skipping link http://glance.openstack.org/formats.html (from http://glance.openstack.org/); unknown archive format: .html
    Skipping link http://glance.openstack.org/gettingstarted.html (from http://glance.openstack.org/); unknown archive format: .html
    Skipping link http://glance.openstack.org/installing.html (from http://glance.openstack.org/); unknown archive format: .html
    Skipping link http://glance.openstack.org/controllingservers.html (from http://glance.openstack.org/); unknown archive format: .html
    Skipping link http://glance.openstack.org/configuring.html (from http://glance.openstack.org/); unknown archive format: .html
    Skipping link http://glance.openstack.org/glance.html (from http://glance.openstack.org/); unknown archive format: .html
    Skipping link http://glance.openstack.org/glanceapi.html (from http://glance.openstack.org/); unknown archive format: .html
    Skipping link http://glance.openstack.org/client.html (from http://glance.openstack.org/); unknown archive format: .html
    Skipping link http://glance.openstack.org/authentication.html (from http://glance.openstack.org/); unknown archive format: .html
    Skipping link http://glance.openstack.org/cache.html (from http://glance.openstack.org/); unknown archive format: .html
    Skipping link http://glance.openstack.org/architecture.html (from http://glance.openstack.org/); unknown archive format: .html
    Skipping link http://glance.openstack.org/architecture.html#what-is-a-registry-server (from http://glance.openstack.org/); unknown archive format: .html
    Skipping link http://glance.openstack.org/architecture.html#what-is-a-store (from http://glance.openstack.org/); unknown archive format: .html
    Skipping link http://glance.openstack.org/installing.html#index-0 (from http://glance.openstack.org/); unknown archive format: .html
    Skipping link http://glance.openstack.org/installing.html#index-1 (from http://glance.openstack.org/); unknown archive format: .html
    Skipping link http://glance.openstack.org/installing.html#index-2 (from http://glance.openstack.org/); unknown archive format: .html
    Skipping link http://glance.openstack.org/installing.html#index-3 (from http://glance.openstack.org/); unknown archive format: .html
    Skipping link http://glance.openstack.org/registries.html#index-0 (from http://glance.openstack.org/); unknown archive format: .html
    Skipping link http://glance.openstack.org/py-modindex.html (from http://glance.openstack.org/); unknown archive format: .html
    Skipping link http://glance.openstack.org/search.html (from http://glance.openstack.org/); unknown archive format: .html
  Analyzing links from page https://launchpad.net/glance
    Skipping link https://launchpad.net/glance/+index (from https://launchpad.net/glance); not a file
    Skipping link https://launchpad.net/@@/launchpad.png (from https://launchpad.net/glance); unknown archive format: .png
    Skipping link http://feeds.launchpad.net/glance/announcements.atom (from https://launchpad.net/glance); unknown archive format: .atom
    Skipping link http://feeds.launchpad.net/glance/latest-bugs.atom (from https://launchpad.net/glance); unknown archive format: .atom
    Skipping link http://feeds.launchpad.net/glance/branches.atom (from https://launchpad.net/glance); unknown archive format: .atom
    Skipping link http://feeds.launchpad.net/glance/revisions.atom (from https://launchpad.net/glance); unknown archive format: .atom
    Skipping link https://fonts.googleapis.com/css?family=Ubuntu:400,400italic,700,700italic (from https://launchpad.net/glance); not a file
    Skipping link https://launchpad.net/+icing/rev14263/combo.css (from https://launchpad.net/glance); unknown archive format: .css
    Skipping link https://launchpad.net/glance/+login (from https://launchpad.net/glance); not a file
    Skipping link https://code.launchpad.net/glance (from https://launchpad.net/glance); not a file
    Skipping link https://bugs.launchpad.net/glance (from https://launchpad.net/glance); not a file
    Skipping link https://blueprints.launchpad.net/glance (from https://launchpad.net/glance); not a file
    Skipping link https://translations.launchpad.net/glance (from https://launchpad.net/glance); not a file
    Skipping link https://answers.launchpad.net/glance (from https://launchpad.net/glance); not a file
    Skipping link https://launchpad.net/%7ecorywright (from https://launchpad.net/glance); not a file
    Skipping link https://github.com/openstack/glance (from https://launchpad.net/glance); not a file
    Skipping link http://wiki.openstack.org/ (from https://launchpad.net/glance); not a file
    Skipping link https://launchpad.net/openstack (from https://launchpad.net/glance); not a file
    Skipping link https://launchpad.net/%7eglance-drivers (from https://launchpad.net/glance); not a file
    Skipping link https://launchpad.net/+help/driver.html (from https://launchpad.net/glance); unknown archive format: .html
    Skipping link https://launchpad.net/glance/essex (from https://launchpad.net/glance); not a file
    Skipping link https://code.launchpad.net/%7ehudson-openstack/glance/github (from https://launchpad.net/glance); not a file
    Skipping link http://bazaar.launchpad.net/%7ehudson-openstack/glance/github/files (from https://launchpad.net/glance); not a file
    Skipping link https://launchpad.net/glance/+rdf (from https://launchpad.net/glance); not a file
    Skipping link https://launchpad.net/glance/+series (from https://launchpad.net/glance); not a file
    Skipping link https://launchpad.net/glance/+milestones (from https://launchpad.net/glance); not a file
    Skipping link https://bugs.launchpad.net/glance/+bug/888372 (from https://launchpad.net/glance); not a file
    Skipping link https://bugs.launchpad.net/glance/+bug/888370 (from https://launchpad.net/glance); not a file
    Skipping link https://bugs.launchpad.net/glance/+bug/888343 (from https://launchpad.net/glance); not a file
    Skipping link https://bugs.launchpad.net/glance/+bug/888340 (from https://launchpad.net/glance); not a file
    Skipping link https://bugs.launchpad.net/glance/+bug/888284 (from https://launchpad.net/glance); not a file
    Skipping link https://launchpad.net/glance/+topcontributors (from https://launchpad.net/glance); not a file
    Skipping link https://launchpad.net/%7ejaypipes (from https://launchpad.net/glance); not a file
    Skipping link https://launchpad.net/%7ettx (from https://launchpad.net/glance); not a file
    Skipping link https://launchpad.net/%7ebcwaldon (from https://launchpad.net/glance); not a file
    Skipping link https://launchpad.net/%7erconradharris (from https://launchpad.net/glance); not a file
    Skipping link https://launchpad.net/%7ereynolds.chin (from https://launchpad.net/glance); unknown archive format: .chin
    Skipping link https://launchpad.net/glance/+packages (from https://launchpad.net/glance); not a file
    Skipping link https://launchpad.net/ubuntu/precise/+source/glance (from https://launchpad.net/glance); not a file
    Skipping link https://launchpad.net/ubuntu-leb/oneiric/+source/glance (from https://launchpad.net/glance); not a file
    Skipping link https://launchpad.net/ubuntu/oneiric/+source/glance (from https://launchpad.net/glance); not a file
    Skipping link https://launchpad.net/ubuntu/natty/+source/glance (from https://launchpad.net/glance); not a file
    Skipping link https://answers.launchpad.net/glance/+question/177431 (from https://launchpad.net/glance); not a file
    Skipping link https://answers.launchpad.net/glance/+question/177391 (from https://launchpad.net/glance); not a file
    Skipping link https://answers.launchpad.net/glance/+question/177275 (from https://launchpad.net/glance); not a file
    Skipping link https://answers.launchpad.net/glance/+question/177268 (from https://launchpad.net/glance); not a file
    Skipping link https://answers.launchpad.net/glance/+question/177079 (from https://launchpad.net/glance); not a file
    Skipping link https://blueprints.launchpad.net/glance/+spec/image-replication (from https://launchpad.net/glance); not a file
    Skipping link https://blueprints.launchpad.net/glance/+spec/glance-usage-notifications (from https://launchpad.net/glance); not a file
    Skipping link https://blueprints.launchpad.net/glance/+spec/glance-get-cmd (from https://launchpad.net/glance); not a file
    Skipping link https://blueprints.launchpad.net/glance/+spec/custom-disk-buffer (from https://launchpad.net/glance); not a file
    Skipping link https://blueprints.launchpad.net/glance/+spec/image-permissions-metadata (from https://launchpad.net/glance); not a file
    Skipping link https://bugs.launchpad.net/glance/+filebug (from https://launchpad.net/glance); not a file
    Skipping link https://answers.launchpad.net/glance/+addquestion (from https://launchpad.net/glance); not a file
    Skipping link https://blueprints.launchpad.net/glance/+addspec (from https://launchpad.net/glance); not a file
    Found link http://launchpad.net/glance/diablo/2011.3/+download/glance-2011.3.tar.gz (from https://launchpad.net/glance), version: 2011.3
    Skipping link https://launchpad.net/glance/+download (from https://launchpad.net/glance); not a file
    Skipping link https://launchpad.net/ (from https://launchpad.net/glance); not a file
    Skipping link https://launchpad.net/+tour (from https://launchpad.net/glance); not a file
    Skipping link https://help.launchpad.net/ (from https://launchpad.net/glance); not a file
    Skipping link http://canonical.com/ (from https://launchpad.net/glance); not a file
    Skipping link https://launchpad.net/legal (from https://launchpad.net/glance); not a file
    Skipping link https://launchpad.net/feedback (from https://launchpad.net/glance); not a file
    Skipping link http://blog.launchpad.net/ (from https://launchpad.net/glance); not a file
    Skipping link http://www.canonical.com/about-canonical/careers (from https://launchpad.net/glance); not a file
    Skipping link http://identi.ca/launchpadstatus (from https://launchpad.net/glance); not a file
    Skipping link https://dev.launchpad.net/ (from https://launchpad.net/glance); not a file
  Using version 2011.3 (newest of versions: 2011.3, 2011.3, 2011.2, 0.1.7, 0.1.6, 0.1.5)
  Downloading from URL http://pypi.python.org/packages/source/g/glance/glance-2011.3.tar.gz#md5=6e9561c6bd1e5df1d08d84879792cecc (from http://pypi.python.org/simple/glance/)
  Running setup.py egg_info for package glance
    Warning: DistUtilsExtra required to use i18n builders.
    To build glance with support for message catalogs, you need
      https://launchpad.net/python-distutils-extra >= 2.18
    running egg_info
    creating pip-egg-info/glance.egg-info
    writing pip-egg-info/glance.egg-info/PKG-INFO
    writing top-level names to pip-egg-info/glance.egg-info/top_level.txt
    writing dependency_links to pip-egg-info/glance.egg-info/dependency_links.txt
    writing manifest file 'pip-egg-info/glance.egg-info/SOURCES.txt'
    warning: manifest_maker: standard file '-c' not found
    reading manifest file 'pip-egg-info/glance.egg-info/SOURCES.txt'
    reading manifest template 'MANIFEST.in'
    warning: no files found matching 'ChangeLog'
    writing manifest file 'pip-egg-info/glance.egg-info/SOURCES.txt'
  Source in ./.dashboard-venv/build/glance has version 2011.3, which satisfies requirement glance (from -r /home/rneff/OpenStackDashboardSrc/horizon/openstack-dashboard/tools/pip-requires (line 20))
Obtaining quantum from git+https://github.com/openstack/quantum.git#egg=quantum (from -r /home/rneff/OpenStackDashboardSrc/horizon/openstack-dashboard/tools/pip-requires (line 22))
  Cloning https://github.com/openstack/quantum.git to ./.dashboard-venv/src/quantum
  Found command 'git' at '/usr/bin/git'
  Running command /usr/bin/git clone -q https://github.com/openstack/quantum.git /home/rneff/OpenStackDashboardSrc/horizon/openstack-dashboard/.dashboard-venv/src/quantum
  Running setup.py egg_info for package quantum
    Checking for virtual-env and easy_install
    done.
    Command 'egg' not found
No files/directores in /home/rneff/OpenStackDashboardSrc/horizon/openstack-dashboard/.dashboard-venv/src/quantum (from dependency_links.txt)
Exception information:
Traceback (most recent call last):
  File "/home/rneff/OpenStackDashboardSrc/horizon/openstack-dashboard/.dashboard-venv/lib/python2.6/site-packages/pip-1.0.2-py2.6.egg/pip/basecommand.py", line 126, in main
    self.run(options, args)
  File "/home/rneff/OpenStackDashboardSrc/horizon/openstack-dashboard/.dashboard-venv/lib/python2.6/site-packages/pip-1.0.2-py2.6.egg/pip/commands/install.py", line 223, in run
    requirement_set.prepare_files(finder, force_root_egg_info=self.bundle, bundle=self.bundle)
  File "/home/rneff/OpenStackDashboardSrc/horizon/openstack-dashboard/.dashboard-venv/lib/python2.6/site-packages/pip-1.0.2-py2.6.egg/pip/req.py", line 1007, in prepare_files
    finder.add_dependency_links(req_to_install.dependency_links)
  File "/home/rneff/OpenStackDashboardSrc/horizon/openstack-dashboard/.dashboard-venv/lib/python2.6/site-packages/pip-1.0.2-py2.6.egg/pip/req.py", line 323, in dependency_links
    return self.egg_info_lines('dependency_links.txt')
  File "/home/rneff/OpenStackDashboardSrc/horizon/openstack-dashboard/.dashboard-venv/lib/python2.6/site-packages/pip-1.0.2-py2.6.egg/pip/req.py", line 302, in egg_info_lines
    data = self.egg_info_data(filename)
  File "/home/rneff/OpenStackDashboardSrc/horizon/openstack-dashboard/.dashboard-venv/lib/python2.6/site-packages/pip-1.0.2-py2.6.egg/pip/req.py", line 254, in egg_info_data
    filename = self.egg_info_path(filename)
  File "/home/rneff/OpenStackDashboardSrc/horizon/openstack-dashboard/.dashboard-venv/lib/python2.6/site-packages/pip-1.0.2-py2.6.egg/pip/req.py", line 288, in egg_info_path
    raise InstallationError('No files/directores in %s (from %s)' % (base, filename))
InstallationError: No files/directores in /home/rneff/OpenStackDashboardSrc/horizon/openstack-dashboard/.dashboard-venv/src/quantum (from dependency_links.txt)

[Gabriel Hurley (gabriel-hurley)]

The original problem is a little farther up that log:

Obtaining quantum from git+https://github.com/openstack/quantum.git#egg=quantum (from -r /home/rneff/OpenStackDashboardSrc/horizon/openstack-dashboard/tools/pip-requires (line 22))
  Cloning https://github.com/openstack/quantum.git to ./.dashboard-venv/src/quantum
  Found command 'git' at '/usr/bin/git'
  Running command /usr/bin/git clone -q https://github.com/openstack/quantum.git /home/rneff/OpenStackDashboardSrc/horizon/openstack-dashboard/.dashboard-venv/src/quantum
  Running setup.py egg_info for package quantum
    Checking for virtual-env and easy_install
    done.
    Command 'egg' not found

It's actually not a problem in Horizon that killed it. It's quantum's setup.py that's dying for you.

FWIW, in the last week Horizon's environment installation has been cleaned up a fair bit. I can't say that it would succeed for you, though, as the problem lies in another project.

You should probably connect with the Quantum guys to help them get their setup.py working on RHEL.

If it turns out I'm wrong feel free to re-open this bug.

[Gabriel Hurley (gabriel-hurley)]

Second report here: https://answers.launchpad.net/horizon/+question/179151

Still not a bug in Horizon, but I'll reopen it and add Quantum as a related project.

[James Michael DuPont (jamesmikedupont)]

I have this problem as well on debian sid .

[Xaver Y.R. Chen (yrchen)]

I have this problem as well on Ubuntu 11.10

[Andrea Siringo (andrea-siringo)]

Same problem here, Ubuntu 11.10.
Is Quantum installation mandatory in order to run Horizon? I thought it isn't, according to http://wiki.openstack.org/OpenStackDashboard

[Gabriel Hurley (gabriel-hurley)]

The docs say that a quantum *endpoint* is optional. Sadly, the quantum API client is *not* optional from a code standpoint currently. And that client is bundled as part of the complete quantum python package. Manual installation of quantum into the dashboard environment followed by running run_tests.sh or install_venv.py again will allow you to proceed until Quantum's package management problemsare resolved.

[koolhead17 (koolhead17)]

Workaround 2 escape this bug :-

remove/comment-out quantum requirement from pip-requires file. Install dashboard without it.

Download quantum separately :-

wget https://github.com/openstack/quantum/zipball/2011.3.zip
unzip 2011.3.zip

Once its done :--

Source dashboard`s virtual environment path, in my case
$ source /opt/horizon/openstack-dashboard/.dashboard-venv/bin/activate

After that

$ python setup.py install
No virtual environment found...create one? (Y/n) n

And your done!!

thanks @kodapa for assisting me on this, hope it helps!!

[Devin Carlen (devcamcar)]

Hmm, it seems like for people using quantum and modules in general, being able to install them in the venv is still valuable. I suggest we add some flags to install_venv.py and make them optional?

[Gabriel Hurley (gabriel-hurley)]

I'm good with that solution. Dovetails with https://bugs.launchpad.net/horizon/+bug/893466. Controls will need to be added to both install_venv.py and run_tests.sh so it passes the right bits through to install_venv.py.

[koolhead17 (koolhead17)]

@Gabriel
Please see https://bugs.launchpad.net/horizon/+bug/897882

The existing pip-requires line:

-e git+https://github.com/openstack/quantum.git#egg=quantum

The new one from master:

-e git+https://github.com/openstack/quantum.git@stable/diablo#egg=quantum

Adding one line patch along with, this will close this bug.

[Jake Dahn (jakedahn)]

I fixed this the other day.

[koolhead17 (koolhead17)]

I don`t see it being fixed for Diablo.

Way to reproduce

git clone https://github.com/openstack/horizon
cd horizon
git checkout stable/diablo

vim openstack-dashboard/tools/pip-requires

-e git+https://github.com/openstack/quantum.git#egg=quantum
-e git+https://github.com/jacobian/openstack.compute.git#egg=openstack
-e git+https://github.com/cloudbuilders/openstackx.git#egg=openstackx
-e git://github.com/rackspace/python-novaclient.git#egg=python-novaclient

Am i missing something?