gate jobs failures

[Mark Vanderwiel]

Latest issue 9-12-2014

 + gem install bundler --no-rdoc --no-ri --verbose
2014-09-12 15:49:20.358 | ERROR: While executing gem ... (Errno::EACCES)
2014-09-12 15:49:20.358 | Permission denied - /var/lib/gems/1.9.1

Missing sudo

Latest issue 9-8-2014

ruby1.9.1 /usr/local/bin/bundle install --path=.bundle --jobs 1 --retry 3 --verbose
/usr/lib/ruby/1.9.1/rubygems/dependency.rb:247:in `to_specs': Could not find bundler (>= 0) amongst [] (Gem::LoadError)
from /usr/lib/ruby/1.9.1/rubygems/dependency.rb:256:in `to_spec'
from /usr/lib/ruby/1.9.1/rubygems.rb:1210:in `gem'
from /usr/local/bin/bundle:18:in `<main>'

Possible fix?
aptitude update
aptitude install -y ruby1.9.1 ruby1.9.1-dev wget libruby1.9.1 rubygems \
       irb1.9.1 ri1.9.1 rdoc1.9.1 \
    build-essential libopenssl-ruby1.9.1 libssl-dev zlib1g-dev
update-alternatives --install /usr/bin/ruby ruby /usr/bin/ruby1.9.1 20
update-alternatives --set ruby /usr/bin/ruby1.9.1
update-alternatives --install /usr/bin/gem gem /usr/bin/gem1.9.1 10
update-alternatives --set gem /usr/bin/gem1.9.1
gem update --no-rdoc --no-ri

latest issues

 + sudo apt-get install -y libgecode-dev
2014-09-04 14:25:43.120 | sudo: unable to resolve host bare-precise-hpcloud-b3-1924966
2014-09-04 14:25:43.122 | sudo: no tty present and no askpass program specified
2014-09-04 14:25:43.122 | Sorry, try again.
2014-09-04 14:25:43.123 | sudo: no tty present and no askpass program specified
2014-09-04 14:25:43.123 | Sorry, try again.
2014-09-04 14:25:43.123 | sudo: no tty present and no askpass program specified
2014-09-04 14:25:43.124 | Sorry, try again.
2014-09-04 14:25:43.124 | sudo: 3 incorrect password attempts

and

Gem::InstallError: berkshelf-api-client requires Ruby version >= 1.9.2.

New fix will be to
* move the revoke sudo step to after the bundler prep one
* use the ruby1.9.1 command prefix see https://github.com/openstack-infra/config/commit/3d26413212c2aaadfe9d7403d06e6abe3145aac7
* cleanup repo gate job to use other prep jobs

Previous attempt to fix this in Infra: https://review.openstack.org/#/c/117274/

A couple timing issues our gate jobs

At various times, we get this issue:

Installing dep-selector-libgecode (1.0.2) native extensions /usr/lib/ruby/1.9.1/rubygems/installer.rb:552:in `rescue in block in build_extensions': ERROR: Failed to build gem native extension. (Gem::Installer::ExtensionBuildError)
...
 -> make clean
2014-08-15 10:39:40.198 | (cd . && autoconf)
2014-08-15 10:39:40.198 | /bin/sh: 1: autoconf: not found
2014-08-15 10:39:40.198 | make: *** [configure] Error 127

And at other times we get a timeout/connection errors downloading a gem.

Make ruby bundler in gate more resilient by only running one job rather then multiple jobs in parallel and retry the bundler install operation 3 times rather then failing after first attempt for git requests and network issues.

Remove the following line:

bundle config --global jobs 8

As this appears to be causing issues when compiling native extensions in parallel.

Change this line from:
bundle install --path=.bundle

to:
bundle install --path=.bundle --jobs 1 --retry 3

Documentation for the --jobs and --retry can be found here: http://bundler.io/v1.5/bundle_install.html

https://review.openstack.org/#/c/114593/

The autoconf issue with compiling libgecode-dev appears to be related to running out a memory as this is a very large project to build.

The gecode 3.x library dependency is part of the berkshelf 3.x requirements. One good way avoid the large compile is doc'd in the berkshelf readme (https://github.com/opscode/dep-selector-libgecode)
using the system provided libraries instead of rebuilding them.

# install the system gecode 3.x libraries on precise
sudo apt-get install -y libgecode-dev
# use the system gecode
USE_SYSTEM_GECODE=1 gem install dep-selector-libgecode

[Mark Vanderwiel (vanderwl)]

Fixed with infra/config patches:

https://review.openstack.org/#/c/121164/
https://review.openstack.org/#/c/120116/
https://review.openstack.org/#/c/119884/
https://review.openstack.org/#/c/119094/
https://review.openstack.org/#/c/117274/