RDO upstream-centos-7 nodepool image is out of date

[wes hayutin]

This issue is blocking promotions in tripleo, so we'll be tracking it here.

 java.io.IOException: remote file operation failed: /home/jenkins/secretFiles/2e8a7a20-4d28-4944-8106-9fccf3330bfe at hudson.remoting.Channel@50cf9340:upstream-centos-7-rdo-cloud-tripleo-5295: java.io.IOException: java.lang.reflect.InvocationTargetException
...
 Caused by: java.lang.UnsatisfiedLinkError: no nio in java.library.path
(^ actual root-cause exception)

https://review.rdoproject.org/jenkins/job/periodic-tripleo-centos-7-pike-containers-build/70/console

https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset005-pike/109/console

https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset005-master/108/console

[Javier Peña (jpena-c)]

This issue is created by a combination of factors:

1- The upstream-centos-7 image in review.rdoproject.org is 1 week old.
2- During the job, "yum update" is executed, and openjdk is updated, removing some classes the Jenkins agent relies on, which causes the error message.

We need to update the image, but it is failing to build due to a devstack issue. We are waiting for https://review.openstack.org/504416 to merge (after the review.openstack.org update today), then we
can build new images.

[yatin (yatinkarel)]

Related patch https://review.openstack.org/504416 got merged.

[Javier Peña (jpena-c)]

Checking image builds, they are still not happening. This time, the error message we got is:

2017-09-19 01:26:29,761 INFO nodepool.image.build.upstream-centos-7: Caching networking-lagopus from git://git.openstack.org/openstack/networking-lagopus.git in /var/cache/nodepool/dib_cache/source-repositories/networking_lagopus_2f0992539c2d013ec7299c18283b3916df096487
2017-09-19 01:26:29,859 INFO nodepool.image.build.upstream-centos-7: fatal: remote error: access denied or repository not exported: /openstack/networking-lagopus.git

The networking-lagopus project was created yesterday [1] before the Gerrit upgrade, but there is no repository at git.openstack.org. Speaking to Yolanda Robla, she has confirmed that after the upgrade, projects are not being created. This should be fixed later today, when the North America-based Infra team starts working.

[Alex Schultz (alex-schultz)]

The networking-lagopus repo is now available. Is this still failing?

[David Moreau Simard (dmsimard)]

The image build was fixed when we landed the fix in https://review.rdoproject.org/r/#/c/9680/

Even though we were pinning 'project-config' to a known-working version, a nodepool element still retrieved the projects list from project-config on the master branch.

As far as I can see, the image finished uploading close to an hour ago and any new jobs using the upstream-centos-7 label should be using this new image.