[queens promotion] - overcloud_prep_containers is failing with 'invalid header field value "oci runtime error: container_linux.go:247'

Bug #1750272 reported by Ronelle Landy
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Triaged
Critical
Unassigned

Bug Description

fs017 and fs030 are failing overcloud-prep-containers in the Queens promotion with:

 /usr/bin/docker-current: Error response from daemon: invalid header field value "oci runtime error: container_linux.go:247: starting container process caused \"process_linux.go:258: applying cgroup configuration for process caused \\\"open /sys/fs/cgroup/pids/system.slice/docker-a8064b00a9814820e5cadb89f41c270801fd7d1fa41e945ec48bfe2d1d574455.scope/cgroup.procs: no such file or directory\\\"\"\n".
....
2018-02-18 11:16:32 | 2018-02-18 11:16:32,495 ERROR: Failed running rpm -qa for 192.168.24.1:8787/queens/centos-binary-aodh-api:0be88d554b03a3337fc590217a0402b360ffed31_5889b624
2018-02-18 11:16:32 | 2018-02-18 11:16:32,495 ERROR: Unable to find image '192.168.24.1:8787/queens/centos-binary-aodh-api:0be88d554b03a3337fc590217a0402b360ffed31_5889b624' locally
ERROR: ERROR running rpm query in container: 192.168.24.1:8787/queens/centos-binary-aodh-api:0be88d554b03a3337fc590217a0402b360ffed31_5889b624

( or similar errors with centos-binary-memcached)

The full logs are included below:

https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset030-queens/6b3f702/undercloud/home/jenkins/overcloud_prep_containers.log.txt.gz

https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-queens/1fbe332/undercloud/home/jenkins/overcloud_prep_containers.log.txt.gz

Revision history for this message
Ronelle Landy (rlandy) wrote :

Marking this as promotion-blocker - will see if the error repeats in the next run

Changed in tripleo:
milestone: none → queens-rc1
importance: Undecided → Critical
status: New → Triaged
tags: added: ci promotion-blocker
Revision history for this message
Ronelle Landy (rlandy) wrote :
Revision history for this message
Ronelle Landy (rlandy) wrote :

https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/overcloud-prep-containers/templates/overcloud-prep-containers.sh.j2#L105

^^ this is the line that executes - we could execute that line with sudo but I am not sure if this is the correct approach.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.