master container build job is failing
c75527260bf212b21ce57998f1f0c668e4c53059_d032039d
# failing job (most recent as of 5/16)
https://review.rdoproject.org/jenkins/job/periodic-tripleo-centos-7-master-containers-build/907/consoleFull
12:55:08 TASK [rdo-kolla-build : Build and push images]
https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-centos-7-master-containers-build/6e68284/console.txt.gz#_2018-05-16_12_55_08_965
# Individual container build logs:
https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-centos-7-master-containers-build/6e68284/kolla/logs/
---
https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-centos-7-master-containers-build/6e68284/kolla/kolla-build.conf
https://trunk.rdoproject.org/centos7/c7/55/c75527260bf212b21ce57998f1f0c668e4c53059_d032039d/delorean.repo
https://trunk.rdoproject.org/centos7-master/delorean-deps.repo
tag = tripleo-ci-testing
template_override = /usr/share/openstack-tripleo-common-containers/container-images/tripleo_kolla_template_overrides.j2
template_override = /tmp/kolla/template-overrides.j2
---
ERROR:kolla.common.utils.neutron-l3-agent:received unexpected HTTP status: 504 Gateway Time-out
ERROR:kolla.common.utils.octavia-housekeeping:received unexpected HTTP status: 500 Internal Server Error
---
https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-centos-7-master-containers-build/6e68284/kolla/logs/neutron-l3-agent.log
INFO:kolla.common.utils.neutron-l3-agent:Successfully built 21412a799e99
INFO:kolla.common.utils.neutron-l3-agent:Built
INFO:kolla.common.utils.neutron-l3-agent:Trying to push the image
ERROR:kolla.common.utils.neutron-l3-agent:received unexpected HTTP status: 504 Gateway Time-out
INFO:kolla.common.utils.neutron-l3-agent:Trying to push the image
INFO:kolla.common.utils.neutron-l3-agent:Trying to push the image
INFO:kolla.common.utils.neutron-l3-agent:Trying to push the image
---
https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-centos-7-master-containers-build/6e68284/kolla/logs/octavia-housekeeping.log
INFO:kolla.common.utils.octavia-housekeeping:Successfully built d3aab0bf7d4b
INFO:kolla.common.utils.octavia-housekeeping:Built
INFO:kolla.common.utils.octavia-housekeeping:Trying to push the image
ERROR:kolla.common.utils.octavia-housekeeping:received unexpected HTTP status: 500 Internal Server Error
INFO:kolla.common.utils.octavia-housekeeping:Trying to push the image
INFO:kolla.common.utils.octavia-housekeeping:Trying to push the image
INFO:kolla.common.utils.octavia-housekeeping:Trying to push the image
https:/ /review. rdoproject. org/jenkins/ job/periodic- tripleo- centos- 7-master- containers- build/908 is spinning now, watching that.
Also looking back thru previous builds from last night/this morning to determine frequency distribution of errors.
Note: curious that we're getting both 504 and 500...
(working) Hypothesis: we're running 16 threads in parallel, we could be swamping but this seems unlikely. more data will help here...