[CI][C8][Wallaby] build-containers failures

[Dariusz Smigiel]

Job periodic-tripleo-ci-build-containers-ubi-8-push-wallaby fails building containers:

2022-05-04 20:29:52 | level=debug msg="Uploading /v2/tripleowallaby/openstack-manila-base/blobs/uploads/"
2022-05-04 20:29:52 | level=debug msg="POST https://trunk.registry.rdoproject.org/v2/tripleowallaby/openstack-manila-base/blobs/uploads/"
2022-05-04 20:29:52 | level=debug msg="... already exists"
2022-05-04 20:29:52 | level=debug msg="Trying to mount /v2/tripleowallaby/openstack-manila-base/blobs/uploads/?from=tripleowallaby%2Fopenstack-tempest&mount=sha256%3A1615f362c3b9b1c30262cb5fee1e0a5e0bd193a8bc10f4c77f065faebc2aeb7c"

The following jobs were incomplete: ['manila-base', 'novajoin-base', 'nova-base', 'octavia-base', 'tempest', 'glance-api']: SystemError: The following jobs were incomplete: ['manila-base', 'novajoin-base', 'nova-base', 'octavia-base', 'tempest', 'glance-api']

[1]: https://logserver.rdoproject.org/openstack-periodic-integration-stable1-cs8/opendev.org/openstack/tripleo-ci/50faeef35d14ba61a119dbbfe9f0680a3050d799/periodic-tripleo-ci-build-containers-ubi-8-push-wallaby/b5cf215/logs/build.log

[Marios Andreou (marios-b)]

as a general rule never file a bug if we only have one example - the absolute minimum should be 2 (but even then it may be transient).

Looking at [1] currently there is 1 fail there and it is the one you have reference in the description [2]. The one after that at [3] is green .

FWIW I also saw a similar bug in train @ [4] - (so it *was* a thing) but then the next one is green again at [5]

        * 2022-05-04 20:50:44 | Buildah failed with the following error: The following jobs were incomplete: [{'base': ['redis', 'memcached', 'rabbitmq', 'keepalived', 'rsyslog', 'tripleoclient', 'mariadb', 'multipathd', 'qdrouterd', {'ovn-base': ['ovn-nb-db-server', 'ovn-controller', 'ovn-sb-db-server', 'ovn-northd']}, 'collectd', 'haproxy', 'unbound', {'os': [{'cinder-base': ['cinder-volume', 'cinder-scheduler', 'cinder-backup', 'cinder-api']}, {'gnocchi-base': ['gnocchi-metricd', 'gnocchi-api', 'gnocchi-statsd']}, {'aodh-base': ['aodh-evaluator', 'aodh-listener', 'aodh-api', 'aodh-notifier']}, 'glance-api', {'swift-base': ['swift-proxy-server', 'swift-container', 'swift-account', 'swift-object']}, {'neutron-base': ['neutron-server', 'neutron-openvswitch-agent', 'neutron-sriov-agent', 'neutron-metadata-agent', 'neutron-mlnx-agent', {'neutron-agent-base': ['neutron-metadata-agent-ovn', 'neutron-dhcp-agent', 'neutron-l3-agent']}, 'neutron-server-ovn', 'ironic-neutron-agent']}, 'placement-api', {'designate-base': ['designate-producer', 'designate-backend-bind9', 'designate-worker', 'designate-mdns', 'designate-sink', 'designate-central', 'designate-api']}, 'horizon', 'panko-api', 'keystone', {'octavia-base': ['octavia-health-manager', 'octavia-api', 'octavia-housekeeping', 'octavia-worker']}, {'ironic-base': ['ironic-inspector', 'ironic-api', 'ironic-conductor', 'ironic-pxe']}, {'ceilometer-base': ['ceilometer-notification', 'ceilometer-central', 'ceilometer-compute', 'ceilometer-ipmi']}, 'ec2-api', {'barbican-base': ['barbican-keystone-listener', 'barbican-api', 'barbican-worker']}, {'heat-base': ['heat-all', 'heat-api-cfn', 'heat-api', 'heat-engine']}, {'mistral-base': ['mistral-api', 'mistral-executor', 'mistral-event-engine', 'mistral-engine']}, {'nova-base': ['nova-novncproxy', 'nova-compute-ironic', 'nova-conductor', 'nova-libvirt', 'nova-scheduler', 'nova-api', 'nova-compute']}, {'novajoin-base': ['novajoin-notifier', 'novajoin-server']}, {'manila-base': ['manila-scheduler', 'manila-share', 'manila-api']}, 'zaqar-wsgi', 'iscsid', 'tempest']}, 'cron', 'etcd']}]

[1] https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-build-containers-ubi-8-push-wallaby
[2] https://logserver.rdoproject.org/openstack-periodic-integration-stable1-cs8/opendev.org/openstack/tripleo-ci/50faeef35d14ba61a119dbbfe9f0680a3050d799/periodic-tripleo-ci-build-containers-ubi-8-push-wallaby/b5cf215/
[3] https://review.rdoproject.org/zuul/build/b86f750a1bcc4bc9b311fd70b1fb39a2
[4] https://logserver.rdoproject.org/openstack-periodic-integration-stable4/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-build-containers-ubi-8-push-train/f5544da/logs/build.log
[5] https://review.rdoproject.org/zuul/build/653abe5267ed44978d5ef436546e2baa

[Marios Andreou (marios-b)]

moving to Incomplete for now based on my comment #1 it is back to green so possibly transient issue.

If we see it again we can move it back to triaged.

[Dariusz Smigiel (smigiel-dariusz)]

Closing the bug,as we're not seeing this problem anymore.