Fuel Master CI should fail sooner if docker fails

Bug #1388002 reported by Matthew Mosesohn
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
In Progress
High
Egor Kotko

Bug Description

Fuel Master CI test takes a full ~50 mins to fail instead of responding sooner. Since this test will be run against many patches, it takes too long to fail. Instead, the test should look in /var/log/puppet/bootstrap_admin_node.log for a message that matches the following expression:
ERROR: .*failed to start.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-devops (master)

Fix proposed to branch: master
Review: https://review.openstack.org/132582

Changed in fuel:
status: New → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-main (master)

Fix proposed to branch: master
Review: https://review.openstack.org/132586

Revision history for this message
Tatyanka (tatyana-leontovich) wrote :

We have sometimes here several retries to start some container, so in your case if first attempts fails -> test will fail too(But second one attempt may be successful)

Revision history for this message
Matthew Mosesohn (raytrac3r) wrote :

What we should do is if dockerctl check CONTAINERNAME fails, it will print this error. What isn't so clear is should we fail 100% here and abort all deployment, or just write it and exit 1 at the end? This "first attempt" fail is not accurate. We test 255 times to see if the container is ready (about 9 minutes) before marking it as failed.

For the scope of Fuel Master CI, I believe we should just consider it failed immediately by parsing the log for this message and marking the CI test as a failure then and there.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on fuel-main (master)

Change abandoned by Egor Kotko (<email address hidden>) on branch: master
Review: https://review.openstack.org/132586
Reason: Abandon because of this https://review.openstack.org/#/c/133440/5

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on fuel-devops (master)

Change abandoned by Egor Kotko (<email address hidden>) on branch: master
Review: https://review.openstack.org/132582
Reason: Abandon because of https://review.openstack.org/#/c/133440/5

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.