config-download Timeout Does Not Always Work

Bug #1867968 reported by Luke Short
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Fix Released
Medium
Luke Short

Bug Description

Description
===========
The `openstack overcloud deploy --config-download-timeout` argument does not always timeout the ansible-playbook command it runs.

Steps to reproduce
==================
Deploy a large scale Overcloud deployment with the argument`--config-download-timeout 30` and Ceph enabled.

Expected result
===============
config-download and all of it's child processes should be killed immediately after the timeout.

Actual result
=============
The ansible-playbook command and it's child processes continue to run.

Environment
===========
Affects all releases.

Logs & Configs
==============
Relevant logs can be found here: https://bugzilla.redhat.com/show_bug.cgi?id=1801502

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tripleo-common (master)

Fix proposed to branch: master
Review: https://review.opendev.org/713707

Revision history for this message
Bogdan Dobrelya (bogdando) wrote :
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-common (master)

Reviewed: https://review.opendev.org/713707
Committed: https://git.openstack.org/cgit/openstack/tripleo-common/commit/?id=7be36f305107c0bfb4e403f5df4226635e34dffa
Submitter: Zuul
Branch: master

commit 7be36f305107c0bfb4e403f5df4226635e34dffa
Author: Luke Short <email address hidden>
Date: Wed Mar 18 14:03:34 2020 -0400

    config-download timeout should KILL the process.

    The timeout command defaults to using TERM which does
    not always ensure that it will end soon enough. The
    ansible-playbook command should end as soon as possible.

    Change-Id: I0f97772434040f04f9495239b9a432c1ac062555
    Closes-Bug: #1867968
    Signed-off-by: Luke Short <email address hidden>

Changed in tripleo:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tripleo-common (stable/train)

Fix proposed to branch: stable/train
Review: https://review.opendev.org/714659

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tripleo-common (stable/stein)

Fix proposed to branch: stable/stein
Review: https://review.opendev.org/715956

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tripleo-common (stable/rocky)

Fix proposed to branch: stable/rocky
Review: https://review.opendev.org/715959

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-common (stable/train)

Reviewed: https://review.opendev.org/714659
Committed: https://git.openstack.org/cgit/openstack/tripleo-common/commit/?id=9faf10dd844b13d002b0d16413935fceae46ed4e
Submitter: Zuul
Branch: stable/train

commit 9faf10dd844b13d002b0d16413935fceae46ed4e
Author: Luke Short <email address hidden>
Date: Wed Mar 18 14:03:34 2020 -0400

    config-download timeout should KILL the process.

    The timeout command defaults to using TERM which does
    not always ensure that it will end soon enough. The
    ansible-playbook command should end as soon as possible.

    Change-Id: I0f97772434040f04f9495239b9a432c1ac062555
    Closes-Bug: #1867968
    Signed-off-by: Luke Short <email address hidden>
    (cherry picked from commit 7be36f305107c0bfb4e403f5df4226635e34dffa)

tags: added: in-stable-train
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-common (stable/stein)

Reviewed: https://review.opendev.org/715956
Committed: https://git.openstack.org/cgit/openstack/tripleo-common/commit/?id=c9cced6131113a0946f5a0ccd676b60b7ed0bcb6
Submitter: Zuul
Branch: stable/stein

commit c9cced6131113a0946f5a0ccd676b60b7ed0bcb6
Author: Luke Short <email address hidden>
Date: Wed Mar 18 14:03:34 2020 -0400

    config-download timeout should KILL the process.

    The timeout command defaults to using TERM which does
    not always ensure that it will end soon enough. The
    ansible-playbook command should end as soon as possible.

    Change-Id: I0f97772434040f04f9495239b9a432c1ac062555
    Closes-Bug: #1867968
    Signed-off-by: Luke Short <email address hidden>
    (cherry picked from commit 7be36f305107c0bfb4e403f5df4226635e34dffa)
    (cherry picked from commit 9faf10dd844b13d002b0d16413935fceae46ed4e)

tags: added: in-stable-stein
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-common (stable/rocky)

Reviewed: https://review.opendev.org/715959
Committed: https://git.openstack.org/cgit/openstack/tripleo-common/commit/?id=d1bb0e6c32f46fdc3012a34842fbfbd1bdfa2cde
Submitter: Zuul
Branch: stable/rocky

commit d1bb0e6c32f46fdc3012a34842fbfbd1bdfa2cde
Author: Luke Short <email address hidden>
Date: Wed Mar 18 14:03:34 2020 -0400

    config-download timeout should KILL the process.

    The timeout command defaults to using TERM which does
    not always ensure that it will end soon enough. The
    ansible-playbook command should end as soon as possible.

    Change-Id: I0f97772434040f04f9495239b9a432c1ac062555
    Closes-Bug: #1867968
    Signed-off-by: Luke Short <email address hidden>
    (cherry picked from commit 7be36f305107c0bfb4e403f5df4226635e34dffa)
    (cherry picked from commit 9faf10dd844b13d002b0d16413935fceae46ed4e)
    (cherry picked from commit c9cced6131113a0946f5a0ccd676b60b7ed0bcb6)

tags: added: in-stable-rocky
Revision history for this message
Bogdan Dobrelya (bogdando) wrote :
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/tripleo-common 12.3.0

This issue was fixed in the openstack/tripleo-common 12.3.0 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/tripleo-common rocky-eol

This issue was fixed in the openstack/tripleo-common rocky-eol release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/tripleo-common stein-eol

This issue was fixed in the openstack/tripleo-common stein-eol release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.