Using logging in the serial console worker blocks Nova

Bug #1557498 reported by Lucian Petrut
14
This bug affects 3 people
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
Won't Fix
Undecided
Unassigned
Liberty
Fix Released
High
Lucian Petrut
os-win
Fix Released
High
Lucian Petrut

Bug Description

The worker used by Nova to log instance serial console output can log an exception message.

The issue is that logging a message from a different thread causes Nova to hang. It seems that the logging file handler causes issues when greenthreads and multiple native threads are used at the same, and the native threads log messages.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to os-win (master)

Reviewed: https://review.openstack.org/292852
Committed: https://git.openstack.org/cgit/openstack/os-win/commit/?id=a25959a204f365a532138d7fe0a73b4cd039e807
Submitter: Jenkins
Branch: master

commit a25959a204f365a532138d7fe0a73b4cd039e807
Author: Lucian Petrut <email address hidden>
Date: Tue Mar 15 14:19:43 2016 +0200

    Fix serial console worker blocking Nova

    The worker used by Nova to log instance serial console output can
    log an exception message.

    The issue is that logging a message from a different thread causes
    Nova to hang. It seems that the logging file handler causes issues
    when greenthreads and multiple native threads are used at the same,
    and the native threads log messages.

    This patch removes this log message for now. In the future, we
    should fix the logging handler to avoid this issue.

    Closes-Bug: #1557498

    Change-Id: Ia5c1aba28347648e90f5ba6111fc047d711236db

Changed in os-win:
status: New → Fix Released
Claudiu Belu (cbelu)
tags: added: hyper-v liberty-backport-potential
Changed in os-win:
importance: Undecided → High
assignee: nobody → Lucian Petrut (petrutlucian94)
Changed in nova:
importance: Undecided → High
assignee: nobody → Lucian Petrut (petrutlucian94)
status: New → In Progress
Matt Riedemann (mriedem)
Changed in nova:
status: In Progress → Won't Fix
assignee: Lucian Petrut (petrutlucian94) → nobody
importance: High → Undecided
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to nova (stable/liberty)

Reviewed: https://review.openstack.org/314590
Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=3a713f8bf49821c8941e5dc9ec7d9b91dea3b8ec
Submitter: Jenkins
Branch: stable/liberty

commit 3a713f8bf49821c8941e5dc9ec7d9b91dea3b8ec
Author: Lucian Petrut <email address hidden>
Date: Tue May 10 17:06:02 2016 +0300

    Fix serial console worker blocking Nova

    The worker used by Nova to log instance serial console output can
    log an exception message.

    The issue is that logging a message from a different thread causes
    Nova to hang. It seems that the logging file handler causes issues
    when greenthreads and multiple native threads are used at the same,
    and the native threads log messages.

    This patch removes this log message for now. In the future, we
    should fix the logging handler to avoid this issue.

    NOTE: This issue has already been solved in Mitaka in os-win,
    which the Hyper-V driver uses since Mitaka.

    (cherry picked from commit a25959a204f365a532138d7fe0a73b4cd039e807)

    Change-Id: Ia5c1aba28347648e90f5ba6111fc047d711236db
    Closes-Bug: #1557498

Revision history for this message
Doug Hellmann (doug-hellmann) wrote : Fix included in openstack/nova 12.0.4

This issue was fixed in the openstack/nova 12.0.4 release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.