OpenStack Compute (nova)

Instances recovered after failed migrations enter error state (hyper-v)

  1. Series queens
  2. Bug #1841411
Bug #1841411 reported by Lucian Petrut
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
Fix Released
Medium
Lucian Petrut
Queens
New
Undecided
Unassigned
Rocky
New
Undecided
Unassigned
Stein
Fix Committed
Undecided
Lucian Petrut
compute-hyperv
Fix Released
Undecided
Lucian Petrut

Bug Description

Most users expect that if a live migration fails but the instance is fully recovered, it shouldn't enter 'error' state. Setting the migration status to 'error' should be enough. This simplifies debugging, making it clear that the instance dosn't have to be manually recovered.

This patch changed this behavior, indirectly affecting the Hyper-V driver, which propagates migration errors: Idfdce9e7dd8106af01db0358ada15737cb846395

When using the Hyper-V driver, instances enter error state even after successful recoveries. We may copy the Libvirt driver behavior and avoid propagating exceptions in this case.

Lucian Petrut (petrutlucian94)
tags: added: hyper-v
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to nova (master)

Fix proposed to branch: master
Review: https://review.opendev.org/678481

Changed in nova:
assignee: nobody → Lucian Petrut (petrutlucian94)
status: New → In Progress
Revision history for this message
Lucian Petrut (petrutlucian94) wrote : Re: Instances recovered after failed migrations enter error state

compute-hyperv fix: https://review.opendev.org/#/c/678480/

Changed in compute-hyperv:
status: New → In Progress
assignee: nobody → Lucian Petrut (petrutlucian94)
Matt Riedemann (mriedem)
summary: - Instances recovered after failed migrations enter error state
+ Instances recovered after failed migrations enter error state (hyper-v)
tags: added: live-migration
Changed in nova:
importance: Undecided → Medium
no longer affects: nova/ocata
no longer affects: nova/pike
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to compute-hyperv (master)

Reviewed: https://review.opendev.org/678480
Committed: https://git.openstack.org/cgit/openstack/compute-hyperv/commit/?id=a721681e6111d85264e20085d1f184d1c923b69e
Submitter: Zuul
Branch: master

commit a721681e6111d85264e20085d1f184d1c923b69e
Author: Lucian Petrut <email address hidden>
Date: Mon Aug 26 10:28:37 2019 +0300

    Avoid error state for recovered instances after failed migrations

    Most users expect that if a live migration fails but the instance
    is fully recovered, it shouldn't enter 'error' state. Setting
    the migration status to 'error' should be enough. This simplifies
    debugging, making it clear that the instance dosn't have to be
    manually recovered.

    This patch changed this behavior, indirectly affecting the Hyper-V
    driver: Idfdce9e7dd8106af01db0358ada15737cb846395

    We'll stop propagating exceptions when managing to recover the
    instance, which matches the reference driver (libvirt) behavior.

    Change-Id: I4b667c06e008b03457d35ce9c920b916d21c255f
    Closes-Bug: 1841411

Changed in compute-hyperv:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to compute-hyperv (stable/stein)

Fix proposed to branch: stable/stein
Review: https://review.opendev.org/680349

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to compute-hyperv (stable/stein)

Reviewed: https://review.opendev.org/680349
Committed: https://git.openstack.org/cgit/openstack/compute-hyperv/commit/?id=ba406564030d834353a8a1899c8520e522aa39fe
Submitter: Zuul
Branch: stable/stein

commit ba406564030d834353a8a1899c8520e522aa39fe
Author: Lucian Petrut <email address hidden>
Date: Mon Aug 26 10:28:37 2019 +0300

    Avoid error state for recovered instances after failed migrations

    Most users expect that if a live migration fails but the instance
    is fully recovered, it shouldn't enter 'error' state. Setting
    the migration status to 'error' should be enough. This simplifies
    debugging, making it clear that the instance dosn't have to be
    manually recovered.

    This patch changed this behavior, indirectly affecting the Hyper-V
    driver: Idfdce9e7dd8106af01db0358ada15737cb846395

    We'll stop propagating exceptions when managing to recover the
    instance, which matches the reference driver (libvirt) behavior.

    Change-Id: I4b667c06e008b03457d35ce9c920b916d21c255f
    Closes-Bug: 1841411
    (cherry picked from commit a721681e6111d85264e20085d1f184d1c923b69e)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/compute-hyperv 9.0.0.0rc1

This issue was fixed in the openstack/compute-hyperv 9.0.0.0rc1 release candidate.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to nova (master)

Reviewed: https://review.opendev.org/678481
Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=12b361f0b44f3d34899982b643482228044d3d86
Submitter: Zuul
Branch: master

commit 12b361f0b44f3d34899982b643482228044d3d86
Author: Lucian Petrut <email address hidden>
Date: Mon Aug 26 10:49:22 2019 +0300

    Avoid error state for recovered instances after failed migrations

    Most users expect that if a live migration fails but the instance
    is fully recovered, it shouldn't enter 'error' state. Setting
    the migration status to 'error' should be enough. This simplifies
    debugging, making it clear that the instance dosn't have to be
    manually recovered.

    This patch changed this behavior, indirectly affecting the Hyper-V
    driver: Idfdce9e7dd8106af01db0358ada15737cb846395

    We'll stop propagating exceptions when managing to recover the
    instance, which matches the reference driver (libvirt) behavior.

    Change-Id: I16c200ebf0a996865ddce5688434e9c9ad69e331
    Closes-Bug: 1841411

Changed in nova:
status: In Progress → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.