Live-migration with volumes creates orphan access records

Bug #1338735 reported by Rajini Karthik
14
This bug affects 3 people
Affects Status Importance Assigned to Milestone
Cinder
Invalid
Undecided
Unassigned
OpenStack Compute (nova)
Expired
Undecided
Unassigned

Bug Description

When live migration is performed on instances with volume attached, nova sends two initiator commands and one terminate connection. This causes orphan access records in some storage arrays ( tested with Dell EqualLogic Driver).

Steps to reproduce:
1. Have one controller and two compute node setup. Setup cinder volume on iscsi or a storage array.
2. Create an instance
3. Create a volume and attach it to the instance
4. Check the location of the instance ( computenode1 or 2)
nova instance1 show
4. Perform live migration of the instance and move it to the second compute node
nova live-migration instance1 computenode2
5. Check the cinder api log. c-api
There will be two os-initialize_connection and one os-terminate-connection. There should only be one set of initialize and terminate connection

description: updated
Sean Dague (sdague)
Changed in nova:
status: New → Confirmed
importance: Undecided → Low
tags: added: live-migrate
removed: live-migration
Mike Perez (thingee)
tags: added: volumess
tags: added: volumes
removed: volumess
Revision history for this message
Sean McGinnis (sean-mcginnis) wrote : Bug Cleanup

Closing stale bug. If this is still an issue please reopen.

Changed in cinder:
status: New → Invalid
Paul Murray (pmurray)
tags: added: live-migration
removed: live-migrate
lvmxh (shaohef)
Changed in nova:
assignee: nobody → lvmxh (shaohef)
lvmxh (shaohef)
Changed in nova:
assignee: lvmxh (shaohef) → nobody
Changed in nova:
assignee: nobody → Pushkar Umaranikar (pushkar-umaranikar)
Revision history for this message
John Garbutt (johngarbutt) wrote :

It looks a lot like this bug is caused by this change:
https://review.openstack.org/#/c/202770/

Revision history for this message
Matt Riedemann (mriedem) wrote :

What version of nova/cinder was being used to recreate this?

Revision history for this message
Rajini Karthik (rajini-karthik) wrote :

Icehouse was the version when I reported the bug

Revision history for this message
Pushkar Umaranikar (pushkar-umaranikar) wrote :

I tried it on nova version 13.0 - close to nova master.

Revision history for this message
Rajini Karthik (rajini-karthik) wrote :

Did you reproduce?

Revision history for this message
Pushkar Umaranikar (pushkar-umaranikar) wrote :

In my case, I can see 3 volume initiation requests, 2 for source host and 1 for destination host.

For source host, requests are initiated from :
compute/manager.py - check_can_live_migrate_source()
virt/libvirt/driver.py - post_live_migration()

As John mentioned, request to volume init from post_live_migration() is added in https://review.openstack.org/#/c/202770/
Waiting for comment/suggestion on the same.

Revision history for this message
Markus Zoeller (markus_z) (mzoeller) wrote : Cleanup EOL bug report

This is an automated cleanup. This bug report has been closed because it
is older than 18 months and there is no open code change to fix this.
After this time it is unlikely that the circumstances which lead to
the observed issue can be reproduced.

If you can reproduce the bug, please:
* reopen the bug report (set to status "New")
* AND add the detailed steps to reproduce the issue (if applicable)
* AND leave a comment "CONFIRMED FOR: <RELEASE_NAME>"
  Only still supported release names are valid (LIBERTY, MITAKA, OCATA, NEWTON).
  Valid example: CONFIRMED FOR: LIBERTY

Changed in nova:
assignee: Pushkar Umaranikar (pushkar-umaranikar) → nobody
importance: Low → Undecided
status: Confirmed → Expired
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.