[SR-IOV] SR-IOV migration doesn't work after 10-20 times

Bug #1592409 reported by Kristina Berezovskaia
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Mirantis OpenStack
Status tracked in 10.0.x
10.0.x
Confirmed
Medium
Sergey Nikitin
9.x
Won't Fix
Medium
Sergey Nikitin

Bug Description

Detailed bug description:
When I try to migrate instance with macvtap port 5 time, it has error state

Steps to reproduce:

Deploy env with 1 controller, 2 computes with SR-IOV feature and 1 compute without SR-IOV.

1. Create net, subnet
neutron net-create net01
neutron subnet-create --name net01__subnet net01 10.1.1.0/24
2. Create router, set gatawey and interface to net01
neutron router-create router_01
neutron router-gateway-set router_01 admin_floating_net
neutron router-interface-add router_01 net01__subnet
3. Create macvtap port and boot vm
NET_ID_1=`neutron net-list | awk '/net01/ {print $2}'`
neutron port-create $NET_ID_1 --binding:vnic-type macvtap --device_owner nova-compute --name sriov_1
port_id_s1=`neutron port-list | awk '/sriov_1/ {print $2}'`
NODE_1=node-2.domain.tld
nova boot vm1 --flavor m1.small --image ubuntu_14.04 --availability-zone nova:$NODE_1 --nic port-id=$port_id_s1 --key-name cloudkey
4. Check active state:
nova list
5. Migrate vm1 (migrate, wait some time, confirm resizing)
nova migrate vm1
6. Check status
7. Repeat 5 and 6 for 10-20 times
Expected results:
instance has status ACTIVE

Actual result:
The instance has status ERROR
Error message: https://paste.mirantis.net/show/2370/

Description of the environment:
iso 482

cat /etc/fuel_build_id:
 482
cat /etc/fuel_build_number:
 482
cat /etc/fuel_release:
 9.0
cat /etc/fuel_openstack_version:
 mitaka-9.0
rpm -qa | egrep 'fuel|astute|network-checker|nailgun|packetary|shotgun':
 fuel-release-9.0.0-1.mos6349.noarch
 fuel-misc-9.0.0-1.mos8458.noarch
 python-packetary-9.0.0-1.mos140.noarch
 fuel-bootstrap-cli-9.0.0-1.mos285.noarch
 fuel-migrate-9.0.0-1.mos8458.noarch
 rubygem-astute-9.0.0-1.mos750.noarch
 fuel-mirror-9.0.0-1.mos140.noarch
 shotgun-9.0.0-1.mos90.noarch
 fuel-openstack-metadata-9.0.0-1.mos8742.noarch
 fuel-notify-9.0.0-1.mos8458.noarch
 nailgun-mcagents-9.0.0-1.mos750.noarch
 python-fuelclient-9.0.0-1.mos325.noarch
 fuel-9.0.0-1.mos6349.noarch
 fuel-utils-9.0.0-1.mos8458.noarch
 fuel-setup-9.0.0-1.mos6349.noarch
 fuel-provisioning-scripts-9.0.0-1.mos8742.noarch
 fuel-library9.0-9.0.0-1.mos8458.noarch
 network-checker-9.0.0-1.mos74.x86_64
 fuel-agent-9.0.0-1.mos285.noarch
 fuel-ui-9.0.0-1.mos2717.noarch
 fuel-ostf-9.0.0-1.mos936.noarch
 fuelmenu-9.0.0-1.mos274.noarch
 fuel-nailgun-9.0.0-1.mos8742.noarch

Additional information:
It reproduced only on 5th-time migration. My list of nodes during migration looks like:
node_4 -> node_5
node_5 -> node_4
node_4 -> node_5
node_5 -> node_4
node_4 -> node_5 - error

Link on snapshot:
https://drive.google.com/uc?export=download&id=0B05EZCZN-hilWHJQLV8xUGlGWk0

Revision history for this message
Kristina Berezovskaia (kkuznetsova) wrote :

Won't fix in 9-0 because of low importance and reproducibility only on 5th-migration

Changed in mos:
status: New → Won't Fix
Revision history for this message
Alexander Ignatov (aignatov) wrote :

It's worth to add release notes here that in rare situations SRIOV migration may not work.

Revision history for this message
Dina Belova (dbelova) wrote :

Added release-notes tag to include information Alex ^^ mentioned

tags: added: release-notes
Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Related fix proposed to mos/mos-docs (master)

Related fix proposed to branch: master
Change author: Evgeny Konstantinov <email address hidden>
Review: https://review.fuel-infra.org/22315

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Related fix merged to mos/mos-docs (master)

Reviewed: https://review.fuel-infra.org/22315
Submitter: Evgeny Konstantinov <email address hidden>
Branch: master

Commit: d11a307a7bbd009981ef25c8dae592c85a4d4476
Author: Evgeny Konstantinov <email address hidden>
Date: Wed Jun 22 10:26:29 2016

Add nova known issue 9.0

Change-Id: I89e88b3b76cf31bfab7219236bc3236155fd1b33
Related-Bug: #1592409

tags: added: release-notes-done
removed: release-notes
tags: added: 10.0-reviewed area-nova
summary: - [SR-IOV] SR-IOV migration doesn't work after 4 times
+ [SR-IOV] SR-IOV migration doesn't work after 10-20 times
description: updated
description: updated
Revision history for this message
Olena Logvinova (ologvinova) wrote :

Since the bug was not fixed in 9.1 and moved to 10.0, duplicating the RN in 9.1 docs: https://review.fuel-infra.org/27239 [RN] Duplicate the Nova 9.0 known issue in 9.1.

tags: added: release-notes
Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Related fix proposed to mos/mos-docs (master)

Related fix proposed to branch: master
Change author: Evgeny Konstantinov <email address hidden>
Review: https://review.fuel-infra.org/29799

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Related fix merged to mos/mos-docs (master)

Reviewed: https://review.fuel-infra.org/29799
Submitter: Olena Logvinova <email address hidden>
Branch: master

Commit: 811ead8b6a07ebb07e34ccc1f4772c6661011794
Author: Evgeny Konstantinov <email address hidden>
Date: Tue Jan 31 11:55:07 2017

Add SR-IOV migration issue to relnotes 9.2

Change-Id: I378328b7c9fcea17eacd66f1b87c0201dfc9d1c0
Related-Bug: #1592409

tags: removed: release-notes
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.