[SR-IOV] SR-IOV migration doesn't work after 10-20 times

Bug #1592409 reported by Kristina Berezovskaia on 2016-06-14
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Mirantis OpenStack
Status tracked in 10.0.x
10.0.x
Medium
Sergey Nikitin
9.x
Medium
Sergey Nikitin

Bug Description

Detailed bug description:
When I try to migrate instance with macvtap port 5 time, it has error state

Steps to reproduce:

Deploy env with 1 controller, 2 computes with SR-IOV feature and 1 compute without SR-IOV.

1. Create net, subnet
neutron net-create net01
neutron subnet-create --name net01__subnet net01 10.1.1.0/24
2. Create router, set gatawey and interface to net01
neutron router-create router_01
neutron router-gateway-set router_01 admin_floating_net
neutron router-interface-add router_01 net01__subnet
3. Create macvtap port and boot vm
NET_ID_1=`neutron net-list | awk '/net01/ {print $2}'`
neutron port-create $NET_ID_1 --binding:vnic-type macvtap --device_owner nova-compute --name sriov_1
port_id_s1=`neutron port-list | awk '/sriov_1/ {print $2}'`
NODE_1=node-2.domain.tld
nova boot vm1 --flavor m1.small --image ubuntu_14.04 --availability-zone nova:$NODE_1 --nic port-id=$port_id_s1 --key-name cloudkey
4. Check active state:
nova list
5. Migrate vm1 (migrate, wait some time, confirm resizing)
nova migrate vm1
6. Check status
7. Repeat 5 and 6 for 10-20 times
Expected results:
instance has status ACTIVE

Actual result:
The instance has status ERROR
Error message: https://paste.mirantis.net/show/2370/

Description of the environment:
iso 482

cat /etc/fuel_build_id:
 482
cat /etc/fuel_build_number:
 482
cat /etc/fuel_release:
 9.0
cat /etc/fuel_openstack_version:
 mitaka-9.0
rpm -qa | egrep 'fuel|astute|network-checker|nailgun|packetary|shotgun':
 fuel-release-9.0.0-1.mos6349.noarch
 fuel-misc-9.0.0-1.mos8458.noarch
 python-packetary-9.0.0-1.mos140.noarch
 fuel-bootstrap-cli-9.0.0-1.mos285.noarch
 fuel-migrate-9.0.0-1.mos8458.noarch
 rubygem-astute-9.0.0-1.mos750.noarch
 fuel-mirror-9.0.0-1.mos140.noarch
 shotgun-9.0.0-1.mos90.noarch
 fuel-openstack-metadata-9.0.0-1.mos8742.noarch
 fuel-notify-9.0.0-1.mos8458.noarch
 nailgun-mcagents-9.0.0-1.mos750.noarch
 python-fuelclient-9.0.0-1.mos325.noarch
 fuel-9.0.0-1.mos6349.noarch
 fuel-utils-9.0.0-1.mos8458.noarch
 fuel-setup-9.0.0-1.mos6349.noarch
 fuel-provisioning-scripts-9.0.0-1.mos8742.noarch
 fuel-library9.0-9.0.0-1.mos8458.noarch
 network-checker-9.0.0-1.mos74.x86_64
 fuel-agent-9.0.0-1.mos285.noarch
 fuel-ui-9.0.0-1.mos2717.noarch
 fuel-ostf-9.0.0-1.mos936.noarch
 fuelmenu-9.0.0-1.mos274.noarch
 fuel-nailgun-9.0.0-1.mos8742.noarch

Additional information:
It reproduced only on 5th-time migration. My list of nodes during migration looks like:
node_4 -> node_5
node_5 -> node_4
node_4 -> node_5
node_5 -> node_4
node_4 -> node_5 - error

Link on snapshot:
https://drive.google.com/uc?export=download&id=0B05EZCZN-hilWHJQLV8xUGlGWk0

Won't fix in 9-0 because of low importance and reproducibility only on 5th-migration

Changed in mos:
status: New → Won't Fix
Alexander Ignatov (aignatov) wrote :

It's worth to add release notes here that in rare situations SRIOV migration may not work.

Dina Belova (dbelova) wrote :

Added release-notes tag to include information Alex ^^ mentioned

tags: added: release-notes

Related fix proposed to branch: master
Change author: Evgeny Konstantinov <email address hidden>
Review: https://review.fuel-infra.org/22315

Reviewed: https://review.fuel-infra.org/22315
Submitter: Evgeny Konstantinov <email address hidden>
Branch: master

Commit: d11a307a7bbd009981ef25c8dae592c85a4d4476
Author: Evgeny Konstantinov <email address hidden>
Date: Wed Jun 22 10:26:29 2016

Add nova known issue 9.0

Change-Id: I89e88b3b76cf31bfab7219236bc3236155fd1b33
Related-Bug: #1592409

tags: added: release-notes-done
removed: release-notes
tags: added: 10.0-reviewed area-nova
summary: - [SR-IOV] SR-IOV migration doesn't work after 4 times
+ [SR-IOV] SR-IOV migration doesn't work after 10-20 times
description: updated
description: updated
Olena Logvinova (ologvinova) wrote :

Since the bug was not fixed in 9.1 and moved to 10.0, duplicating the RN in 9.1 docs: https://review.fuel-infra.org/27239 [RN] Duplicate the Nova 9.0 known issue in 9.1.

tags: added: release-notes

Related fix proposed to branch: master
Change author: Evgeny Konstantinov <email address hidden>
Review: https://review.fuel-infra.org/29799

Reviewed: https://review.fuel-infra.org/29799
Submitter: Olena Logvinova <email address hidden>
Branch: master

Commit: 811ead8b6a07ebb07e34ccc1f4772c6661011794
Author: Evgeny Konstantinov <email address hidden>
Date: Tue Jan 31 11:55:07 2017

Add SR-IOV migration issue to relnotes 9.2

Change-Id: I378328b7c9fcea17eacd66f1b87c0201dfc9d1c0
Related-Bug: #1592409

tags: removed: release-notes
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers