[ostf] Instance live migration failure

[Valentyn Yakovlev]

Found on baremetal run

Steps to reproduce:
            1. Create new environment
            2. Choose Neutron, VLAN
            3. Choose cinder for volumes and ceph for images, ceph for
               ephemeral and Rados GW for objects
            4. Add 3 controller
            5. Add 2 compute
            6. Add 3 ceph nodes
            7. Add 1 cinder node
            8. Change default public net mask from /24 to /25
            9. Change default partitioning for ceph and cinder nodes for vdc
            10. Change default dns server to any 2 public dns servers to the
                'Host OS DNS Servers' on Settings tab
            11. Change default ntp servers to any 2 public ntp servers to the
                'Host OS NTP Servers' on Settings tab
            12. Verify networks
            13. Deploy cluster
            14. Verify networks
            15. Checking size of partitions
            16. Run OSTF <- [failure]

Expected result:
   ostf test passed

Actual result:
    Instance live migration failure

shotgun2 short-report
cat /etc/fuel_build_id:
 495
cat /etc/fuel_build_number:
 495
cat /etc/fuel_release:
 9.0
cat /etc/fuel_openstack_version:
 mitaka-9.0
rpm -qa | egrep 'fuel|astute|network-checker|nailgun|packetary|shotgun':
 fuel-agent-9.0.0-1.mos293.noarch
 fuel-migrate-9.0.0-1.mos8693.noarch
 fuel-openstack-metadata-9.0.0-1.mos8941.noarch
 python-packetary-9.0.0-1.mos163.noarch
 python-fuelclient-9.0.0-1.mos364.noarch
 shotgun-9.0.0-1.mos90.noarch
 fuelmenu-9.0.0-1.mos277.noarch
 fuel-misc-9.0.0-1.mos8693.noarch
 fuel-utils-9.0.0-1.mos8693.noarch
 fuel-ostf-9.0.0-1.mos947.noarch
 fuel-notify-9.0.0-1.mos8693.noarch
 network-checker-9.0.0-1.mos77.x86_64
 rubygem-astute-9.0.0-1.mos788.noarch
 fuel-release-9.0.0-1.mos6359.noarch
 nailgun-mcagents-9.0.0-1.mos788.noarch
 fuel-setup-9.0.0-1.mos6359.noarch
 fuel-nailgun-9.0.0-1.mos8941.noarch
 fuel-bootstrap-cli-9.0.0-1.mos293.noarch
 fuel-9.0.0-1.mos6359.noarch
 fuel-ui-9.0.0-1.mos2857.noarch
 fuel-provisioning-scripts-9.0.0-1.mos8941.noarch
 fuel-library9.0-9.0.0-1.mos8693.noarch
 fuel-mirror-9.0.0-1.mos163.noarch

[Valentyn Yakovlev (vyakovlev)]

logs:
https://drive.google.com/file/d/0B1PDTyhFQndBUkdGS0tZQUhXZGs/view?usp=sharing

[Valentyn Yakovlev (vyakovlev)]

run:
https://product-ci.infra.mirantis.net/view/baremetal/job/9.x.baremetal.ubuntu.cinder_ceph_for_images_ephemeral_rados/44/console

[Vladimir Kuklin (vkuklin)]

2017-01-10T12:55:08.969094+00:00 err: 2017-01-10 12:55:08.971 25523 ERROR nova.virt.libvirt.driver [req-cd748da1-f82d-4132-a1e7-5366fe10366a 82c166c410da4482b94f71d733efee6d 6d2078a50abc456eabaf0002fd2cffb6 - - -] [instance: 79539421-efbf-4edd-80d5-f4c00be7e7eb] Live Migration failure: unsupported configuration: guest and host CPU are not compatible: Host CPU does not provide required features: rtm, invpcid, bmi2, avx2, hle, bmi1, abm, movbe, fma; try using 'Haswell-noTSX' CPU model
2017-01-10T12:55:08.969307+00:00 debug: 2017-01-10 12:55:08.971 25523 DEBUG nova.virt.libvirt.driver [req-cd748da1-f82d-4132-a1e7-5366fe10366a 82c166c410da4482b94f71d733efee6d 6d2078a50abc456eabaf0002fd2cffb6 - - -] [instance: 79539421-efbf-4edd-80d5-f4c00be7e7eb] Migration operation thread notification thread_finished /usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py:6560
2017-01-10T12:55:09.073919+00:00 debug: 2017-01-10 12:55:09.075 25523 DEBUG nova.virt.libvirt.driver [req-cd748da1-f82d-4132-a1e7-5366fe10366a 82c166c410da4482b94f71d733efee6d 6d2078a50abc456eabaf0002fd2cffb6 - - -] [instance: 79539421-efbf-4edd-80d5-f4c00be7e7eb] VM running on src, migration failed _live_migration_monitor /usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py:6348
2017-01-10T12:55:09.074170+00:00 debug: 2017-01-10 12:55:09.076 25523 DEBUG nova.virt.libvirt.driver [req-cd748da1-f82d-4132-a1e7-5366fe10366a 82c166c410da4482b94f71d733efee6d 6d2078a50abc456eabaf0002fd2cffb6 - - -] [instance: 79539421-efbf-4edd-80d5-f4c00be7e7eb] Fixed incorrect job type to be 4 _live_migration_monitor /usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py:6368
2017-01-10T12:55:09.074414+00:00 err: 2017-01-10 12:55:09.076 25523 ERROR nova.virt.libvirt.driver [req-cd748da1-f82d-4132-a1e7-5366fe10366a 82c166c410da4482b94f71d733efee6d 6d2078a50abc456eabaf0002fd2cffb6 - - -] [instance: 79539421-efbf-4edd-80d5-f4c00be7e7eb] Migration operation has aborted

[Vladimir Kuklin (vkuklin)]

According to this, the target host cannot be used as a target for migration. Thus, this is either an environment configuration issue, test has specified that host explicitly not allowing for nova to smartly guess the target host or a nova bug where nova does not pick correct host for migration.