tempest api migration tests very long

[Tom Barron]

test cases under manila_tempest_tests.tests.api.admin.test_migration can run over ten minutes each causing job timeouts or failures waiting for results on individual test cases. Here is a recent example from review: https://review.openstack.org/#/c/489639/:

http://logs.openstack.org/39/489639/7/check/gate-manila-tempest-dsvm-mysql-generic-ubuntu-xenial-nv/05efe94/console.html

manila_tempest_tests.tests.api.admin.test_migration.MigrationCancelNFSTest.test_migration_cancel_1_True [511.521368s] ... FAILED

manila_tempest_tests.tests.api.admin.test_migration.MigrationWithShareExtendingNFSTest.test_extend_on_migrated_share_1_True [620.960435s] ... FAILED

manila_tempest_tests.tests.api.admin.test_migration.MigrationWithShareShrinkingNFSTest.test_shrink_on_migrated_share_1_True [630.269295s] ... ok

manila_tempest_tests.tests.api.admin.test_migration.MigrationWithDifferentSnapshotSupportNFSTest.test_migrate_share_to_no_snapshot_capability_share_type_1_True [236.365127s] ... ok

manila_tempest_tests.tests.api.admin.test_migration.MigrationWithDifferentSnapshotSupportNFSTest.test_migrate_share_to_snapshot_capability_share_type_1_True [226.159901s] ... ok

[Tom Barron (tpb)]

Even with the lvm driver instead of generic these tests take significant time. From the same review as above, see http://logs.openstack.org/39/489639/7/check/gate-manila-tempest-minimal-dsvm-lvm-centos-7/62f0c3f/console.html

manila_tempest_tests.tests.api.admin.test_migration.MigrationWithDifferentSnapshotSupportNFSTest.test_migrate_share_to_no_snapshot_capability_share_type_1_True [147.418052s] ... ok

manila_tempest_tests.tests.api.admin.test_migration.MigrationCancelNFSTest.test_migration_cancel_1_True [158.893034s] ... ok

manila_tempest_tests.tests.api.admin.test_migration.MigrationTwoPhaseNFSTest.test_migration_2phase_1_True [194.716600s] ... ok

manila_tempest_tests.tests.api.admin.test_migration.MigrationWithDifferentSnapshotSupportNFSTest.test_migrate_share_to_snapshot_capability_share_type_1_True [106.064927s]

manila_tempest_tests.tests.api.admin.test_migration.MigrationWithShareExtendingNFSTest.test_extend_on_migrated_share_1_True [210.874781s] ... ok

[Rodrigo Barbieri (rodrigo-barbieri2010)]

As we discussed in a weekly meeting, one possible reason for the tests to take too long is because the waiters on both tempest side and manila server side are too long.

On manila server side, there are waiters in several places, one of them is "time.sleep(tries ** 2)".

On tempest side, it is "time.sleep(self.build_interval)".

Maybe tweaking those values can improve the time it takes for the tests to complete.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/541478

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/541478
Committed: https://git.openstack.org/cgit/openstack/manila/commit/?id=53ec28a1caa2555917974c8e0eb0efffdf58dfdb
Submitter: Zuul
Branch: master

commit 53ec28a1caa2555917974c8e0eb0efffdf58dfdb
Author: Rodrigo Barbieri <email address hidden>
Date: Thu Feb 1 17:08:41 2018 -0200

    Fix Host-assisted Share Migration with IPv4+IPv6

    Previously, the Data Service allowed only 1 IP to be specified
    for the 'data_node_access_ip' config option, which prevented
    Host-assisted Share Migration to be successful on a combination
    of backends that include IPv6 and IPv4 export locations.

    To fix this, we are adding a new config option and deprecating
    the old one. The new one is named 'data_node_access_ips' and
    accepts a list of IPs. All IPs included in this list should
    correspond to interfaces on the node running the Data Service
    and will be allowed access during Host-assisted Share Migration.

    Additionally, we are improving the responsiveness of the
    Host-assisted Share Migration by using exponential waiters
    instead of polynomial. Those waiters are used when managing
    resources created by Share Migration.

    Closes-bug: #1745436
    Partial-bug: #1708491

    Change-Id: I1c0b7621ae8192f75f691987b185a4fc6a7228ce

[Jason Grosso (jgrosso)]

closing fix-release based on https://review.opendev.org/#/c/541478/