Live migration fails due to unexpected keyword argument 'disk_over_commit'

[Juha Kosonen]

Starting from API version 2.25, the block_migration parameter can be set to auto so that nova can decide the value during live migration. At the same time disk_over_commit parameter was removed.

https://specs.openstack.org/openstack/nova-specs/specs/mitaka/implemented/making_live_migration_api_friendly.html
https://developer.openstack.org/api-ref/compute/#live-migrate-server-os-migratelive-action

(venv) root@38db38ba5a89:/# rally task start live-migr.yaml
--------------------------------------------------------------------------------
Preparing input task
--------------------------------------------------------------------------------

Task is:
---
  NovaServers.boot_and_live_migrate_server:
  - args:
      flavor:
        name: "m1.tiny"
      image:
        name: "cirros"
      block_migration: "auto"
      nics:
        - net-id: "072676b0-c948-44ff-a832-6632aacddcba"
    runner:
      type: "constant"
      times: 1
      concurrency: 1
    context:
      users:
        tenants: 1
        users_per_tenant: 1
      api_versions:
        nova:
          version: 2.25

Task syntax is correct :)
Running Rally version 0.9.1~dev692
--------------------------------------------------------------------------------
Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8: started
--------------------------------------------------------------------------------

Running Task... This can take a while...

To track task status use:

        rally task status
        or
        rally task detailed

Using task: 6d37e6e5-8006-4799-94ea-f19d8034e1b8
2017-10-04 09:14:22.165 17290 INFO rally.task.engine [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 | Starting: Task validation.
2017-10-04 09:14:22.275 17290 INFO rally.task.engine [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 | Starting: Task validation of syntax.
2017-10-04 09:14:22.299 17290 INFO rally.task.engine [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 | Completed: Task validation of syntax.
2017-10-04 09:14:22.300 17290 INFO rally.task.engine [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 | Starting: Task validation of required platforms.
2017-10-04 09:14:22.307 17290 INFO rally.task.engine [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 | Completed: Task validation of required platforms.
2017-10-04 09:14:22.307 17290 INFO rally.task.engine [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 | Starting: Task validation of semantic.
2017-10-04 09:14:22.770 17290 INFO rally.task.context [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 | Context users@openstack setup() started
2017-10-04 09:14:25.050 17290 INFO rally.task.context [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 | Context users@openstack setup() finished in 2.28 sec
2017-10-04 09:14:26.130 17290 INFO rally.task.context [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 | Context users@openstack cleanup() started
2017-10-04 09:14:29.270 17290 INFO rally.task.context [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 | Context users@openstack cleanup() finished in 3.14 sec
2017-10-04 09:14:29.271 17290 INFO rally.task.engine [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 | Completed: Task validation of semantic.
2017-10-04 09:14:29.271 17290 INFO rally.task.engine [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 | Completed: Task validation.
2017-10-04 09:14:29.271 17290 INFO rally.api [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 input file is valid.
2017-10-04 09:14:29.271 17290 INFO rally.api [-] Run Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 against Deployment 31ca442c-6501-4e2c-b234-b196c45a548f
2017-10-04 09:14:29.272 17290 INFO rally.task.engine [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 | Starting: Running task.
2017-10-04 09:14:29.623 17290 INFO rally.task.engine [-] Running workload:
  position = 0
  config = {
   "version": 2,
   "title": "A cropped version of a bigger task.",
   "description": "Auto-generated task from a single workload (uuid=d1d23ab4-52bf-452e-ad9e-784c82555a94)",
   "subtasks": [
      {
         "title": "NovaServers.boot_and_live_migrate_server",
         "description": "Live Migrate a server.",
         "scenario": {
            "NovaServers.boot_and_live_migrate_server": {
               "flavor": {
                  "name": "m1.tiny"
               },
               "image": {
                  "name": "cirros"
               },
               "block_migration": "auto",
               "nics": [
                  {
                     "net-id": "072676b0-c948-44ff-a832-6632aacddcba"
                  }
               ]
            }
         },
         "contexts": {
            "users": {
               "tenants": 1,
               "users_per_tenant": 1
            },
            "api_versions": {
               "nova": {
                  "version": 2.25
               }
            }
         },
         "runner": {
            "constant": {
               "times": 1,
               "concurrency": 1
            }
         },
         "hooks": [],
         "sla": {
            "failure_rate": {
               "max": 0
            }
         }
      }
   ]
}
2017-10-04 09:14:29.643 17290 INFO rally.task.context [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 | Context users@openstack setup() started
2017-10-04 09:14:31.830 17290 INFO rally.task.context [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 | Context users@openstack setup() finished in 2.19 sec
2017-10-04 09:14:31.831 17290 INFO rally.task.context [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 | Context api_versions@openstack setup() started
2017-10-04 09:14:32.059 17290 INFO rally.task.context [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 | Context api_versions@openstack setup() finished in 0.23 sec
2017-10-04 09:14:32.060 17290 INFO rally.task.context [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 | Context cleanup@openstack setup() started
2017-10-04 09:14:32.060 17290 INFO rally.task.context [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 | Context cleanup@openstack setup() finished in 0.30 msec
2017-10-04 09:14:33.116 17421 INFO rally.task.runner [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 | ITER: 1 START
2017-10-04 09:14:44.770 17421 INFO rally.task.runner [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 | ITER: 1 END: Error TypeError: live_migrate() got an unexpected keyword argument 'disk_over_commit'
2017-10-04 09:14:44.794 17290 INFO rally.task.context [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 | Context cleanup@openstack cleanup() started
2017-10-04 09:14:50.388 17290 INFO rally.task.context [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 | Context cleanup@openstack cleanup() finished in 5.59 sec
2017-10-04 09:14:50.389 17290 INFO rally.task.context [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 | Context api_versions@openstack cleanup() started
2017-10-04 09:14:50.389 17290 INFO rally.task.context [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 | Context api_versions@openstack cleanup() finished in 0.33 msec
2017-10-04 09:14:50.389 17290 INFO rally.task.context [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 | Context users@openstack cleanup() started
2017-10-04 09:14:52.954 17290 INFO rally.task.context [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 | Context users@openstack cleanup() finished in 2.56 sec
2017-10-04 09:14:53.768 17290 INFO rally.task.engine [-] Load duration is: 10.650629
2017-10-04 09:14:53.769 17290 INFO rally.task.engine [-] Full runner duration is: 11.689908
2017-10-04 09:14:53.769 17290 INFO rally.task.engine [-] Full duration is: 23.324393
2017-10-04 09:14:54.185 17290 INFO rally.task.engine [-] Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 | Completed: Running task.

--------------------------------------------------------------------------------
Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8: finished
--------------------------------------------------------------------------------

test scenario NovaServers.boot_and_live_migrate_server
args position 0
args values:
{
  "runner": {
    "times": 1,
    "concurrency": 1,
    "type": "constant"
  },
  "hooks": [],
  "args": {
    "flavor": {
      "name": "m1.tiny"
    },
    "image": {
      "name": "cirros"
    },
    "block_migration": "auto",
    "nics": [
      {
        "net-id": "072676b0-c948-44ff-a832-6632aacddcba"
      }
    ]
  },
  "sla": {
    "failure_rate": {
      "max": 0
    }
  },
  "context": {
    "users": {
      "tenants": 1,
      "users_per_tenant": 1
    },
    "api_versions": {
      "nova": {
        "version": 2.25
      }
    }
  }
}

--------------------------------------------------------------------------------
Task 6d37e6e5-8006-4799-94ea-f19d8034e1b8 has 1 error(s)
--------------------------------------------------------------------------------

TypeError: live_migrate() got an unexpected keyword argument 'disk_over_commit'

Traceback (most recent call last):
  File "/venv/local/lib/python2.7/site-packages/rally/task/runner.py", line 72, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/venv/local/lib/python2.7/site-packages/rally/plugins/openstack/scenarios/nova/servers.py", line 722, in run
    block_migration, disk_over_commit)
  File "/venv/local/lib/python2.7/site-packages/rally/task/atomic.py", line 85, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/venv/local/lib/python2.7/site-packages/rally/plugins/openstack/scenarios/nova/utils.py", line 757, in _live_migrate
    disk_over_commit=disk_over_commit)
  File "/venv/local/lib/python2.7/site-packages/novaclient/api_versions.py", line 393, in substitution
    return methods[-1].func(obj, *args, **kwargs)
TypeError: live_migrate() got an unexpected keyword argument 'disk_over_commit'

--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server | 10.381 | 10.381 | 10.381 | 10.381 | 10.381 | 10.381 | 100.0% | 1 |
| nova.find_host_to_migrate | 0.949 | 0.949 | 0.949 | 0.949 | 0.949 | 0.949 | 100.0% | 1 |
| nova.live_migrate | 0.32 | 0.32 | 0.32 | 0.32 | 0.32 | 0.32 | 0.0% | 1 |
| total | 11.651 | 11.651 | 11.651 | 11.651 | 11.651 | 11.651 | 0.0% | 1 |
| -> duration | 10.651 | 10.651 | 10.651 | 10.651 | 10.651 | 10.651 | 0.0% | 1 |
| -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 0.0% | 1 |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 10.650629
Full duration: 23.324393

HINTS:
* To plot HTML graphics with this data, run:
        rally task report 6d37e6e5-8006-4799-94ea-f19d8034e1b8 --out output.html

* To generate a JUnit report, run:
        rally task export 6d37e6e5-8006-4799-94ea-f19d8034e1b8 --type junit --to output.xml

* To get raw JSON output of task results, run:
        rally task results 6d37e6e5-8006-4799-94ea-f19d8034e1b8

(venv) root@38db38ba5a89:/#