| 2019-07-22 17:33:16 |
Ghada Khalil |
description |
Brief Description
-----------------
In a newly installed StarlingX (Duplex), after creating few VMs. Waiting until all VMs are in running state if you go to Horizon interface, and try to perform the live migration the following error will be thrown: "Error: Failed to live migrate instance to host "AUTO_SCHEDULE"."
Severity
--------
Provide the severity of the defect.
<Critical: System/Feature is not usable due to the defect> By now,
<Major: System/Feature is usable but degraded>
<Minor: System/Feature is usable with minor issue>
Steps to Reproduce
------------------
1.- Follow the steps described here to setup a Duplex Configuration:
https://wiki.openstack.org/wiki/StarlingX/Containers/InstallationOnAIODX
2.- Add the property mem_page_sizeo to the flavor (just to have ping / available)
openstack flavor set $UUID_my_flavor --property hw:mem_page_size=large
3.- Create an image:
openstack image create --container-format bare --disk-format qcow2 --file cirros-0.3.4-x86_64-disk.img cirros
4.- Create some VMs, in my case I have created 6 with the same flavor / image, and different name each one
openstack server create --image cirros --flavor my_tiny --network public-net0 vm1
5.- Go to Openstack Horizon interface:
http://$OAM_IP:31000 ----> Admin - Instances
6.- In the instances Menu, go to the Actions drop down menu, and select any VM (all 6 VMs created before should have the Running State), and select "Live Migrate Instance"
7.- Leave "Automatically schedule new host".
8.- Clck submit
9.- You will get the error that it's in the description.
Expected Behavior
------------------
The VM should be migrated with no issues to the next available controller (in the case of Duplex)
Actual Behavior
----------------
State what is the actual behavior
Reproducibility
---------------
<Reproducible/Intermittent/Seen once>
State if the issue is 100% reproducible, intermittent or seen once. If it is intermittent, state the frequency of occurrence
System Configuration
--------------------
<One node system, Two node system, Multi-node system, Dedicated storage, https, IPv4, IPv6 etc.>
Branch/Pull Time/Commit
-----------------------
Branch and the time when code was pulled or git commit or cengn load info
Last Pass
---------
Did this test scenario pass previously? If so, please indicate the load/pull time info of the last pass.
Use this section to also indicate if this is a new test scenario.
Timestamp/Logs
--------------
Attach the logs for debugging (use attachments in Launchpad or paste.openstack.org)
Provide a snippet of logs here and the timestamp when issue was seen.
Please indicate the unique identifier in the logs to highlight the problem
Test Activity
-------------
[Sanity, Feature Testing, Regression Testing, Developer Testing, Evaluation, Other - Please specify]
Severity
--------
Provide the severity of the defect.
<Critical: System/Feature is not usable due to the defect> The Live Migration Feature isn't working.
Steps to Reproduce
------------------
Write down the steps to reproduce the issue
Expected Behavior
------------------
Write down what was expected after taking the steps written above
Actual Behavior
----------------
The VM is not migrated and the following error is shown in Horizon: Error: Failed to live migrate instance to host "AUTO_SCHEDULE".
Reproducibility
---------------
<Reproducible in a fresh installed system>
System Configuration
--------------------
<Two node system / Duplex>
Branch/Pull Time/Commit
-----------------------
controller-0:~$ cat /etc/build.info
###
### StarlingX
### Built from master
###
OS="centos"
SW_VERSION="19.01"
BUILD_TARGET="Host Installer"
BUILD_TYPE="Formal"
BUILD_ID="20190715T233000Z"
JOB="STX_build_master_master"
BUILD_BY="starlingx.build@cengn.ca"
BUILD_NUMBER="182"
BUILD_HOST="starlingx_mirror"
BUILD_DATE="2019-07-15 23:30:00 +0000"
Last Pass
---------
Unknown.
Timestamp/Logs
--------------
/var/log/nfv-vim.log
2019-07-19T14:46:59.171 controller-0 VIM_Thread[802041] DEBUG _vim_nfvi_events.py.235 Instance state-change, nfvi_instance={'attached_volut': None, 'name': u'richo6', 'recovery_priority': None, 'tenant_id': '744e785d-d011-41c5-8d78-30e374c99cc9', 'avail_status': [], 'nfvi_data': {'vm_state': u'active', 'task_state': 'none', 'powsupport': None, 'instance_type': None, 'oper_state': 'enabled', 'host_name': u'controller-0', 'admin_state': 'unlocked', 'action': '', 'image_uuid': u'e94eb945-44f0-4c94-b657-423c4b9af222', 'ud12af6771824'}.
2019-07-19T14:54:25.716 controller-0 VIM_Thread[802041] DEBUG _vim_nfvi_events.py.304 Instance action, uuid=ce777205-36f8-49c8-a786-29cca4e action, type=live-migrate, params={'host': None, 'block-migration': False}, state=initial, reason=
2019-07-19T14:54:26.057 controller-0 VIM_Thread[802041] DEBUG _vim_nfvi_events.py.235 Instance state-change, nfvi_instance={'attached_volut': None, 'name': u'richo1', 'recovery_priority': None, 'tenant_id': '744e785d-d011-41c5-8d78-30e374c99cc9', 'avail_status': [], 'nfvi_data': {'vm_state': u'active', 'task_state': u'migrating'ation_support': None, 'instance_type': None, 'oper_state': 'enabled', 'host_name': u'controller-0', 'admin_state': 'unlocked', 'action': 'migrating', 'image_uuid': u'e94eb945-44f0-4c94-b657-4236f8-49c8-a786-29cca41e4035'}.
2019-07-19T14:54:27.633 controller-0 VIM_Thread[802041] DEBUG _vim_nfvi_events.py.235 Instance state-change, nfvi_instance={'attached_volut': None, 'name': u'richo1', 'recovery_priority': None, 'tenant_id': '744e785d-d011-41c5-8d78-30e374c99cc9', 'avail_status': [], 'nfvi_data': {'vm_state': u'active', 'task_state': 'none', 'powsupport': None, 'instance_type': None, 'oper_state': 'enabled', 'host_name': u'controller-0', 'admin_state': 'unlocked', 'action': '', 'image_uuid': u'e94eb945-44f0-4c94-b657-423c4b9af222', 'u29cca41e4035'}.
2019-07-19T14:54:27.685 controller-0 VIM_Thread[802041] ERROR Caught exception while trying to live migrate an instance, error=[OpenStack Rest-API Exception: methostack.svc.cluster.local:8774/v2.1/744e785dd01141c58d7830e374c99cc9/servers/ce777205-36f8-49c8-a786-29cca41e4035/action, headers={'Content-Type': 'application/json'}, body={"os-migrateLive": {"_migration": false, "host": null}}, status_code=400, reason=HTTP Error 400: Bad Request, response_headers=[('Content-Length', '184'), ('X-Compute-Request-Id', 'req-83334395-991d-4c4b-aedf-69a2API-Version, X-OpenStack-Nova-API-Version'), ('Openstack-Api-Version', 'compute 2.1'), ('X-Openstack-Nova-Api-Version', '2.1'), ('Date', 'Fri, 19 Jul 2019 14:54:27 GMT'), ('Content-Type', 'app('X-Openstack-Request-Id', 'req-83334395-991d-4c4b-aedf-69a294a5b3f7')], response_body={"badRequest": {"message": "controller-0 is not on shared storage: Shared storage live-migration requiresrom-volume with no local disks.", "code": 400}}].
OpenStackRestAPIException: [OpenStack Rest-API Exception: method=POST, url=http://nova-api.openstack.svc.cluster.local:8774/v2.1/744e785dd01141c58d7830e374c99cc9/servers/ce777205-36f8-49c8-a78'Content-Type': 'application/json'}, body={"os-migrateLive": {"disk_over_commit": false, "block_migration": false, "host": null}}, status_code=400, reason=HTTP Error 400: Bad Request, response4'), ('X-Compute-Request-Id', 'req-83334395-991d-4c4b-aedf-69a294a5b3f7'), ('Vary', 'OpenStack-API-Version, X-OpenStack-Nova-API-Version'), ('Openstack-Api-Version', 'compute 2.1'), ('X-Openst'Date', 'Fri, 19 Jul 2019 14:54:27 GMT'), ('Content-Type', 'application/json; charset=UTF-8'), ('X-Openstack-Request-Id', 'req-83334395-991d-4c4b-aedf-69a294a5b3f7')], response_body={"badReques not on shared storage: Shared storage live-migration requires either shared storage or boot-from-volume with no local disks.", "code": 400}}]
2019-07-19T14:54:27.688 controller-0 VIM_Thread[802041] DEBUG _instance_task_work.py.110 Live-Migrate-Instance callback for richo1, response=controller-0 is not on shared storage: shared storage live-migration requires either shared storage or boot-from-volume with no local disks'}.
Test Activity
-------------
[Regression Testing] |
Brief Description
-----------------
In a newly installed StarlingX (Duplex), after creating few VMs. Waiting until all VMs are in running state if you go to Horizon interface, and try to perform the live migration the following error will be thrown: "Error: Failed to live migrate instance to host "AUTO_SCHEDULE"."
Severity
--------
<Critical: System/Feature is not usable due to the defect> The Live Migration Feature isn't working.
Steps to Reproduce
------------------
1.- Follow the steps described here to setup a Duplex Configuration:
https://wiki.openstack.org/wiki/StarlingX/Containers/InstallationOnAIODX
2.- Add the property mem_page_sizeo to the flavor (just to have ping / available)
openstack flavor set $UUID_my_flavor --property hw:mem_page_size=large
3.- Create an image:
openstack image create --container-format bare --disk-format qcow2 --file cirros-0.3.4-x86_64-disk.img cirros
4.- Create some VMs, in my case I have created 6 with the same flavor / image, and different name each one
openstack server create --image cirros --flavor my_tiny --network public-net0 vm1
5.- Go to Openstack Horizon interface:
http://$OAM_IP:31000 ----> Admin - Instances
6.- In the instances Menu, go to the Actions drop down menu, and select any VM (all 6 VMs created before should have the Running State), and select "Live Migrate Instance"
7.- Leave "Automatically schedule new host".
8.- Clck submit
9.- You will get the error that it's in the description.
Expected Behavior
------------------
The VM should be migrated with no issues to the next available controller (in the case of Duplex)
Actual Behavior
----------------
The VM is not migrated and the following error is shown in Horizon: Error: Failed to live migrate instance to host "AUTO_SCHEDULE".
Reproducibility
---------------
<Reproducible in a fresh installed system>
System Configuration
--------------------
<Two node system / Duplex>
Branch/Pull Time/Commit
-----------------------
controller-0:~$ cat /etc/build.info
###
### StarlingX
### Built from master
###
OS="centos"
SW_VERSION="19.01"
BUILD_TARGET="Host Installer"
BUILD_TYPE="Formal"
BUILD_ID="20190715T233000Z"
JOB="STX_build_master_master"
BUILD_BY="starlingx.build@cengn.ca"
BUILD_NUMBER="182"
BUILD_HOST="starlingx_mirror"
BUILD_DATE="2019-07-15 23:30:00 +0000"
Last Pass
---------
Unknown
Timestamp/Logs
--------------
/var/log/nfv-vim.log
2019-07-19T14:46:59.171 controller-0 VIM_Thread[802041] DEBUG _vim_nfvi_events.py.235 Instance state-change, nfvi_instance={'attached_volut': None, 'name': u'richo6', 'recovery_priority': None, 'tenant_id': '744e785d-d011-41c5-8d78-30e374c99cc9', 'avail_status': [], 'nfvi_data': {'vm_state': u'active', 'task_state': 'none', 'powsupport': None, 'instance_type': None, 'oper_state': 'enabled', 'host_name': u'controller-0', 'admin_state': 'unlocked', 'action': '', 'image_uuid': u'e94eb945-44f0-4c94-b657-423c4b9af222', 'ud12af6771824'}.
2019-07-19T14:54:25.716 controller-0 VIM_Thread[802041] DEBUG _vim_nfvi_events.py.304 Instance action, uuid=ce777205-36f8-49c8-a786-29cca4e action, type=live-migrate, params={'host': None, 'block-migration': False}, state=initial, reason=
2019-07-19T14:54:26.057 controller-0 VIM_Thread[802041] DEBUG _vim_nfvi_events.py.235 Instance state-change, nfvi_instance={'attached_volut': None, 'name': u'richo1', 'recovery_priority': None, 'tenant_id': '744e785d-d011-41c5-8d78-30e374c99cc9', 'avail_status': [], 'nfvi_data': {'vm_state': u'active', 'task_state': u'migrating'ation_support': None, 'instance_type': None, 'oper_state': 'enabled', 'host_name': u'controller-0', 'admin_state': 'unlocked', 'action': 'migrating', 'image_uuid': u'e94eb945-44f0-4c94-b657-4236f8-49c8-a786-29cca41e4035'}.
2019-07-19T14:54:27.633 controller-0 VIM_Thread[802041] DEBUG _vim_nfvi_events.py.235 Instance state-change, nfvi_instance={'attached_volut': None, 'name': u'richo1', 'recovery_priority': None, 'tenant_id': '744e785d-d011-41c5-8d78-30e374c99cc9', 'avail_status': [], 'nfvi_data': {'vm_state': u'active', 'task_state': 'none', 'powsupport': None, 'instance_type': None, 'oper_state': 'enabled', 'host_name': u'controller-0', 'admin_state': 'unlocked', 'action': '', 'image_uuid': u'e94eb945-44f0-4c94-b657-423c4b9af222', 'u29cca41e4035'}.
2019-07-19T14:54:27.685 controller-0 VIM_Thread[802041] ERROR Caught exception while trying to live migrate an instance, error=[OpenStack Rest-API Exception: methostack.svc.cluster.local:8774/v2.1/744e785dd01141c58d7830e374c99cc9/servers/ce777205-36f8-49c8-a786-29cca41e4035/action, headers={'Content-Type': 'application/json'}, body={"os-migrateLive": {"_migration": false, "host": null}}, status_code=400, reason=HTTP Error 400: Bad Request, response_headers=[('Content-Length', '184'), ('X-Compute-Request-Id', 'req-83334395-991d-4c4b-aedf-69a2API-Version, X-OpenStack-Nova-API-Version'), ('Openstack-Api-Version', 'compute 2.1'), ('X-Openstack-Nova-Api-Version', '2.1'), ('Date', 'Fri, 19 Jul 2019 14:54:27 GMT'), ('Content-Type', 'app('X-Openstack-Request-Id', 'req-83334395-991d-4c4b-aedf-69a294a5b3f7')], response_body={"badRequest": {"message": "controller-0 is not on shared storage: Shared storage live-migration requiresrom-volume with no local disks.", "code": 400}}].
OpenStackRestAPIException: [OpenStack Rest-API Exception: method=POST, url=http://nova-api.openstack.svc.cluster.local:8774/v2.1/744e785dd01141c58d7830e374c99cc9/servers/ce777205-36f8-49c8-a78'Content-Type': 'application/json'}, body={"os-migrateLive": {"disk_over_commit": false, "block_migration": false, "host": null}}, status_code=400, reason=HTTP Error 400: Bad Request, response4'), ('X-Compute-Request-Id', 'req-83334395-991d-4c4b-aedf-69a294a5b3f7'), ('Vary', 'OpenStack-API-Version, X-OpenStack-Nova-API-Version'), ('Openstack-Api-Version', 'compute 2.1'), ('X-Openst'Date', 'Fri, 19 Jul 2019 14:54:27 GMT'), ('Content-Type', 'application/json; charset=UTF-8'), ('X-Openstack-Request-Id', 'req-83334395-991d-4c4b-aedf-69a294a5b3f7')], response_body={"badReques not on shared storage: Shared storage live-migration requires either shared storage or boot-from-volume with no local disks.", "code": 400}}]
2019-07-19T14:54:27.688 controller-0 VIM_Thread[802041] DEBUG _instance_task_work.py.110 Live-Migrate-Instance callback for richo1, response=controller-0 is not on shared storage: shared storage live-migration requires either shared storage or boot-from-volume with no local disks'}.
Test Activity
-------------
[Regression Testing] |
|
