Resize server up failed when server's diskConfig option is Manual

Bug #1560210 reported by Tong Liu
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
Expired
Undecided
Unassigned

Bug Description

In my setup, there are two type of hypervisors ESX and KVM. The server is on ESX host. But during resize, it failed as it is migrated from one host (i.e. ESX host) to another (i.e. KVM host).

Revision history for this message
Tong Liu (liutong) wrote :
Download full text (7.3 KiB)

Traceback from tempest failure:
Log:
pythonlogging:'': {{{
        Body: None
    Response - Headers: {'status': '200', 'content-length': '1419', 'content-location': 'http://10.144.137.140:8774/v2.1/5116bfd6f1ff4d35a26d266dd59e6ec9/servers/e95f572d-3484-47eb-adea-082a1979f928', 'x-compute-request-id': 'req-31c912a3-315d-4142-9842-f817041afc04', 'vary': 'X-OpenStack-Nova-API-Version', 'connection': 'close', 'x-openstack-nova-api-version': '2.1', 'date': 'Fri, 19 Feb 2016 02:25:59 GMT', 'content-type': 'application/json'}
        Body: {"server": {"status": "ACTIVE", "updated": "2016-02-19T02:25:56Z", "hostId": "9c0e68e78ed2414b91351464d02ca6867cf9fb7d01f3d117601e02ab", "addresses": {}, "links": [{"href": "http://10.144.137.140:8774/v2.1/5116bfd6f1ff4d35a26d266dd59e6ec9/servers/e95f572d-3484-47eb-adea-082a1979f928", "rel": "self"}, {"href": "http://10.144.137.140:8774/5116bfd6f1ff4d35a26d266dd59e6ec9/servers/e95f572d-3484-47eb-adea-082a1979f928", "rel": "bookmark"}], "key_name": null, "image": {"id": "2482c8aa-ba09-44d1-b848-63d09a233f4d", "links": [{"href": "http://10.144.137.140:8774/5116bfd6f1ff4d35a26d266dd59e6ec9/images/2482c8aa-ba09-44d1-b848-63d09a233f4d", "rel": "bookmark"}]}, "OS-EXT-STS:task_state": "deleting", "OS-EXT-STS:vm_state": "active", "OS-SRV-USG:launched_at": "2016-02-19T02:25:54.000000", "flavor": {"id": "1", "links": [{"href": "http://10.144.137.140:8774/5116bfd6f1ff4d35a26d266dd59e6ec9/flavors/1", "rel": "bookmark"}]}, "id": "e95f572d-3484-47eb-adea-082a1979f928", "OS-SRV-USG:terminated_at": null, "OS-EXT-AZ:availability_zone": "nova", "user_id": "6b0b64bba0ae477d9c8d2cf33bb74802", "name": "tempest.common.compute-instance-1106858152", "created": "2016-02-19T02:25:31Z", "tenant_id": "5116bfd6f1ff4d35a26d266dd59e6ec9", "OS-DCF:diskConfig": "MANUAL", "os-extended-volumes:volumes_attached": [], "accessIPv4": "", "accessIPv6": "", "progress": 0, "OS-EXT-STS:power_state": 1, "config_drive": "", "metadata": {}}}
2016-02-18 18:26:03,501 14392 INFO [tempest_lib.common.rest_client] Request (TestServerAdvancedOps:_run_cleanups): 200 GET http://10.144.137.140:8774/v2.1/5116bfd6f1ff4d35a26d266dd59e6ec9/servers/e95f572d-3484-47eb-adea-082a1979f928 0.305s
2016-02-18 18:26:03,503 14392 DEBUG [tempest_lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'status': '200', 'content-length': '1424', 'content-location': 'http://10.144.137.140:8774/v2.1/5116bfd6f1ff4d35a26d266dd59e6ec9/servers/e95f572d-3484-47eb-adea-082a1979f928', 'x-compute-request-id': 'req-5572a149-5968-409d-a5a0-053836f9d285', 'vary': 'X-OpenStack-Nova-API-Version', 'connection': 'close', 'x-openstack-nova-api-version': '2.1', 'date': 'Fri, 19 Feb 2016 02:26:00 GMT', 'content-type': 'application/json'}
        Body: {"server": {"status": "DELETED", "updated": "2016-02-19T02:26:00Z", "hostId": "9c0e68e78ed2414b91351464d02ca6867cf9fb7d01f3d117601e02ab", "addresses": {}, "links": [{"href": "http://10.144.137.140:8774/v2.1/5116bfd6f1ff4d35a26d266dd59e6ec9/servers/e95f572d-3484-47eb-adea-082a1979f928", "rel": "self"}, {"href": "http://10.144.1...

Read more...

Revision history for this message
Sylvain Bauza (sylvain-bauza) wrote :

Not sure I get your problem. The error message is self-explicit : "Server disk was unable to be resized because: Resize to zero disk flavor is not allowed."

It seems the flavor you want for resizing your instance has a root_gb variable equals to 0. In that case, Nova doesn't accept to resize from an image-based instance to a volume-based one.

Setting the bug report as Invalid, but please move it back to New if you don't agree.

Changed in nova:
status: New → Invalid
Revision history for this message
Tong Liu (liutong) wrote :
Download full text (5.2 KiB)

The tempest log above is the initial failure due to "resize to zero disk flavor is not allowed". Later I tried with more disk manually, and it still failed during migration. Please see below for more information.
nicira@htb-1n-eng-dhcp8:/opt/stack/horizon$ nova show tj-test-resize
+--------------------------------------+----------------------------------------------------------------+
| Property | Value |
+--------------------------------------+----------------------------------------------------------------+
| OS-DCF:diskConfig | MANUAL |
| OS-EXT-AZ:availability_zone | nova |
| OS-EXT-STS:power_state | 1 |
| OS-EXT-STS:task_state | - |
| OS-EXT-STS:vm_state | active |
| OS-SRV-USG:launched_at | 2016-03-18T23:57:51.000000 |
| OS-SRV-USG:terminated_at | - |
| accessIPv4 | |
| accessIPv6 | |
| config_drive | |
| created | 2016-03-18T23:57:36Z |
| flavor | m1.nano (42) |
| hostId | 74913a7ca3224c89c2db0e23a8e8c19f658768fb2a47f26240836120 |
| id | 6a657875-fe4f-405d-9a50-d96d6cd1cd0a |
| image | cirros-0.3.3-x86_64-ESX (4939d898-cc68-432b-8067-ebfd2af82bb7) |
| key_name | - |
| metadata | {} |
| name | tj-test-resize |
| net1 network | 192.168.1.26 |
| os-extended-volumes:volumes_attached | [] |
| progress | 0 |
| security_groups | default |
| status | ACTIVE |
| tenant_id | e625475de6344113a6d22461402ead92 |
| updated | 2016-03-18T23:...

Read more...

Changed in nova:
status: Invalid → New
Revision history for this message
Tong Liu (liutong) wrote :
Download full text (72.1 KiB)

Adding log from related tempest run:
    Response - Headers: {'status': '200', 'content-length': '1411', 'content-location': 'http://10.116.254.63:8774/v2.1/deafe324147b43069f64771fb146fe83/servers/7e11e25a-d92d-4260-b866-41d63df96c52', 'x-compute-request-id': 'req-461d3f4f-827b-44c5-b5de-cce914fd5443', 'vary': 'X-OpenStack-Nova-API-Version', 'connection': 'close', 'x-openstack-nova-api-version': '2.1', 'date': 'Tue, 22 Mar 2016 21:55:10 GMT', 'content-type': 'application/json'}
        Body: {"server": {"status": "ACTIVE", "updated": "2016-03-22T21:55:10Z", "hostId": "9ce218709dd97c4c679ecb7c361b861568028f7d21bb1db7229d42c4", "addresses": {}, "links": [{"href": "http://10.116.254.63:8774/v2.1/deafe324147b43069f64771fb146fe83/servers/7e11e25a-d92d-4260-b866-41d63df96c52", "rel": "self"}, {"href": "http://10.116.254.63:8774/deafe324147b43069f64771fb146fe83/servers/7e11e25a-d92d-4260-b866-41d63df96c52", "rel": "bookmark"}], "key_name": null, "image": {"id": "27e31f48-e26f-4e01-aabf-b4af7af5559a", "links": [{"href": "http://10.116.254.63:8774/deafe324147b43069f64771fb146fe83/images/27e31f48-e26f-4e01-aabf-b4af7af5559a", "rel": "bookmark"}]}, "OS-EXT-STS:task_state": null, "OS-EXT-STS:vm_state": "active", "OS-SRV-USG:launched_at": "2016-03-22T21:55:10.000000", "flavor": {"id": "42", "links": [{"href": "http://10.116.254.63:8774/deafe324147b43069f64771fb146fe83/flavors/42", "rel": "bookmark"}]}, "id": "7e11e25a-d92d-4260-b866-41d63df96c52", "OS-SRV-USG:terminated_at": null, "OS-EXT-AZ:availability_zone": "nova", "user_id": "1f710e09a6dd4cbb8481652a98d395d1", "name": "tempest.common.compute-instance-1930282783", "created": "2016-03-22T21:55:00Z", "tenant_id": "deafe324147b43069f64771fb146fe83", "OS-DCF:diskConfig": "MANUAL", "os-extended-volumes:volumes_attached": [], "accessIPv4": "", "accessIPv6": "", "progress": 0, "OS-EXT-STS:power_state": 1, "config_drive": "", "metadata": {}}}
2016-03-22 14:51:24,439 15218 DEBUG [tempest.scenario.test_server_advanced_ops] Resizing instance 7e11e25a-d92d-4260-b866-41d63df96c52 from flavor 42 to flavor 1
2016-03-22 14:51:24,778 15218 INFO [tempest.lib.common.rest_client] Request (TestServerAdvancedOps:test_resize_server_confirm): 202 POST http://10.116.254.63:8774/v2.1/deafe324147b43069f64771fb146fe83/servers/7e11e25a-d92d-4260-b866-41d63df96c52/action 0.338s
2016-03-22 14:51:24,779 15218 DEBUG [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"resize": {"flavorRef": "1"}}
    Response - Headers: {'status': '202', 'content-length': '0', 'x-compute-request-id': 'req-edf74c9d-3f01-4364-8bcc-7e79aaf9e089', 'vary': 'X-OpenStack-Nova-API-Version', 'connection': 'close', 'x-openstack-nova-api-version': '2.1', 'date': 'Tue, 22 Mar 2016 21:55:10 GMT', 'content-type': 'application/json'}
        Body:
2016-03-22 14:51:24,937 15218 INFO [tempest.lib.common.rest_client] Request (TestServerAdvancedOps:test_resize_server_confirm): 200 GET http://10.116.254.63:8774/v2.1/deafe324147b43069f64771fb146fe83/servers/7e11e25a-d92d-4260-b866-41d63df96c52 0.157s
2016-03-22 14:51:24,938 15218 DEBUG [tempes...

Revision history for this message
Sylvain Bauza (sylvain-bauza) wrote :

Okay, I can see that the resize is failing, probably because it tries to JSON-decode a None string.

Are you sure you can't find anything in the n-cpu logs ? You could also take a look on the n-cond logs.

Anyway, I'm not a virt expert, but I don't know if it's possible to resize an instance from an ESX-backed file to a libvirt one, I guess it's probably not supported but I'll double-check.

Changed in nova:
status: New → Incomplete
Revision history for this message
Launchpad Janitor (janitor) wrote :

[Expired for OpenStack Compute (nova) because there has been no activity for 60 days.]

Changed in nova:
status: Incomplete → Expired
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.