Activity log for bug #1052640

Date Who What changed Old value New value Message
2012-09-18 19:53:08 Russell Bryant bug added bug
2012-09-18 19:55:05 Russell Bryant description The following commit change image downloading to be asynchronous: commit 41c164139cab619d0a3e0d97b80037f85eb541ad Author: Eoghan Glynn <eglynn@redhat.com> Date: Wed Sep 5 14:33:47 2012 +0000 Asynchronously copy from external image source Fixes bug 1008874, bug 1046433. Avoid tieing up dispatch thread for large copy-from images, instead initiate copy asynchronously. The response status is not set to 202 Accepted as per standard RESTful idiom, as a non-error response code change requires an API version bump. Instead, the incomplete nature of the image registration is reflected in the image status. Change-Id: I06692422490de0a7d93f63bbd0ffb9c6435a0d2b Unfortunately, it appears that there is a greenthread scheduling problem that still leaves glance-api in a bad state while the image is downloaded. [rbryant@f17-openstack-test-day ~]$ time glance add name=f16 is_public=true disk_format=qcow2 container_format=bare copy_from=http://berrange.fedorapeople.org/images/2012-02-29/f16-x86_64-openstack-sda.qcow2 Added new image with ID: 9717656c-2564-4b15-812c-8706ca038d2c real 0m0.715s user 0m0.117s sys 0m0.033s [rbryant@f17-openstack-test-day ~]$ time glance index ID Name Disk Format Container Format Size ------------------------------------ ------------------------------ -------------------- -------------------- -------------- 9717656c-2564-4b15-812c-8706ca038d2c f16 qcow2 bare 213581824 real 1m11.992s user 0m0.109s sys 0m0.022s [rbryant@f17-openstack-test-day ~]$ time glance index ID Name Disk Format Container Format Size ------------------------------------ ------------------------------ -------------------- -------------------- -------------- 9717656c-2564-4b15-812c-8706ca038d2c f16 qcow2 bare 213581824 real 1m1.287s user 0m0.124s sys 0m0.061s (repeat 'time glance index' 4 more times, with times varying from 1 to 1.5 minutes) [rbryant@f17-openstack-test-day ~]$ time glance index ID Name Disk Format Container Format Size ------------------------------------ ------------------------------ -------------------- -------------------- -------------- 9717656c-2564-4b15-812c-8706ca038d2c f16 qcow2 bare 213581824 real 0m24.255s user 0m0.125s sys 0m0.034s [rbryant@f17-openstack-test-day ~]$ time glance index ID Name Disk Format Container Format Size ------------------------------------ ------------------------------ -------------------- -------------------- -------------- 9717656c-2564-4b15-812c-8706ca038d2c f16 qcow2 bare 213581824 real 0m0.443s user 0m0.110s sys 0m0.017s (all further instances return quickly like this) The following commit changed image downloading when using copy_from to be asynchronous: commit 41c164139cab619d0a3e0d97b80037f85eb541ad Author: Eoghan Glynn <eglynn@redhat.com> Date: Wed Sep 5 14:33:47 2012 +0000     Asynchronously copy from external image source     Fixes bug 1008874, bug 1046433.     Avoid tieing up dispatch thread for large copy-from images,     instead initiate copy asynchronously.     The response status is not set to 202 Accepted as per standard     RESTful idiom, as a non-error response code change requires     an API version bump.     Instead, the incomplete nature of the image registration is     reflected in the image status.     Change-Id: I06692422490de0a7d93f63bbd0ffb9c6435a0d2b Unfortunately, it appears that there is a greenthread scheduling problem that still leaves glance-api in a bad state while the image is downloaded. [rbryant@f17-openstack-test-day ~]$ time glance add name=f16 is_public=true disk_format=qcow2 container_format=bare copy_from=http://berrange.fedorapeople.org/images/2012-02-29/f16-x86_64-openstack-sda.qcow2 Added new image with ID: 9717656c-2564-4b15-812c-8706ca038d2c real 0m0.715s user 0m0.117s sys 0m0.033s [rbryant@f17-openstack-test-day ~]$ time glance index ID Name Disk Format Container Format Size ------------------------------------ ------------------------------ -------------------- -------------------- -------------- 9717656c-2564-4b15-812c-8706ca038d2c f16 qcow2 bare 213581824 real 1m11.992s user 0m0.109s sys 0m0.022s [rbryant@f17-openstack-test-day ~]$ time glance index ID Name Disk Format Container Format Size ------------------------------------ ------------------------------ -------------------- -------------------- -------------- 9717656c-2564-4b15-812c-8706ca038d2c f16 qcow2 bare 213581824 real 1m1.287s user 0m0.124s sys 0m0.061s (repeat 'time glance index' 4 more times, with times varying from 1 to 1.5 minutes) [rbryant@f17-openstack-test-day ~]$ time glance index ID Name Disk Format Container Format Size ------------------------------------ ------------------------------ -------------------- -------------------- -------------- 9717656c-2564-4b15-812c-8706ca038d2c f16 qcow2 bare 213581824 real 0m24.255s user 0m0.125s sys 0m0.034s [rbryant@f17-openstack-test-day ~]$ time glance index ID Name Disk Format Container Format Size ------------------------------------ ------------------------------ -------------------- -------------------- -------------- 9717656c-2564-4b15-812c-8706ca038d2c f16 qcow2 bare 213581824 real 0m0.443s user 0m0.110s sys 0m0.017s (all further instances return quickly like this)
2012-09-18 19:55:18 Russell Bryant bug added subscriber Eoghan Glynn
2012-09-18 21:09:06 Russell Bryant tags folsom-rc-potential
2012-09-18 21:22:01 Brian Waldon glance: assignee Eoghan Glynn (eglynn)
2012-09-18 21:22:04 Brian Waldon glance: milestone grizzly-1
2012-09-18 21:22:07 Brian Waldon glance: status New In Progress
2012-09-18 21:22:09 Brian Waldon glance: importance Undecided Critical
2012-09-18 21:22:15 Brian Waldon nominated for series glance/folsom
2012-09-18 21:22:15 Brian Waldon bug task added glance/folsom
2012-09-18 21:22:15 Brian Waldon nominated for series glance/grizzly
2012-09-18 21:22:15 Brian Waldon bug task added glance/grizzly
2012-09-18 21:23:12 Brian Waldon glance/grizzly: milestone folsom-rc2
2012-09-18 21:23:18 Brian Waldon tags folsom-rc-potential
2012-09-18 21:23:58 Brian Waldon glance/grizzly: assignee Eoghan Glynn (eglynn)
2012-09-18 21:24:09 Brian Waldon glance/folsom: milestone grizzly-1 folsom-rc2
2012-09-18 21:24:11 Brian Waldon glance/grizzly: milestone folsom-rc2 grizzly-1
2012-09-18 21:24:46 Brian Waldon glance/grizzly: importance Undecided Critical
2012-09-18 21:24:55 Brian Waldon glance/grizzly: status New In Progress
2012-09-19 08:29:59 Thierry Carrez bug task deleted glance/grizzly
2012-09-19 08:30:06 Thierry Carrez bug task deleted glance/folsom
2012-09-19 10:49:31 Eoghan Glynn summary glance-api unresponsive while downloading an image with copy_from glance-api unresponsive during long-lived I/O-bound operations
2012-09-20 07:45:44 OpenStack Infra glance: status In Progress Fix Committed
2012-09-20 13:32:19 OpenStack Infra glance: status Fix Committed Fix Released
2012-09-27 14:47:04 Thierry Carrez glance: milestone folsom-rc2 2012.2