Glance: checksum verification failed

[Dennis Dmitriev]

Cluster configuration:
- CentOS/HA
- Nova-network/FlatDHCP , network tagging
- Cinder LVM

- 3 controllers (1 cpu / 4Gb ram)
- 2 compute (4 cpu / 8Gb ram + 1 cpu / 4Gb ram)
- 1 cinder (1 cpu / 4Gb ram)
all nodes have 100Gb hdd.

Sahara image for testing: http://sahara-files.mirantis.com/mos60/sahara-juno-vanilla-1.2.1-ubuntu-14.04.qcow2

- Network verification passed
- All OSTF tests passed except Sahara test.

On compute nodes can be found the following errors:
========================================
2014-12-24T09:04:34.247304+00:00 err: Instance failed to spawn
....
2014-12-24 09:04:34.243 1716 TRACE nova.compute.manager [instance: e5c11443-8a34-4610-a80f-ba4f0fe34963] IMAGE_API.download(context, image_href, dest_path=path)
...
2014-12-24 09:04:34.243 1716 TRACE nova.compute.manager [instance: e5c11443-8a34-4610-a80f-ba4f0fe34963] raise IncompleteRead(''.join(value))
2014-12-24 09:04:34.243 1716 TRACE nova.compute.manager [instance: e5c11443-8a34-4610-a80f-ba4f0fe34963] IncompleteRead: IncompleteRead(0 bytes read)

On the controllers in glance-api.log (node-1 for exapmle):
=======================================
2014-12-24 09:05:41.851 17290 TRACE glance.image_cache
2014-12-24T09:05:41.854381+00:00 info: 2014-12-24 09:05:41.854 17290 INFO glance.wsgi.server [-] Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/eventlet/wsgi.py", line 449, in handle_one_response
    for data in result:
  File "/usr/lib/python2.6/site-packages/glance/image_cache/__init__.py", line 266, in cache_tee_iter
    LOG.exception(utils.exception_to_str(e))
  File "/usr/lib/python2.6/site-packages/glance/openstack/common/excutils.py", line 82, in __exit__
    six.reraise(self.type_, self.value, self.tb)
  File "/usr/lib/python2.6/site-packages/glance/image_cache/__init__.py", line 260, in cache_tee_iter
    raise exception.GlanceException(msg)
GlanceException: Checksum verification failed. Aborted caching of image '2acee1a1-8529-483a-8530-e67ea6713ed4'.

Sahara images are accessible and downloadable via glance CLI.

[ruhe (ruhe)]

This is a bug related to Glance code. Thus, re-assigning it to mos-glance team and to MOS project.

[Alexander Tivelkov (ativelkov)]

It seems like the statement "Sahara images are accessible and downloadable via glance CLI" is wrong: I was not able to download the image using glance CLI: got the same error about checksum mismatch.

It seems like the image got corrupt during the upload process. No ideas why it could happen, but the it seems probable that it may be caused by the remote source being too slow.

I was not able to re-import the image using the "glance image-create --copy-from" command - same as https://bugs.launchpad.net/mos/+bug/1401118. Most probably this is the same issue.

When I manually dowloaded the image locally and the created it in glance with "--file" option, everything works fine

[Dennis Dmitriev (ddmitriev)]

Image sometimes has "Killed" status , but sometimes it is uploaded and 'Active'. This bug is about cases with 'Active' image uploaded via http link.

Reproduced on Sahara test on another enviromnent: CentOS/HA with bonding enabled, neutron/vlan, ceph for vol/images.

I uploaded the same image twice (from http://sahara-files.mirantis.com and from web server located near the host with the OpenStack cluster).

Downloading image after first upload:
http://paste.openstack.org/show/154634/

Downloading image after second upload:
http://paste.openstack.org/show/154635/

As you see, in both cases there is the same 'Checksum was edee33464fddc73fcc02928a6d6fa774' and it is incorrect:

$ md5sum ./sahara-juno-vanilla-1.2.1-ubuntu-14.04.qcow2
ad380fabb47245f8ae63d764c3758b89 ./sahara-juno-vanilla-1.2.1-ubuntu-14.04.qcow2

[Dennis Dmitriev (ddmitriev)]

Sorry, wrong config in #6 , no Ceph was used. Cinder LVM in both cases.

[Dennis Dmitriev (ddmitriev)]

Looks like images uploaded via Horizon UI were not fully uploaded.
I took an ISO image with size (in bytes): 3919179776 , but was uploaded only 3686400000.

======== Image name: fuel-6.1 , node-6 - one of the controllers.

[root@node-6 ~]# glance image-list
+--------------------------------------+----------+-------------+------------------+------------+--------+
| ID | Name | Disk Format | Container Format | Size | Status |
+--------------------------------------+----------+-------------+------------------+------------+--------+
| d6222f48-bb3c-41f2-9305-da1e5a0e7a5e | fuel-6.1 | iso | bare | 3919179776 | active |
| 6a301e61-7af4-4dc5-b54b-ff4f0fa22b18 | sahara | qcow2 | bare | 960954368 | active |
| 68f35445-72cf-4cb7-83db-94b918cdea86 | TestVM | qcow2 | bare | 13167616 | active |
+--------------------------------------+----------+-------------+------------------+------------+--------+

[root@node-6 ~]# glance image-download d6222f48-bb3c-41f2-9305-da1e5a0e7a5e > /dev/null
[Errno 32] Corrupt image download. Checksum was 722362a3851b0d209aab8d4aa2aa617d expected b290418be48990a599b15eedd9bd12c9

=== Checksum of the original image really is b290418be48990a599b15eedd9bd12c9.

[root@node-6 ~]# ls -la /var/lib/glance/image-cache/invalid/d6222f48-bb3c-41f2-9305-da1e5a0e7a5e
-rw-r----- 1 glance glance 3686400000 Dec 26 10:12 /var/lib/glance/image-cache/invalid/d6222f48-bb3c-41f2-9305-da1e5a0e7a5e
[root@node-6 ~]# md5sum /var/lib/glance/image-cache/invalid/d6222f48-bb3c-41f2-9305-da1e5a0e7a5e
722362a3851b0d209aab8d4aa2aa617d /var/lib/glance/image-cache/invalid/d6222f48-bb3c-41f2-9305-da1e5a0e7a5e

--------

In the /var/lib/glance/node/ there are 18 parts with size 204800000 bytes, total size 3686400000. Last part(s) was not stored to glance although it's checksum was counted properly.

[Dennis Dmitriev (ddmitriev)]

When the image was uploading to glance, in swift should stored chunks in size 218103808 : http://paste.openstack.org/show/154804/

But in fact chunks size is 204800000, and last stored chunk number is (18/20).

glance-api.log from node-7 is attached. Please look at the time frame between 2014-12-26 00:20 - 00:45 in the logs, when the image d6222f48-bb3c-41f2-9305-da1e5a0e7a5e was uploading. I cannot attach full diagnostic snapshot because of big size (~2Gb logs).

Latelly, when I were downloading the image via glance cli on node-5 (primary controller), the following error appeared in glance-api.log: "Message objects do not support str() because they may contain non-ascii characters. Please use unicode() or translate() instead..". Possible that this is another issue.
http://paste.openstack.org/show/154805/

[OSCI Robot (oscirobot)]

RPM package glance has been built for project openstack/glance
Package version == 2014.1.3, package release == fuel5.1.2.mira3.git.aafb8b5.74b86c5

Changeset: https://review.fuel-infra.org/2173
project: openstack/glance
branch: openstack-ci/fuel-5.1.2/2014.1.1
author: Alexander Tivelkov
committer: Alexander Tivelkov
subject: Fix for CooperativeReader to properly process read length
status: patchset-created

Files placed on repository:
openstack-glance-2014.1.3-fuel5.1.2.mira3.git.aafb8b5.74b86c5.noarch.rpm
openstack-glance-doc-2014.1.3-fuel5.1.2.mira3.git.aafb8b5.74b86c5.noarch.rpm
python-glance-2014.1.3-fuel5.1.2.mira3.git.aafb8b5.74b86c5.noarch.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-5.1.2-stable-2173/centos

[OSCI Robot (oscirobot)]

DEB package glance has been built for project openstack/glance
Package version == 2014.1.3, package release == fuel5.1.2~mira2+git.aafb8b5.74b86c5

Changeset: https://review.fuel-infra.org/2173
project: openstack/glance
branch: openstack-ci/fuel-5.1.2/2014.1.1
author: Alexander Tivelkov
committer: Alexander Tivelkov
subject: Fix for CooperativeReader to properly process read length
status: patchset-created

Files placed on repository:
glance-api_2014.1.3-fuel5.1.2~mira2+git.aafb8b5.74b86c5_all.deb
glance-common_2014.1.3-fuel5.1.2~mira2+git.aafb8b5.74b86c5_all.deb
glance-registry_2014.1.3-fuel5.1.2~mira2+git.aafb8b5.74b86c5_all.deb
glance_2014.1.3-fuel5.1.2~mira2+git.aafb8b5.74b86c5_all.deb
python-glance-doc_2014.1.3-fuel5.1.2~mira2+git.aafb8b5.74b86c5_all.deb
python-glance_2014.1.3-fuel5.1.2~mira2+git.aafb8b5.74b86c5_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-5.1.2-stable-2173/ubuntu

[OSCI Robot (oscirobot)]

RPM package glance has been built for project openstack/glance
Package version == 2014.2, package release == fuel6.0.1.mira10.git.fae64fd.3babba9

Changeset: https://review.fuel-infra.org/2174
project: openstack/glance
branch: openstack-ci/fuel-6.0.1/2014.2
author: Alexander Tivelkov
committer: Alexander Tivelkov
subject: Fix for CooperativeReader to properly process read length
status: patchset-created

Files placed on repository:
openstack-glance-2014.2-fuel6.0.1.mira10.git.fae64fd.3babba9.noarch.rpm
openstack-glance-doc-2014.2-fuel6.0.1.mira10.git.fae64fd.3babba9.noarch.rpm
python-glance-2014.2-fuel6.0.1.mira10.git.fae64fd.3babba9.noarch.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-6.0.1-stable-2174/centos

[OSCI Robot (oscirobot)]

DEB package glance has been built for project openstack/glance
Package version == 2014.2, package release == fuel6.0.1~mira10+git.fae64fd.3babba9

Changeset: https://review.fuel-infra.org/2174
project: openstack/glance
branch: openstack-ci/fuel-6.0.1/2014.2
author: Alexander Tivelkov
committer: Alexander Tivelkov
subject: Fix for CooperativeReader to properly process read length
status: patchset-created

Files placed on repository:
glance-api_2014.2-fuel6.0.1~mira10+git.fae64fd.3babba9_all.deb
glance-common_2014.2-fuel6.0.1~mira10+git.fae64fd.3babba9_all.deb
glance-registry_2014.2-fuel6.0.1~mira10+git.fae64fd.3babba9_all.deb
glance_2014.2-fuel6.0.1~mira10+git.fae64fd.3babba9_all.deb
python-glance-doc_2014.2-fuel6.0.1~mira10+git.fae64fd.3babba9_all.deb
python-glance_2014.2-fuel6.0.1~mira10+git.fae64fd.3babba9_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-6.0.1-stable-2174/ubuntu

[OSCI Robot (oscirobot)]

RPM package glance has been built for project openstack/glance
Package version == 2014.2, package release == fuel6.1.mira10.git.32a3b49.3babba9

Changeset: https://review.fuel-infra.org/2175
project: openstack/glance
branch: openstack-ci/fuel-6.1/2014.2
author: Alexander Tivelkov
committer: Alexander Tivelkov
subject: Fix for CooperativeReader to properly process read length
status: patchset-created

Files placed on repository:
openstack-glance-2014.2-fuel6.1.mira10.git.32a3b49.3babba9.noarch.rpm
openstack-glance-doc-2014.2-fuel6.1.mira10.git.32a3b49.3babba9.noarch.rpm
python-glance-2014.2-fuel6.1.mira10.git.32a3b49.3babba9.noarch.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-6.1-stable-2175/centos

[OSCI Robot (oscirobot)]

DEB package glance has been built for project openstack/glance
Package version == 2014.2, package release == fuel6.1~mira10+git.32a3b49.3babba9

Changeset: https://review.fuel-infra.org/2175
project: openstack/glance
branch: openstack-ci/fuel-6.1/2014.2
author: Alexander Tivelkov
committer: Alexander Tivelkov
subject: Fix for CooperativeReader to properly process read length
status: patchset-created

Files placed on repository:
glance-api_2014.2-fuel6.1~mira10+git.32a3b49.3babba9_all.deb
glance-common_2014.2-fuel6.1~mira10+git.32a3b49.3babba9_all.deb
glance-registry_2014.2-fuel6.1~mira10+git.32a3b49.3babba9_all.deb
glance_2014.2-fuel6.1~mira10+git.32a3b49.3babba9_all.deb
python-glance-doc_2014.2-fuel6.1~mira10+git.32a3b49.3babba9_all.deb
python-glance_2014.2-fuel6.1~mira10+git.32a3b49.3babba9_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-6.1-stable-2175/ubuntu

[OSCI Robot (oscirobot)]

RPM package glance has been built for project openstack/glance
Package version == 2014.2, package release == fuel6.1.mira10

Changeset: https://review.fuel-infra.org/2175
project: openstack/glance
branch: openstack-ci/fuel-6.1/2014.2
author: Alexander Tivelkov
committer: Alexander Tivelkov
subject: Fix for CooperativeReader to properly process read length
status: change-merged

Files placed on repository:
openstack-glance-2014.2-fuel6.1.mira10.noarch.rpm
openstack-glance-doc-2014.2-fuel6.1.mira10.noarch.rpm
python-glance-2014.2-fuel6.1.mira10.noarch.rpm

Changeset merged. Package placed on primary repository
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-6.1-stable/centos

[OSCI Robot (oscirobot)]

DEB package glance has been built for project openstack/glance
Package version == 2014.2, package release == fuel6.1~mira10

Changeset: https://review.fuel-infra.org/2175
project: openstack/glance
branch: openstack-ci/fuel-6.1/2014.2
author: Alexander Tivelkov
committer: Alexander Tivelkov
subject: Fix for CooperativeReader to properly process read length
status: change-merged

Files placed on repository:
glance-api_2014.2-fuel6.1~mira10_all.deb
glance-common_2014.2-fuel6.1~mira10_all.deb
glance-registry_2014.2-fuel6.1~mira10_all.deb
glance_2014.2-fuel6.1~mira10_all.deb
python-glance-doc_2014.2-fuel6.1~mira10_all.deb
python-glance_2014.2-fuel6.1~mira10_all.deb

Changeset merged. Package placed on primary repository
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-6.1-stable/ubuntu

[OSCI Robot (oscirobot)]

RPM package glance has been built for project openstack/glance
Package version == 2014.1.1, package release == fuel5.1.mira4.git.3d6e3cd.2144c72

Changeset: https://review.fuel-infra.org/2754
project: openstack/glance
branch: openstack-ci/fuel-5.1/2014.1.1
author: Alexandr Nevenchannyy
committer: Alexandr Nevenchannyy
subject: Fix for CooperativeReader to properly process read length
status: patchset-created

Files placed on repository:
openstack-glance-2014.1.1-fuel5.1.mira4.git.3d6e3cd.2144c72.noarch.rpm
openstack-glance-doc-2014.1.1-fuel5.1.mira4.git.3d6e3cd.2144c72.noarch.rpm
python-glance-2014.1.1-fuel5.1.mira4.git.3d6e3cd.2144c72.noarch.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-5.1-stable-2754/centos

[OSCI Robot (oscirobot)]

DEB package glance has been built for project openstack/glance
Package version == 2014.1.1, package release == fuel5.1~mira11+git.3d6e3cd.2144c72

Changeset: https://review.fuel-infra.org/2754
project: openstack/glance
branch: openstack-ci/fuel-5.1/2014.1.1
author: Alexandr Nevenchannyy
committer: Alexandr Nevenchannyy
subject: Fix for CooperativeReader to properly process read length
status: patchset-created

Files placed on repository:
glance-api_2014.1.1-fuel5.1~mira11+git.3d6e3cd.2144c72_all.deb
glance-common_2014.1.1-fuel5.1~mira11+git.3d6e3cd.2144c72_all.deb
glance-registry_2014.1.1-fuel5.1~mira11+git.3d6e3cd.2144c72_all.deb
glance_2014.1.1-fuel5.1~mira11+git.3d6e3cd.2144c72_all.deb
python-glance-doc_2014.1.1-fuel5.1~mira11+git.3d6e3cd.2144c72_all.deb
python-glance_2014.1.1-fuel5.1~mira11+git.3d6e3cd.2144c72_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-5.1-stable-2754/ubuntu

[OSCI Robot (oscirobot)]

DEB package glance has been built for project openstack/glance
Package version == 2014.1, package release == fuel5.1~mira11+git.b9cbc31.3b0b916

Changeset: https://review.fuel-infra.org/2773
project: openstack/glance
branch: openstack-ci/fuel-5.1/2014.1
author: Alexandr Nevenchannyy
committer: Alexandr Nevenchannyy
subject: Fix for CooperativeReader to properly process read length
status: patchset-created

Files placed on repository:
glance-api_2014.1-fuel5.1~mira11+git.b9cbc31.3b0b916_all.deb
glance-common_2014.1-fuel5.1~mira11+git.b9cbc31.3b0b916_all.deb
glance-registry_2014.1-fuel5.1~mira11+git.b9cbc31.3b0b916_all.deb
glance_2014.1-fuel5.1~mira11+git.b9cbc31.3b0b916_all.deb
python-glance-doc_2014.1-fuel5.1~mira11+git.b9cbc31.3b0b916_all.deb
python-glance_2014.1-fuel5.1~mira11+git.b9cbc31.3b0b916_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-5.1-stable-2773/ubuntu

[Kyrylo Romanenko (kromanenko)]

I tried to deploy configuration to verify current issue, but stuck on deployment.
It`s described in issue https://bugs.launchpad.net/mos/+bug/1424708

[OSCI Robot (oscirobot)]

RPM package glance has been built for project openstack/glance
Package version == 2014.2.2, package release == fuel6.0.1.mira1.git.09ea6e3.3babba9

Changeset: https://review.fuel-infra.org/3830
project: openstack/glance
branch: openstack-ci/fuel-6.0.1/2014.2
author: Mikhail Fedosin
committer: Mikhail Fedosin
subject: Fix for CooperativeReader to process read length
status: patchset-created

Files placed on repository:
openstack-glance-2014.2.2-fuel6.0.1.mira1.git.09ea6e3.3babba9.noarch.rpm
openstack-glance-doc-2014.2.2-fuel6.0.1.mira1.git.09ea6e3.3babba9.noarch.rpm
python-glance-2014.2.2-fuel6.0.1.mira1.git.09ea6e3.3babba9.noarch.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-6.0.1-stable-3830/centos

[OSCI Robot (oscirobot)]

package glance has been built for project openstack/glance
Package version == 2014.2, package release == fuel6.1.mira21.git.8e65d35.3babba9

Changeset: https://review.fuel-infra.org/3829
project: openstack/glance
branch: openstack-ci/fuel-6.1/2014.2
author: Mikhail Fedosin
committer: Mikhail Fedosin
subject: Fix for CooperativeReader to process read length
status: patchset-created

Files placed on repository:

NOTE: Changeset is not merged, created temporary package repository.
 repository URL: /centos-fuel-6.1-stable-3829/

[OSCI Robot (oscirobot)]

DEB package glance has been built for project openstack/glance
Package version == 2014.2.2, package release == fuel6.0.1~mira1+git.09ea6e3.3babba9

Changeset: https://review.fuel-infra.org/3830
project: openstack/glance
branch: openstack-ci/fuel-6.0.1/2014.2
author: Mikhail Fedosin
committer: Mikhail Fedosin
subject: Fix for CooperativeReader to process read length
status: patchset-created

Files placed on repository:
glance-api_2014.2.2-fuel6.0.1~mira1+git.09ea6e3.3babba9_all.deb
glance-common_2014.2.2-fuel6.0.1~mira1+git.09ea6e3.3babba9_all.deb
glance-registry_2014.2.2-fuel6.0.1~mira1+git.09ea6e3.3babba9_all.deb
glance_2014.2.2-fuel6.0.1~mira1+git.09ea6e3.3babba9_all.deb
python-glance-doc_2014.2.2-fuel6.0.1~mira1+git.09ea6e3.3babba9_all.deb
python-glance_2014.2.2-fuel6.0.1~mira1+git.09ea6e3.3babba9_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-6.0.1-stable-3830/ubuntu

[OSCI Robot (oscirobot)]

package glance has been built for project openstack/glance
Package version == 2014.2, package release == fuel6.1~mira16+git.8e65d35.3babba9

Changeset: https://review.fuel-infra.org/3829
project: openstack/glance
branch: openstack-ci/fuel-6.1/2014.2
author: Mikhail Fedosin
committer: Mikhail Fedosin
subject: Fix for CooperativeReader to process read length
status: patchset-created

Files placed on repository:

NOTE: Changeset is not merged, created temporary package repository.
 repository URL: /ubuntu-fuel-6.1-stable-3829/

[OSCI Robot (oscirobot)]

RPM package glance has been built for project openstack/glance
Package version == 2014.2.2, package release == fuel6.0.1.mira2.git.bd03a2c.3babba9

Changeset: https://review.fuel-infra.org/3830
project: openstack/glance
branch: openstack-ci/fuel-6.0.1/2014.2
author: Mikhail Fedosin
committer: Mikhail Fedosin
subject: Fix for CooperativeReader to process read length
status: patchset-created

Files placed on repository:
openstack-glance-2014.2.2-fuel6.0.1.mira2.git.bd03a2c.3babba9.noarch.rpm
openstack-glance-doc-2014.2.2-fuel6.0.1.mira2.git.bd03a2c.3babba9.noarch.rpm
python-glance-2014.2.2-fuel6.0.1.mira2.git.bd03a2c.3babba9.noarch.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-6.0.1-stable-3830/centos

[OSCI Robot (oscirobot)]

DEB package glance has been built for project openstack/glance
Package version == 2014.2.2, package release == fuel6.0.1~mira2+git.bd03a2c.3babba9

Changeset: https://review.fuel-infra.org/3830
project: openstack/glance
branch: openstack-ci/fuel-6.0.1/2014.2
author: Mikhail Fedosin
committer: Mikhail Fedosin
subject: Fix for CooperativeReader to process read length
status: patchset-created

Files placed on repository:
glance-api_2014.2.2-fuel6.0.1~mira2+git.bd03a2c.3babba9_all.deb
glance-common_2014.2.2-fuel6.0.1~mira2+git.bd03a2c.3babba9_all.deb
glance-registry_2014.2.2-fuel6.0.1~mira2+git.bd03a2c.3babba9_all.deb
glance_2014.2.2-fuel6.0.1~mira2+git.bd03a2c.3babba9_all.deb
python-glance-doc_2014.2.2-fuel6.0.1~mira2+git.bd03a2c.3babba9_all.deb
python-glance_2014.2.2-fuel6.0.1~mira2+git.bd03a2c.3babba9_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-6.0.1-stable-3830/ubuntu

[OSCI Robot (oscirobot)]

RPM package glance has been built for project openstack/glance
Package version == 2014.2.2, package release == fuel6.0.1.mira2.git.fa479c3.3babba9

Changeset: https://review.fuel-infra.org/3830
project: openstack/glance
branch: openstack-ci/fuel-6.0.1/2014.2
author: Mikhail Fedosin
committer: Mikhail Fedosin
subject: Fix for CooperativeReader to process read length
status: patchset-created

Files placed on repository:
openstack-glance-2014.2.2-fuel6.0.1.mira2.git.fa479c3.3babba9.noarch.rpm
openstack-glance-doc-2014.2.2-fuel6.0.1.mira2.git.fa479c3.3babba9.noarch.rpm
python-glance-2014.2.2-fuel6.0.1.mira2.git.fa479c3.3babba9.noarch.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-6.0.1-stable-3830/centos

[OSCI Robot (oscirobot)]

DEB package glance has been built for project openstack/glance
Package version == 2014.2.2, package release == fuel6.0.1~mira2+git.fa479c3.3babba9

Changeset: https://review.fuel-infra.org/3830
project: openstack/glance
branch: openstack-ci/fuel-6.0.1/2014.2
author: Mikhail Fedosin
committer: Mikhail Fedosin
subject: Fix for CooperativeReader to process read length
status: patchset-created

Files placed on repository:
glance-api_2014.2.2-fuel6.0.1~mira2+git.fa479c3.3babba9_all.deb
glance-common_2014.2.2-fuel6.0.1~mira2+git.fa479c3.3babba9_all.deb
glance-registry_2014.2.2-fuel6.0.1~mira2+git.fa479c3.3babba9_all.deb
glance_2014.2.2-fuel6.0.1~mira2+git.fa479c3.3babba9_all.deb
python-glance-doc_2014.2.2-fuel6.0.1~mira2+git.fa479c3.3babba9_all.deb
python-glance_2014.2.2-fuel6.0.1~mira2+git.fa479c3.3babba9_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-6.0.1-stable-3830/ubuntu

[OSCI Robot (oscirobot)]

RPM package glance has been built for project openstack/glance
Package version == 2014.2.2, package release == fuel6.0.1.mira2

Changeset: https://review.fuel-infra.org/3830
project: openstack/glance
branch: openstack-ci/fuel-6.0.1/2014.2
author: Mikhail Fedosin
committer: Mikhail Fedosin
subject: Fix for CooperativeReader to process read length
status: change-merged

Files placed on repository:
openstack-glance-2014.2.2-fuel6.0.1.mira2.noarch.rpm
openstack-glance-doc-2014.2.2-fuel6.0.1.mira2.noarch.rpm
python-glance-2014.2.2-fuel6.0.1.mira2.noarch.rpm

Changeset merged. Package placed on primary repository
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-6.0.1-stable/centos

[OSCI Robot (oscirobot)]

package glance has been built for project openstack/glance
Package version == 2014.2.2, package release == fuel6.1.mira1.git.97feba3.3babba9

Changeset: https://review.fuel-infra.org/3829
project: openstack/glance
branch: openstack-ci/fuel-6.1/2014.2
author: Mikhail Fedosin
committer: Alexander Tivelkov
subject: Fix for CooperativeReader to process read length
status: patchset-created

Files placed on repository:

NOTE: Changeset is not merged, created temporary package repository.
 repository URL: /centos-fuel-6.1-stable-3829/

[OSCI Robot (oscirobot)]

package glance has been built for project openstack/glance
Package version == 2014.2.2, package release == fuel6.1~mira1+git.97feba3.3babba9

Changeset: https://review.fuel-infra.org/3829
project: openstack/glance
branch: openstack-ci/fuel-6.1/2014.2
author: Mikhail Fedosin
committer: Alexander Tivelkov
subject: Fix for CooperativeReader to process read length
status: patchset-created

Files placed on repository:

NOTE: Changeset is not merged, created temporary package repository.
 repository URL: /ubuntu-fuel-6.1-stable-3829/

[OSCI Robot (oscirobot)]

DEB package glance has been built for project openstack/glance
Package version == 2014.2.2, package release == fuel6.0.1~mira2

Changeset: https://review.fuel-infra.org/3830
project: openstack/glance
branch: openstack-ci/fuel-6.0.1/2014.2
author: Mikhail Fedosin
committer: Mikhail Fedosin
subject: Fix for CooperativeReader to process read length
status: change-merged

Files placed on repository:
glance-api_2014.2.2-fuel6.0.1~mira2_all.deb
glance-common_2014.2.2-fuel6.0.1~mira2_all.deb
glance-registry_2014.2.2-fuel6.0.1~mira2_all.deb
glance_2014.2.2-fuel6.0.1~mira2_all.deb
python-glance-doc_2014.2.2-fuel6.0.1~mira2_all.deb
python-glance_2014.2.2-fuel6.0.1~mira2_all.deb

Changeset merged. Package placed on primary repository
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-6.0.1-stable/ubuntu

[OSCI Robot (oscirobot)]

package glance has been built for project openstack/glance
Package version == 2014.2.2, package release == fuel6.1.mira2

Changeset: https://review.fuel-infra.org/3829
project: openstack/glance
branch: openstack-ci/fuel-6.1/2014.2
author: Mikhail Fedosin
committer: Alexander Tivelkov
subject: Fix for CooperativeReader to process read length
status: change-merged

Files placed on repository:

Changeset merged. Package placed on primary repository
 repository URL: /centos-fuel-6.1-stable/

[OSCI Robot (oscirobot)]

package glance has been built for project openstack/glance
Package version == 2014.2.2, package release == fuel6.1~mira2

Changeset: https://review.fuel-infra.org/3829
project: openstack/glance
branch: openstack-ci/fuel-6.1/2014.2
author: Mikhail Fedosin
committer: Alexander Tivelkov
subject: Fix for CooperativeReader to process read length
status: change-merged

Files placed on repository:

Changeset merged. Package placed on primary repository
 repository URL: /ubuntu-fuel-6.1-stable/

[OSCI Robot (oscirobot)]

RPM package glance has been built for project openstack/glance
Package version == 2014.1.3, package release == fuel5.1.1.mira3.git.9cc6b55.74b86c5

Changeset: https://review.fuel-infra.org/4406
project: openstack/glance
branch: openstack-ci/fuel-5.1.1-updates/2014.1.1
author: Alexandr Nevenchannyy
committer: Alexandr Nevenchannyy
subject: Fix for CooperativeReader to process read length
status: patchset-created

Files placed on repository:
openstack-glance-2014.1.3-fuel5.1.1.mira3.git.9cc6b55.74b86c5.noarch.rpm
openstack-glance-doc-2014.1.3-fuel5.1.1.mira3.git.9cc6b55.74b86c5.noarch.rpm
python-glance-2014.1.3-fuel5.1.1.mira3.git.9cc6b55.74b86c5.noarch.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-5.1.1-updates-stable-4406/centos

[OSCI Robot (oscirobot)]

DEB package glance has been built for project openstack/glance
Package version == 2014.1.3, package release == fuel5.1.1~mira2+git.9cc6b55.74b86c5

Changeset: https://review.fuel-infra.org/4406
project: openstack/glance
branch: openstack-ci/fuel-5.1.1-updates/2014.1.1
author: Alexandr Nevenchannyy
committer: Alexandr Nevenchannyy
subject: Fix for CooperativeReader to process read length
status: patchset-created

Files placed on repository:
glance-api_2014.1.3-fuel5.1.1~mira2+git.9cc6b55.74b86c5_all.deb
glance-common_2014.1.3-fuel5.1.1~mira2+git.9cc6b55.74b86c5_all.deb
glance-registry_2014.1.3-fuel5.1.1~mira2+git.9cc6b55.74b86c5_all.deb
glance_2014.1.3-fuel5.1.1~mira2+git.9cc6b55.74b86c5_all.deb
python-glance-doc_2014.1.3-fuel5.1.1~mira2+git.9cc6b55.74b86c5_all.deb
python-glance_2014.1.3-fuel5.1.1~mira2+git.9cc6b55.74b86c5_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-5.1.1-updates-stable-4406/ubuntu

[OSCI Robot (oscirobot)]

RPM package glance has been built for project openstack/glance
Package version == 2014.1.3, package release == fuel5.1.1.mira3

Changeset: https://review.fuel-infra.org/4406
project: openstack/glance
branch: openstack-ci/fuel-5.1.1-updates/2014.1.1
author: Alexandr Nevenchannyy
committer: Alexandr Nevenchannyy
subject: Fix for CooperativeReader to process read length
status: change-merged

Files placed on repository:
openstack-glance-2014.1.3-fuel5.1.1.mira3.noarch.rpm
openstack-glance-doc-2014.1.3-fuel5.1.1.mira3.noarch.rpm
python-glance-2014.1.3-fuel5.1.1.mira3.noarch.rpm

Changeset merged. Package placed on primary repository
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-5.1.1-updates-stable/centos

[OSCI Robot (oscirobot)]

DEB package glance has been built for project openstack/glance
Package version == 2014.1.3, package release == fuel5.1.1~mira2

Changeset: https://review.fuel-infra.org/4406
project: openstack/glance
branch: openstack-ci/fuel-5.1.1-updates/2014.1.1
author: Alexandr Nevenchannyy
committer: Alexandr Nevenchannyy
subject: Fix for CooperativeReader to process read length
status: change-merged

Files placed on repository:
glance-api_2014.1.3-fuel5.1.1~mira2_all.deb
glance-common_2014.1.3-fuel5.1.1~mira2_all.deb
glance-registry_2014.1.3-fuel5.1.1~mira2_all.deb
glance_2014.1.3-fuel5.1.1~mira2_all.deb
python-glance-doc_2014.1.3-fuel5.1.1~mira2_all.deb
python-glance_2014.1.3-fuel5.1.1~mira2_all.deb

Changeset merged. Package placed on primary repository
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-5.1.1-updates-stable/ubuntu

[Victor Ryzhenkin (vryzhenkin)]

Verified of 6.0.1

{"build_id": "2015-03-09_09-13-55", "ostf_sha": "b38332e6741fc4b0ef40a9b4fe9d2804ee6437cc", "build_number": "125", "auth_required": true, "api": "1.0", "nailgun_sha": "83f8c83b5e77973bd391dde3b97d22999ff02bd2", "production": "docker", "fuelmain_sha": "bc1a1279509a87de0b9201e6dd2d393e0e122905", "astute_sha": "f7cda2171b0b677dfaeb59693d980a2d3ee4c3e0", "feature_groups": ["mirantis"], "release": "6.0.1", "release_versions": {"2014.2.2-6.0.1": {"VERSION": {"build_id": "2015-03-09_09-13-55", "ostf_sha": "b38332e6741fc4b0ef40a9b4fe9d2804ee6437cc", "build_number": "125", "api": "1.0", "nailgun_sha": "83f8c83b5e77973bd391dde3b97d22999ff02bd2", "production": "docker", "fuelmain_sha": "bc1a1279509a87de0b9201e6dd2d393e0e122905", "astute_sha": "f7cda2171b0b677dfaeb59693d980a2d3ee4c3e0", "feature_groups": ["mirantis"], "release": "6.0.1", "fuellib_sha": "d771c4fe4702dbf373140a4f79046e4eca7cd1a8"}}}, "fuellib_sha": "d771c4fe4702dbf373140a4f79046e4eca7cd1a8"}

[Kyrylo Romanenko (kromanenko)]

VERSION:
  feature_groups:
    - mirantis
  production: "docker"
  release: "6.1"
  openstack_version: "2014.2.2-6.1"
  api: "1.0"
  build_number: "471"
  build_id: "2015-05-26_20-59-56"
  nailgun_sha: "f737675091bd1903aace0e36812e855ce47dfec7"
  python-fuelclient_sha: "e19f1b65792f84c4a18b5a9473f85ef3ba172fce"
  astute_sha: "0bd72c72369e743376864e8e8dabfe873d40450a"
  fuel-library_sha: "8cfeca1a86179ebed1e4e03b2133b49c27350f6f"
  fuel-ostf_sha: "87819878bc0ca572900e1f6933d9b99e666d6f62"
  fuelmain_sha: "13b3e9cf074ba1cf1ae06509c55fbab613c73f4e"

Cluster configuration:
- CentOS/HA
- Nova-network/FlatDHCP , network tagging
- Cinder LVM

- 3 controllers
- 2 compute
- 1 cinder
150 GB each node.

Sahara image was uploaded via horizon with correct check-sum and sahara ostf tests passed.

[Fuel Devops McRobotson (fuel-devops-robot)]

Fix proposed to branch: openstack-ci/fuel-7.0/2015.1.0
Change author: Alexander Tivelkov <email address hidden>
Review: https://review.fuel-infra.org/8107

[Fuel Devops McRobotson (fuel-devops-robot)]

Fix proposed to branch: openstack-ci/fuel-5.1-updates/2014.1.1
Change author: Alexander Tivelkov <email address hidden>
Review: https://review.fuel-infra.org/9279

[Fuel Devops McRobotson (fuel-devops-robot)]

Reviewed: https://review.fuel-infra.org/9279
Submitter: Vitaly Sedelnik <email address hidden>
Branch: openstack-ci/fuel-5.1-updates/2014.1.1

Commit: d3d83d98a770ba69666d4f3d4998ede2021c97cd
Author: Alexander Tivelkov <email address hidden>
Date: Mon Jul 13 15:32:03 2015

Fix for CooperativeReader to process read length

CooperativeReader, being an eventlet-friendly wrapper around the
generator- based reader of image data, actually transforms
chunk-by-chunk iteration into the readable stream. It is used when the
image is being copied from the remote source: some generator-based
image data representing the remote source acts as its underlying
object, and the instance of CooperativeReader is passed as a data
stream to the backend client which uses it to read the data.

Before this patch, the CooperativeReader was ignoring the "length"
parameter of the read method, always returning the whole chunk returned
by the underlying generator (in case of HTTP source the size of this
chunk is 16 M). This was causing problems for the clients attempting to
read data from it, and - under some circumstances - the loss of data.

For chunked storage of files in Swift a special class (ChunkReader,
declared in the swift store driver) is used to reduce the requested
read length so no extra data is read and transferred. However, this was
not working as the CooperativeReader (which was the underlying stream
for the ChunkReader) was ignoring the requested size. This was causing
the data to be lost when reading behind the boundaries of the Chunks.

This patchset introduces a buffer in the CooperativeReader to store the
most recently fetched iterator chunk. The reads are independent from
requests to iterator, so the CooperativeReader is able to return the
exact requested amount of bytes and no data is lost due to extra-reads.

SecurityImpact

Change-Id: Ief37d1e29487bb03e612320f5cc06910cfd1c23a
Closes-bug: #1411704
Closes-bug: #1405386
(cherry picked from commit 270ec44a890f4bd2917310e2fcab9ad2bb9413b7)
(cherry picked from commit de45f294dccaeb8e2d933ab17f9f001600da0b5e)
(cherry picked from commit 9cc6b55e6e5432de48d2e207b8e2dae0a1478172)

[Fuel Devops McRobotson (fuel-devops-robot)]

Change abandoned by Mike Fedosin <email address hidden> on branch: openstack-ci/fuel-7.0/2015.1.0
Review: https://review.fuel-infra.org/8107

[Fuel Devops McRobotson (fuel-devops-robot)]

Change abandoned by Alexander Tivelkov <email address hidden> on branch: openstack-ci/fuel-6.0.1/2014.2
Review: https://review.fuel-infra.org/2174

[Fuel Devops McRobotson (fuel-devops-robot)]

Change abandoned by Alexander Tivelkov <email address hidden> on branch: openstack-ci/fuel-5.1.2/2014.1.1
Review: https://review.fuel-infra.org/2173