Glance --copy-from misses some data

Bug #1411704 reported by Fabrizio Soppelsa
20
This bug affects 3 people
Affects Status Importance Assigned to Milestone
Mirantis OpenStack
Fix Released
Critical
Alexander Tivelkov
5.1.x
Fix Released
Critical
Alexander Nevenchannyy
6.0.x
Fix Released
Critical
Denis Puchkin
6.1.x
Fix Released
Critical
Alexander Tivelkov

Bug Description

When glance creates an image with --copy-from with swift backend, it uploads it and correctly compute the checksum, but data is missing, i.e.:

swift size is 6377635840
original 6386024448

Misses exactly 8M

Glance conf:

chunk_size = 5120
object_size = 5120

See also https://bugs.launchpad.net/fuel/+bug/1412463

tags: added: customer-found
tags: added: swift
description: updated
Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package glance has been built for project openstack/glance
Package version == 2014.1.3, package release == fuel5.1.2.mira3.git.aafb8b5.74b86c5

Changeset: https://review.fuel-infra.org/2173
project: openstack/glance
branch: openstack-ci/fuel-5.1.2/2014.1.1
author: Alexander Tivelkov
committer: Alexander Tivelkov
subject: Fix for CooperativeReader to properly process read length
status: patchset-created

Files placed on repository:
openstack-glance-2014.1.3-fuel5.1.2.mira3.git.aafb8b5.74b86c5.noarch.rpm
openstack-glance-doc-2014.1.3-fuel5.1.2.mira3.git.aafb8b5.74b86c5.noarch.rpm
python-glance-2014.1.3-fuel5.1.2.mira3.git.aafb8b5.74b86c5.noarch.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-5.1.2-stable-2173/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package glance has been built for project openstack/glance
Package version == 2014.1.3, package release == fuel5.1.2~mira2+git.aafb8b5.74b86c5

Changeset: https://review.fuel-infra.org/2173
project: openstack/glance
branch: openstack-ci/fuel-5.1.2/2014.1.1
author: Alexander Tivelkov
committer: Alexander Tivelkov
subject: Fix for CooperativeReader to properly process read length
status: patchset-created

Files placed on repository:
glance-api_2014.1.3-fuel5.1.2~mira2+git.aafb8b5.74b86c5_all.deb
glance-common_2014.1.3-fuel5.1.2~mira2+git.aafb8b5.74b86c5_all.deb
glance-registry_2014.1.3-fuel5.1.2~mira2+git.aafb8b5.74b86c5_all.deb
glance_2014.1.3-fuel5.1.2~mira2+git.aafb8b5.74b86c5_all.deb
python-glance-doc_2014.1.3-fuel5.1.2~mira2+git.aafb8b5.74b86c5_all.deb
python-glance_2014.1.3-fuel5.1.2~mira2+git.aafb8b5.74b86c5_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-5.1.2-stable-2173/ubuntu

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package glance has been built for project openstack/glance
Package version == 2014.2, package release == fuel6.0.1.mira10.git.fae64fd.3babba9

Changeset: https://review.fuel-infra.org/2174
project: openstack/glance
branch: openstack-ci/fuel-6.0.1/2014.2
author: Alexander Tivelkov
committer: Alexander Tivelkov
subject: Fix for CooperativeReader to properly process read length
status: patchset-created

Files placed on repository:
openstack-glance-2014.2-fuel6.0.1.mira10.git.fae64fd.3babba9.noarch.rpm
openstack-glance-doc-2014.2-fuel6.0.1.mira10.git.fae64fd.3babba9.noarch.rpm
python-glance-2014.2-fuel6.0.1.mira10.git.fae64fd.3babba9.noarch.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-6.0.1-stable-2174/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package glance has been built for project openstack/glance
Package version == 2014.2, package release == fuel6.0.1~mira10+git.fae64fd.3babba9

Changeset: https://review.fuel-infra.org/2174
project: openstack/glance
branch: openstack-ci/fuel-6.0.1/2014.2
author: Alexander Tivelkov
committer: Alexander Tivelkov
subject: Fix for CooperativeReader to properly process read length
status: patchset-created

Files placed on repository:
glance-api_2014.2-fuel6.0.1~mira10+git.fae64fd.3babba9_all.deb
glance-common_2014.2-fuel6.0.1~mira10+git.fae64fd.3babba9_all.deb
glance-registry_2014.2-fuel6.0.1~mira10+git.fae64fd.3babba9_all.deb
glance_2014.2-fuel6.0.1~mira10+git.fae64fd.3babba9_all.deb
python-glance-doc_2014.2-fuel6.0.1~mira10+git.fae64fd.3babba9_all.deb
python-glance_2014.2-fuel6.0.1~mira10+git.fae64fd.3babba9_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-6.0.1-stable-2174/ubuntu

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package glance has been built for project openstack/glance
Package version == 2014.2, package release == fuel6.1.mira10.git.32a3b49.3babba9

Changeset: https://review.fuel-infra.org/2175
project: openstack/glance
branch: openstack-ci/fuel-6.1/2014.2
author: Alexander Tivelkov
committer: Alexander Tivelkov
subject: Fix for CooperativeReader to properly process read length
status: patchset-created

Files placed on repository:
openstack-glance-2014.2-fuel6.1.mira10.git.32a3b49.3babba9.noarch.rpm
openstack-glance-doc-2014.2-fuel6.1.mira10.git.32a3b49.3babba9.noarch.rpm
python-glance-2014.2-fuel6.1.mira10.git.32a3b49.3babba9.noarch.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-6.1-stable-2175/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package glance has been built for project openstack/glance
Package version == 2014.2, package release == fuel6.1~mira10+git.32a3b49.3babba9

Changeset: https://review.fuel-infra.org/2175
project: openstack/glance
branch: openstack-ci/fuel-6.1/2014.2
author: Alexander Tivelkov
committer: Alexander Tivelkov
subject: Fix for CooperativeReader to properly process read length
status: patchset-created

Files placed on repository:
glance-api_2014.2-fuel6.1~mira10+git.32a3b49.3babba9_all.deb
glance-common_2014.2-fuel6.1~mira10+git.32a3b49.3babba9_all.deb
glance-registry_2014.2-fuel6.1~mira10+git.32a3b49.3babba9_all.deb
glance_2014.2-fuel6.1~mira10+git.32a3b49.3babba9_all.deb
python-glance-doc_2014.2-fuel6.1~mira10+git.32a3b49.3babba9_all.deb
python-glance_2014.2-fuel6.1~mira10+git.32a3b49.3babba9_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-6.1-stable-2175/ubuntu

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package glance has been built for project openstack/glance
Package version == 2014.2, package release == fuel6.1.mira10

Changeset: https://review.fuel-infra.org/2175
project: openstack/glance
branch: openstack-ci/fuel-6.1/2014.2
author: Alexander Tivelkov
committer: Alexander Tivelkov
subject: Fix for CooperativeReader to properly process read length
status: change-merged

Files placed on repository:
openstack-glance-2014.2-fuel6.1.mira10.noarch.rpm
openstack-glance-doc-2014.2-fuel6.1.mira10.noarch.rpm
python-glance-2014.2-fuel6.1.mira10.noarch.rpm

Changeset merged. Package placed on primary repository
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-6.1-stable/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package glance has been built for project openstack/glance
Package version == 2014.2, package release == fuel6.1~mira10

Changeset: https://review.fuel-infra.org/2175
project: openstack/glance
branch: openstack-ci/fuel-6.1/2014.2
author: Alexander Tivelkov
committer: Alexander Tivelkov
subject: Fix for CooperativeReader to properly process read length
status: change-merged

Files placed on repository:
glance-api_2014.2-fuel6.1~mira10_all.deb
glance-common_2014.2-fuel6.1~mira10_all.deb
glance-registry_2014.2-fuel6.1~mira10_all.deb
glance_2014.2-fuel6.1~mira10_all.deb
python-glance-doc_2014.2-fuel6.1~mira10_all.deb
python-glance_2014.2-fuel6.1~mira10_all.deb

Changeset merged. Package placed on primary repository
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-6.1-stable/ubuntu

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package glance has been built for project openstack/glance
Package version == 2014.1.1, package release == fuel5.1.mira4.git.3d6e3cd.2144c72

Changeset: https://review.fuel-infra.org/2754
project: openstack/glance
branch: openstack-ci/fuel-5.1/2014.1.1
author: Alexandr Nevenchannyy
committer: Alexandr Nevenchannyy
subject: Fix for CooperativeReader to properly process read length
status: patchset-created

Files placed on repository:
openstack-glance-2014.1.1-fuel5.1.mira4.git.3d6e3cd.2144c72.noarch.rpm
openstack-glance-doc-2014.1.1-fuel5.1.mira4.git.3d6e3cd.2144c72.noarch.rpm
python-glance-2014.1.1-fuel5.1.mira4.git.3d6e3cd.2144c72.noarch.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-5.1-stable-2754/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package glance has been built for project openstack/glance
Package version == 2014.1.1, package release == fuel5.1~mira11+git.3d6e3cd.2144c72

Changeset: https://review.fuel-infra.org/2754
project: openstack/glance
branch: openstack-ci/fuel-5.1/2014.1.1
author: Alexandr Nevenchannyy
committer: Alexandr Nevenchannyy
subject: Fix for CooperativeReader to properly process read length
status: patchset-created

Files placed on repository:
glance-api_2014.1.1-fuel5.1~mira11+git.3d6e3cd.2144c72_all.deb
glance-common_2014.1.1-fuel5.1~mira11+git.3d6e3cd.2144c72_all.deb
glance-registry_2014.1.1-fuel5.1~mira11+git.3d6e3cd.2144c72_all.deb
glance_2014.1.1-fuel5.1~mira11+git.3d6e3cd.2144c72_all.deb
python-glance-doc_2014.1.1-fuel5.1~mira11+git.3d6e3cd.2144c72_all.deb
python-glance_2014.1.1-fuel5.1~mira11+git.3d6e3cd.2144c72_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-5.1-stable-2754/ubuntu

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package glance has been built for project openstack/glance
Package version == 2014.1, package release == fuel5.1~mira11+git.b9cbc31.3b0b916

Changeset: https://review.fuel-infra.org/2773
project: openstack/glance
branch: openstack-ci/fuel-5.1/2014.1
author: Alexandr Nevenchannyy
committer: Alexandr Nevenchannyy
subject: Fix for CooperativeReader to properly process read length
status: patchset-created

Files placed on repository:
glance-api_2014.1-fuel5.1~mira11+git.b9cbc31.3b0b916_all.deb
glance-common_2014.1-fuel5.1~mira11+git.b9cbc31.3b0b916_all.deb
glance-registry_2014.1-fuel5.1~mira11+git.b9cbc31.3b0b916_all.deb
glance_2014.1-fuel5.1~mira11+git.b9cbc31.3b0b916_all.deb
python-glance-doc_2014.1-fuel5.1~mira11+git.b9cbc31.3b0b916_all.deb
python-glance_2014.1-fuel5.1~mira11+git.b9cbc31.3b0b916_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-5.1-stable-2773/ubuntu

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package glance has been built for project openstack/glance
Package version == 2014.2, package release == fuel6.0.mira10.git.bb2e234.3babba9

Changeset: https://review.fuel-infra.org/3012
project: openstack/glance
branch: openstack-ci/fuel-6.0-updates/2014.2
author: Alexandr Nevenchannyy
committer: Alexandr Nevenchannyy
subject: Fix for CooperativeReader to process read length
status: patchset-created

Files placed on repository:
openstack-glance-2014.2-fuel6.0.mira10.git.bb2e234.3babba9.noarch.rpm
openstack-glance-doc-2014.2-fuel6.0.mira10.git.bb2e234.3babba9.noarch.rpm
python-glance-2014.2-fuel6.0.mira10.git.bb2e234.3babba9.noarch.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-6.0-updates-stable-3012/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package glance has been built for project openstack/glance
Package version == 2014.2, package release == fuel6.0~mira10+git.bb2e234.3babba9

Changeset: https://review.fuel-infra.org/3012
project: openstack/glance
branch: openstack-ci/fuel-6.0-updates/2014.2
author: Alexandr Nevenchannyy
committer: Alexandr Nevenchannyy
subject: Fix for CooperativeReader to process read length
status: patchset-created

Files placed on repository:
glance-api_2014.2-fuel6.0~mira10+git.bb2e234.3babba9_all.deb
glance-common_2014.2-fuel6.0~mira10+git.bb2e234.3babba9_all.deb
glance-registry_2014.2-fuel6.0~mira10+git.bb2e234.3babba9_all.deb
glance_2014.2-fuel6.0~mira10+git.bb2e234.3babba9_all.deb
python-glance-doc_2014.2-fuel6.0~mira10+git.bb2e234.3babba9_all.deb
python-glance_2014.2-fuel6.0~mira10+git.bb2e234.3babba9_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-6.0-updates-stable-3012/ubuntu

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package glance has been built for project openstack/glance
Package version == 2014.2, package release == fuel6.0.mira0

Changeset: https://review.fuel-infra.org/3012
project: openstack/glance
branch: openstack-ci/fuel-6.0-updates/2014.2
author: Alexandr Nevenchannyy
committer: Alexandr Nevenchannyy
subject: Fix for CooperativeReader to process read length
status: change-merged

Files placed on repository:
openstack-glance-2014.2-fuel6.0.mira0.noarch.rpm
openstack-glance-doc-2014.2-fuel6.0.mira0.noarch.rpm
python-glance-2014.2-fuel6.0.mira0.noarch.rpm

Changeset merged. Package placed on primary repository
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-6.0-updates-stable/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package glance has been built for project openstack/glance
Package version == 2014.2, package release == fuel6.0~mira0

Changeset: https://review.fuel-infra.org/3012
project: openstack/glance
branch: openstack-ci/fuel-6.0-updates/2014.2
author: Alexandr Nevenchannyy
committer: Alexandr Nevenchannyy
subject: Fix for CooperativeReader to process read length
status: change-merged

Files placed on repository:
glance-api_2014.2-fuel6.0~mira0_all.deb
glance-common_2014.2-fuel6.0~mira0_all.deb
glance-registry_2014.2-fuel6.0~mira0_all.deb
glance_2014.2-fuel6.0~mira0_all.deb
python-glance-doc_2014.2-fuel6.0~mira0_all.deb
python-glance_2014.2-fuel6.0~mira0_all.deb

Changeset merged. Package placed on primary repository
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-6.0-updates-stable/ubuntu

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package glance has been built for project openstack/glance
Package version == 2014.2, package release == fuel6.0.mira10

Changeset: https://review.fuel-infra.org/3012
project: openstack/glance
branch: openstack-ci/fuel-6.0-updates/2014.2
author: Alexandr Nevenchannyy
committer: Alexandr Nevenchannyy
subject: Fix for CooperativeReader to process read length
status: change-merged

Files placed on repository:
openstack-glance-2014.2-fuel6.0.mira10.noarch.rpm
openstack-glance-doc-2014.2-fuel6.0.mira10.noarch.rpm
python-glance-2014.2-fuel6.0.mira10.noarch.rpm

Changeset merged. Package placed on primary repository
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-6.0-updates-stable/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package glance has been built for project openstack/glance
Package version == 2014.2, package release == fuel6.0~mira10

Changeset: https://review.fuel-infra.org/3012
project: openstack/glance
branch: openstack-ci/fuel-6.0-updates/2014.2
author: Alexandr Nevenchannyy
committer: Alexandr Nevenchannyy
subject: Fix for CooperativeReader to process read length
status: change-merged

Files placed on repository:
glance-api_2014.2-fuel6.0~mira10_all.deb
glance-common_2014.2-fuel6.0~mira10_all.deb
glance-registry_2014.2-fuel6.0~mira10_all.deb
glance_2014.2-fuel6.0~mira10_all.deb
python-glance-doc_2014.2-fuel6.0~mira10_all.deb
python-glance_2014.2-fuel6.0~mira10_all.deb

Changeset merged. Package placed on primary repository
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-6.0-updates-stable/ubuntu

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package glance has been built for project openstack/glance
Package version == 2014.2, package release == fuel6.0.mira0.git.83ba12a.58b50a5

Changeset: https://review.fuel-infra.org/3619
project: mox-build/glance-build
branch: openstack-ci/fuel-6.0/2014.2
author: Vlad Naboichenko
committer: Vlad Naboichenko
subject: Added patch in glance. Added .gitreview https://bugs.launchpad.net/mos/+bug/1411704
status: patchset-created

Files placed on repository:
openstack-glance-2014.2-fuel6.0.mira0.git.83ba12a.58b50a5.noarch.rpm
openstack-glance-doc-2014.2-fuel6.0.mira0.git.83ba12a.58b50a5.noarch.rpm
python-glance-2014.2-fuel6.0.mira0.git.83ba12a.58b50a5.noarch.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/mox-centos-fuel-6.0-stable-3619/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package glance has been built for project openstack/glance
Package version == 2014.2, package release == fuel6.0~mira0+git.83ba12a.58b50a5

Changeset: https://review.fuel-infra.org/3619
project: mox-build/glance-build
branch: openstack-ci/fuel-6.0/2014.2
author: Vlad Naboichenko
committer: Vlad Naboichenko
subject: Added patch in glance. Added .gitreview https://bugs.launchpad.net/mos/+bug/1411704
status: patchset-created

Files placed on repository:
glance-api_2014.2-fuel6.0~mira0+git.83ba12a.58b50a5_all.deb
glance-common_2014.2-fuel6.0~mira0+git.83ba12a.58b50a5_all.deb
glance-registry_2014.2-fuel6.0~mira0+git.83ba12a.58b50a5_all.deb
glance_2014.2-fuel6.0~mira0+git.83ba12a.58b50a5_all.deb
python-glance-doc_2014.2-fuel6.0~mira0+git.83ba12a.58b50a5_all.deb
python-glance_2014.2-fuel6.0~mira0+git.83ba12a.58b50a5_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/mox-ubuntu-fuel-6.0-stable-3619/ubuntu

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package glance has been built for project openstack/glance
Package version == 2014.2, package release == fuel6.0.mira0

Changeset: https://review.fuel-infra.org/3619
project: mox-build/glance-build
branch: openstack-ci/fuel-6.0/2014.2
author: Vlad Naboichenko
committer: Vlad Naboichenko
subject: Added patch in glance. Added .gitreview https://bugs.launchpad.net/mos/+bug/1411704
status: change-merged

Files placed on repository:
openstack-glance-2014.2-fuel6.0.mira0.noarch.rpm
openstack-glance-doc-2014.2-fuel6.0.mira0.noarch.rpm
python-glance-2014.2-fuel6.0.mira0.noarch.rpm

Changeset merged. Package placed on primary repository
RPM repository URL: http://osci-obs.vm.mirantis.net:82/mox-centos-fuel-6.0-stable/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package glance has been built for project openstack/glance
Package version == 2014.2, package release == fuel6.0~mira0

Changeset: https://review.fuel-infra.org/3619
project: mox-build/glance-build
branch: openstack-ci/fuel-6.0/2014.2
author: Vlad Naboichenko
committer: Vlad Naboichenko
subject: Added patch in glance. Added .gitreview https://bugs.launchpad.net/mos/+bug/1411704
status: change-merged

Files placed on repository:
glance-api_2014.2-fuel6.0~mira0_all.deb
glance-common_2014.2-fuel6.0~mira0_all.deb
glance-registry_2014.2-fuel6.0~mira0_all.deb
glance_2014.2-fuel6.0~mira0_all.deb
python-glance-doc_2014.2-fuel6.0~mira0_all.deb
python-glance_2014.2-fuel6.0~mira0_all.deb

Changeset merged. Package placed on primary repository
DEB repository URL: http://osci-obs.vm.mirantis.net:82/mox-ubuntu-fuel-6.0-stable/ubuntu

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package glance has been built for project openstack/glance
Package version == 2014.2.2, package release == fuel6.0.1.mira1.git.09ea6e3.3babba9

Changeset: https://review.fuel-infra.org/3830
project: openstack/glance
branch: openstack-ci/fuel-6.0.1/2014.2
author: Mikhail Fedosin
committer: Mikhail Fedosin
subject: Fix for CooperativeReader to process read length
status: patchset-created

Files placed on repository:
openstack-glance-2014.2.2-fuel6.0.1.mira1.git.09ea6e3.3babba9.noarch.rpm
openstack-glance-doc-2014.2.2-fuel6.0.1.mira1.git.09ea6e3.3babba9.noarch.rpm
python-glance-2014.2.2-fuel6.0.1.mira1.git.09ea6e3.3babba9.noarch.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-6.0.1-stable-3830/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

package glance has been built for project openstack/glance
Package version == 2014.2, package release == fuel6.1.mira21.git.8e65d35.3babba9

Changeset: https://review.fuel-infra.org/3829
project: openstack/glance
branch: openstack-ci/fuel-6.1/2014.2
author: Mikhail Fedosin
committer: Mikhail Fedosin
subject: Fix for CooperativeReader to process read length
status: patchset-created

Files placed on repository:

NOTE: Changeset is not merged, created temporary package repository.
 repository URL: /centos-fuel-6.1-stable-3829/

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package glance has been built for project openstack/glance
Package version == 2014.2.2, package release == fuel6.0.1~mira1+git.09ea6e3.3babba9

Changeset: https://review.fuel-infra.org/3830
project: openstack/glance
branch: openstack-ci/fuel-6.0.1/2014.2
author: Mikhail Fedosin
committer: Mikhail Fedosin
subject: Fix for CooperativeReader to process read length
status: patchset-created

Files placed on repository:
glance-api_2014.2.2-fuel6.0.1~mira1+git.09ea6e3.3babba9_all.deb
glance-common_2014.2.2-fuel6.0.1~mira1+git.09ea6e3.3babba9_all.deb
glance-registry_2014.2.2-fuel6.0.1~mira1+git.09ea6e3.3babba9_all.deb
glance_2014.2.2-fuel6.0.1~mira1+git.09ea6e3.3babba9_all.deb
python-glance-doc_2014.2.2-fuel6.0.1~mira1+git.09ea6e3.3babba9_all.deb
python-glance_2014.2.2-fuel6.0.1~mira1+git.09ea6e3.3babba9_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-6.0.1-stable-3830/ubuntu

Revision history for this message
OSCI Robot (oscirobot) wrote :

package glance has been built for project openstack/glance
Package version == 2014.2, package release == fuel6.1~mira16+git.8e65d35.3babba9

Changeset: https://review.fuel-infra.org/3829
project: openstack/glance
branch: openstack-ci/fuel-6.1/2014.2
author: Mikhail Fedosin
committer: Mikhail Fedosin
subject: Fix for CooperativeReader to process read length
status: patchset-created

Files placed on repository:

NOTE: Changeset is not merged, created temporary package repository.
 repository URL: /ubuntu-fuel-6.1-stable-3829/

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package glance has been built for project openstack/glance
Package version == 2014.2.2, package release == fuel6.0.1.mira2.git.bd03a2c.3babba9

Changeset: https://review.fuel-infra.org/3830
project: openstack/glance
branch: openstack-ci/fuel-6.0.1/2014.2
author: Mikhail Fedosin
committer: Mikhail Fedosin
subject: Fix for CooperativeReader to process read length
status: patchset-created

Files placed on repository:
openstack-glance-2014.2.2-fuel6.0.1.mira2.git.bd03a2c.3babba9.noarch.rpm
openstack-glance-doc-2014.2.2-fuel6.0.1.mira2.git.bd03a2c.3babba9.noarch.rpm
python-glance-2014.2.2-fuel6.0.1.mira2.git.bd03a2c.3babba9.noarch.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-6.0.1-stable-3830/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package glance has been built for project openstack/glance
Package version == 2014.2.2, package release == fuel6.0.1~mira2+git.bd03a2c.3babba9

Changeset: https://review.fuel-infra.org/3830
project: openstack/glance
branch: openstack-ci/fuel-6.0.1/2014.2
author: Mikhail Fedosin
committer: Mikhail Fedosin
subject: Fix for CooperativeReader to process read length
status: patchset-created

Files placed on repository:
glance-api_2014.2.2-fuel6.0.1~mira2+git.bd03a2c.3babba9_all.deb
glance-common_2014.2.2-fuel6.0.1~mira2+git.bd03a2c.3babba9_all.deb
glance-registry_2014.2.2-fuel6.0.1~mira2+git.bd03a2c.3babba9_all.deb
glance_2014.2.2-fuel6.0.1~mira2+git.bd03a2c.3babba9_all.deb
python-glance-doc_2014.2.2-fuel6.0.1~mira2+git.bd03a2c.3babba9_all.deb
python-glance_2014.2.2-fuel6.0.1~mira2+git.bd03a2c.3babba9_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-6.0.1-stable-3830/ubuntu

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package glance has been built for project openstack/glance
Package version == 2014.2.2, package release == fuel6.0.1.mira2.git.fa479c3.3babba9

Changeset: https://review.fuel-infra.org/3830
project: openstack/glance
branch: openstack-ci/fuel-6.0.1/2014.2
author: Mikhail Fedosin
committer: Mikhail Fedosin
subject: Fix for CooperativeReader to process read length
status: patchset-created

Files placed on repository:
openstack-glance-2014.2.2-fuel6.0.1.mira2.git.fa479c3.3babba9.noarch.rpm
openstack-glance-doc-2014.2.2-fuel6.0.1.mira2.git.fa479c3.3babba9.noarch.rpm
python-glance-2014.2.2-fuel6.0.1.mira2.git.fa479c3.3babba9.noarch.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-6.0.1-stable-3830/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package glance has been built for project openstack/glance
Package version == 2014.2.2, package release == fuel6.0.1~mira2+git.fa479c3.3babba9

Changeset: https://review.fuel-infra.org/3830
project: openstack/glance
branch: openstack-ci/fuel-6.0.1/2014.2
author: Mikhail Fedosin
committer: Mikhail Fedosin
subject: Fix for CooperativeReader to process read length
status: patchset-created

Files placed on repository:
glance-api_2014.2.2-fuel6.0.1~mira2+git.fa479c3.3babba9_all.deb
glance-common_2014.2.2-fuel6.0.1~mira2+git.fa479c3.3babba9_all.deb
glance-registry_2014.2.2-fuel6.0.1~mira2+git.fa479c3.3babba9_all.deb
glance_2014.2.2-fuel6.0.1~mira2+git.fa479c3.3babba9_all.deb
python-glance-doc_2014.2.2-fuel6.0.1~mira2+git.fa479c3.3babba9_all.deb
python-glance_2014.2.2-fuel6.0.1~mira2+git.fa479c3.3babba9_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-6.0.1-stable-3830/ubuntu

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package glance has been built for project openstack/glance
Package version == 2014.2.2, package release == fuel6.0.1.mira2

Changeset: https://review.fuel-infra.org/3830
project: openstack/glance
branch: openstack-ci/fuel-6.0.1/2014.2
author: Mikhail Fedosin
committer: Mikhail Fedosin
subject: Fix for CooperativeReader to process read length
status: change-merged

Files placed on repository:
openstack-glance-2014.2.2-fuel6.0.1.mira2.noarch.rpm
openstack-glance-doc-2014.2.2-fuel6.0.1.mira2.noarch.rpm
python-glance-2014.2.2-fuel6.0.1.mira2.noarch.rpm

Changeset merged. Package placed on primary repository
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-6.0.1-stable/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

package glance has been built for project openstack/glance
Package version == 2014.2.2, package release == fuel6.1.mira1.git.97feba3.3babba9

Changeset: https://review.fuel-infra.org/3829
project: openstack/glance
branch: openstack-ci/fuel-6.1/2014.2
author: Mikhail Fedosin
committer: Alexander Tivelkov
subject: Fix for CooperativeReader to process read length
status: patchset-created

Files placed on repository:

NOTE: Changeset is not merged, created temporary package repository.
 repository URL: /centos-fuel-6.1-stable-3829/

Revision history for this message
OSCI Robot (oscirobot) wrote :

package glance has been built for project openstack/glance
Package version == 2014.2.2, package release == fuel6.1~mira1+git.97feba3.3babba9

Changeset: https://review.fuel-infra.org/3829
project: openstack/glance
branch: openstack-ci/fuel-6.1/2014.2
author: Mikhail Fedosin
committer: Alexander Tivelkov
subject: Fix for CooperativeReader to process read length
status: patchset-created

Files placed on repository:

NOTE: Changeset is not merged, created temporary package repository.
 repository URL: /ubuntu-fuel-6.1-stable-3829/

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package glance has been built for project openstack/glance
Package version == 2014.2.2, package release == fuel6.0.1~mira2

Changeset: https://review.fuel-infra.org/3830
project: openstack/glance
branch: openstack-ci/fuel-6.0.1/2014.2
author: Mikhail Fedosin
committer: Mikhail Fedosin
subject: Fix for CooperativeReader to process read length
status: change-merged

Files placed on repository:
glance-api_2014.2.2-fuel6.0.1~mira2_all.deb
glance-common_2014.2.2-fuel6.0.1~mira2_all.deb
glance-registry_2014.2.2-fuel6.0.1~mira2_all.deb
glance_2014.2.2-fuel6.0.1~mira2_all.deb
python-glance-doc_2014.2.2-fuel6.0.1~mira2_all.deb
python-glance_2014.2.2-fuel6.0.1~mira2_all.deb

Changeset merged. Package placed on primary repository
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-6.0.1-stable/ubuntu

Revision history for this message
OSCI Robot (oscirobot) wrote :

package glance has been built for project openstack/glance
Package version == 2014.2.2, package release == fuel6.1.mira2

Changeset: https://review.fuel-infra.org/3829
project: openstack/glance
branch: openstack-ci/fuel-6.1/2014.2
author: Mikhail Fedosin
committer: Alexander Tivelkov
subject: Fix for CooperativeReader to process read length
status: change-merged

Files placed on repository:

Changeset merged. Package placed on primary repository
 repository URL: /centos-fuel-6.1-stable/

Revision history for this message
OSCI Robot (oscirobot) wrote :

package glance has been built for project openstack/glance
Package version == 2014.2.2, package release == fuel6.1~mira2

Changeset: https://review.fuel-infra.org/3829
project: openstack/glance
branch: openstack-ci/fuel-6.1/2014.2
author: Mikhail Fedosin
committer: Alexander Tivelkov
subject: Fix for CooperativeReader to process read length
status: change-merged

Files placed on repository:

Changeset merged. Package placed on primary repository
 repository URL: /ubuntu-fuel-6.1-stable/

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package glance has been built for project openstack/glance
Package version == 2014.1.3, package release == fuel5.1.1.mira3.git.9cc6b55.74b86c5

Changeset: https://review.fuel-infra.org/4406
project: openstack/glance
branch: openstack-ci/fuel-5.1.1-updates/2014.1.1
author: Alexandr Nevenchannyy
committer: Alexandr Nevenchannyy
subject: Fix for CooperativeReader to process read length
status: patchset-created

Files placed on repository:
openstack-glance-2014.1.3-fuel5.1.1.mira3.git.9cc6b55.74b86c5.noarch.rpm
openstack-glance-doc-2014.1.3-fuel5.1.1.mira3.git.9cc6b55.74b86c5.noarch.rpm
python-glance-2014.1.3-fuel5.1.1.mira3.git.9cc6b55.74b86c5.noarch.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-5.1.1-updates-stable-4406/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package glance has been built for project openstack/glance
Package version == 2014.1.3, package release == fuel5.1.1~mira2+git.9cc6b55.74b86c5

Changeset: https://review.fuel-infra.org/4406
project: openstack/glance
branch: openstack-ci/fuel-5.1.1-updates/2014.1.1
author: Alexandr Nevenchannyy
committer: Alexandr Nevenchannyy
subject: Fix for CooperativeReader to process read length
status: patchset-created

Files placed on repository:
glance-api_2014.1.3-fuel5.1.1~mira2+git.9cc6b55.74b86c5_all.deb
glance-common_2014.1.3-fuel5.1.1~mira2+git.9cc6b55.74b86c5_all.deb
glance-registry_2014.1.3-fuel5.1.1~mira2+git.9cc6b55.74b86c5_all.deb
glance_2014.1.3-fuel5.1.1~mira2+git.9cc6b55.74b86c5_all.deb
python-glance-doc_2014.1.3-fuel5.1.1~mira2+git.9cc6b55.74b86c5_all.deb
python-glance_2014.1.3-fuel5.1.1~mira2+git.9cc6b55.74b86c5_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-5.1.1-updates-stable-4406/ubuntu

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package glance has been built for project openstack/glance
Package version == 2014.1.3, package release == fuel5.1.1.mira3

Changeset: https://review.fuel-infra.org/4406
project: openstack/glance
branch: openstack-ci/fuel-5.1.1-updates/2014.1.1
author: Alexandr Nevenchannyy
committer: Alexandr Nevenchannyy
subject: Fix for CooperativeReader to process read length
status: change-merged

Files placed on repository:
openstack-glance-2014.1.3-fuel5.1.1.mira3.noarch.rpm
openstack-glance-doc-2014.1.3-fuel5.1.1.mira3.noarch.rpm
python-glance-2014.1.3-fuel5.1.1.mira3.noarch.rpm

Changeset merged. Package placed on primary repository
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-5.1.1-updates-stable/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package glance has been built for project openstack/glance
Package version == 2014.1.3, package release == fuel5.1.1~mira2

Changeset: https://review.fuel-infra.org/4406
project: openstack/glance
branch: openstack-ci/fuel-5.1.1-updates/2014.1.1
author: Alexandr Nevenchannyy
committer: Alexandr Nevenchannyy
subject: Fix for CooperativeReader to process read length
status: change-merged

Files placed on repository:
glance-api_2014.1.3-fuel5.1.1~mira2_all.deb
glance-common_2014.1.3-fuel5.1.1~mira2_all.deb
glance-registry_2014.1.3-fuel5.1.1~mira2_all.deb
glance_2014.1.3-fuel5.1.1~mira2_all.deb
python-glance-doc_2014.1.3-fuel5.1.1~mira2_all.deb
python-glance_2014.1.3-fuel5.1.1~mira2_all.deb

Changeset merged. Package placed on primary repository
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-5.1.1-updates-stable/ubuntu

Revision history for this message
Kyrylo Romanenko (kromanenko) wrote :
Download full text (3.5 KiB)

Verified by following way:

1. Initial "Image" file.
# sudo dd if=/dev/zero of=bigimage.iso bs=1G count=8
# ll bigimage.qcow2
-rw-r--r-- 1 root root 8589934592 бер 11 12:05 bigimage.qcow2
# md5sum bigimage.qcow2
b770351fadae5a96bbaf9702ed97d28d bigimage.qcow2

2. Host it on nginx locally.

3. Login to controller node.
4. Download image
# glance image-create --name BIGIMG --copy-from http://172.18.196.49/bigimage.qcow2
+------------------+--------------------------------------+
| Property | Value |
+------------------+--------------------------------------+
| checksum | None |
| container_format | None |
| created_at | 2015-03-11T13:00:46 |
| deleted | False |
| deleted_at | None |
| disk_format | None |
| id | 02ac19eb-7876-4203-a433-fb14bf3b85d6 |
| is_public | False |
| min_disk | 0 |
| min_ram | 0 |
| name | BIGIMG |
| owner | a9195f1c203147c9a8477ea0556f5824 |
| protected | False |
| size | 8589934592 |
| status | queued |
| updated_at | 2015-03-11T13:00:46 |
| virtual_size | None |
+------------------+--------------------------------------+

And wait until image uploaded to storage...

5. Check on Horizon in Admin->Images:
Name
BIGIMG
Size
8.0 GB
Checksum
b770351fadae5a96bbaf9702ed97d28d

6. Check from Glance command:
# glance image-list
+--------------------------------------+--------+-------------+------------------+------------+--------+
| ID | Name | Disk Format | Container Format | Size | Status |
+--------------------------------------+--------+-------------+------------------+------------+--------+
| 02ac19eb-7876-4203-a433-fb14bf3b85d6 | BIGIMG | | | 8589934592 | active |
+--------------------------------------+--------+-------------+------------------+------------+--------+

We can see that initial and final size 8589934592 bytes, and initial and final md5 sum is b770351fadae5a96bbaf9702ed97d28d.

Environment:
MOS 6.0.1, Juno on Ubuntu 12.04.4 2014.2.2-6.0.1
{"build_id": "2015-03-10_09-14-43", "ostf_sha": "b38332e6741fc4b0ef40a9b4fe9d2804ee6437cc", "build_number": "127", "auth_required": true, "api": "1.0", "nailgun_sha": "83f8c83b5e77973bd391dde3b97d22999ff02bd2", "production": "docker", "fuelmain_sha": "0868371a91e72b5a6720281f02055165b6c81d44", "astute_sha": "f7cda2171b0b677dfaeb59693d980a2d3ee4c3e0", "feature_groups": ["mirantis"], "release": "6.0.1", "release_versions": {"2014.2.2-6.0.1": {"VERSION": {"build_id": "2015-03-10_09-14-43", "ostf_sha": "b38332e6741fc4b0ef40a9b4fe9d2804ee6437cc", "build_number": "127", "api": "1.0", "nailgun_sha...

Read more...

Revision history for this message
Kyrylo Romanenko (kromanenko) wrote :

Verified by the same way for MOS6.1.
 {"build_id": "2015-03-17_14-56-03", "ostf_sha": "bf5cf60cee2cc20e5914436ca8a3efbb5f510f64", "build_number": "203", "release_versions": {"2014.2-6.1": {"VERSION": {"build_id": "2015-03-17_14-56-03", "ostf_sha": "bf5cf60cee2cc20e5914436ca8a3efbb5f510f64", "build_number": "203", "api": "1.0", "nailgun_sha": "09a847619f99900b49853220369aa6b5f1b563de", "production": "docker", "python-fuelclient_sha": "2509c9b72cdcdbe46c141685a99b03cd934803be", "astute_sha": "93e427ac49109fa3fd8b0e1d0bb3d14092be2e8c", "feature_groups": ["mirantis"], "release": "6.1", "fuelmain_sha": "188e6536bfbe31a297be9c8c327f0b127eeca6d8", "fuellib_sha": "0166d1430f2f85bf8f05bb6bcedc57f816f16d9c"}}}, "auth_required": true, "api": "1.0", "nailgun_sha": "09a847619f99900b49853220369aa6b5f1b563de", "production": "docker", "python-fuelclient_sha": "2509c9b72cdcdbe46c141685a99b03cd934803be", "astute_sha": "93e427ac49109fa3fd8b0e1d0bb3d14092be2e8c", "feature_groups": ["mirantis"], "release": "6.1", "fuelmain_sha": "188e6536bfbe31a297be9c8c327f0b127eeca6d8", "fuellib_sha": "0166d1430f2f85bf8f05bb6bcedc57f816f16d9c"}

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix proposed to openstack/glance (openstack-ci/fuel-7.0/2015.1.0)

Fix proposed to branch: openstack-ci/fuel-7.0/2015.1.0
Change author: Alexander Tivelkov <email address hidden>
Review: https://review.fuel-infra.org/8107

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix proposed to openstack/glance (openstack-ci/fuel-5.1-updates/2014.1.1)

Fix proposed to branch: openstack-ci/fuel-5.1-updates/2014.1.1
Change author: Alexander Tivelkov <email address hidden>
Review: https://review.fuel-infra.org/9279

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix merged to openstack/glance (openstack-ci/fuel-5.1-updates/2014.1.1)

Reviewed: https://review.fuel-infra.org/9279
Submitter: Vitaly Sedelnik <email address hidden>
Branch: openstack-ci/fuel-5.1-updates/2014.1.1

Commit: d3d83d98a770ba69666d4f3d4998ede2021c97cd
Author: Alexander Tivelkov <email address hidden>
Date: Mon Jul 13 15:32:03 2015

Fix for CooperativeReader to process read length

CooperativeReader, being an eventlet-friendly wrapper around the
generator- based reader of image data, actually transforms
chunk-by-chunk iteration into the readable stream. It is used when the
image is being copied from the remote source: some generator-based
image data representing the remote source acts as its underlying
object, and the instance of CooperativeReader is passed as a data
stream to the backend client which uses it to read the data.

Before this patch, the CooperativeReader was ignoring the "length"
parameter of the read method, always returning the whole chunk returned
by the underlying generator (in case of HTTP source the size of this
chunk is 16 M). This was causing problems for the clients attempting to
read data from it, and - under some circumstances - the loss of data.

For chunked storage of files in Swift a special class (ChunkReader,
declared in the swift store driver) is used to reduce the requested
read length so no extra data is read and transferred. However, this was
not working as the CooperativeReader (which was the underlying stream
for the ChunkReader) was ignoring the requested size. This was causing
the data to be lost when reading behind the boundaries of the Chunks.

This patchset introduces a buffer in the CooperativeReader to store the
most recently fetched iterator chunk. The reads are independent from
requests to iterator, so the CooperativeReader is able to return the
exact requested amount of bytes and no data is lost due to extra-reads.

SecurityImpact

Change-Id: Ief37d1e29487bb03e612320f5cc06910cfd1c23a
Closes-bug: #1411704
Closes-bug: #1405386
(cherry picked from commit 270ec44a890f4bd2917310e2fcab9ad2bb9413b7)
(cherry picked from commit de45f294dccaeb8e2d933ab17f9f001600da0b5e)
(cherry picked from commit 9cc6b55e6e5432de48d2e207b8e2dae0a1478172)

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Change abandoned on openstack/glance (openstack-ci/fuel-7.0/2015.1.0)

Change abandoned by Mike Fedosin <email address hidden> on branch: openstack-ci/fuel-7.0/2015.1.0
Review: https://review.fuel-infra.org/8107

Revision history for this message
Vitaly Sedelnik (vsedelnik) wrote :

Retargeted back to 6.0-mu-1 - the issue was reopened and targeted to 6.0-mu-7 by mistake

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Change abandoned on openstack/glance (openstack-ci/fuel-6.0.1/2014.2)

Change abandoned by Alexander Tivelkov <email address hidden> on branch: openstack-ci/fuel-6.0.1/2014.2
Review: https://review.fuel-infra.org/2174

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Change abandoned on openstack/glance (openstack-ci/fuel-5.1.2/2014.1.1)

Change abandoned by Alexander Tivelkov <email address hidden> on branch: openstack-ci/fuel-5.1.2/2014.1.1
Review: https://review.fuel-infra.org/2173

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.