VMware: Upload volume to image fails with GlanceConnectionFailed error

Bug #1295239 reported by Vipin Balachandran
16
This bug affects 3 people
Affects Status Importance Assigned to Milestone
Cinder
Fix Released
High
Vipin Balachandran
Icehouse
Fix Released
High
Vipin Balachandran
VMwareAPI-Team
New
Undecided
Unassigned

Bug Description

Upload volume to image fails with the following error:

Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/eventlet/hubs/hub.py", line 346, in fire_timers
    timer()
  File "/usr/local/lib/python2.7/dist-packages/eventlet/hubs/timer.py", line 56, in __call__
    cb(*args, **kw)
  File "/usr/local/lib/python2.7/dist-packages/eventlet/greenthread.py", line 194, in main
    result = function(*args, **kwargs)
  File "/opt/stack/cinder/cinder/volume/drivers/vmware/io_util.py", line 108, in _inner
    data=self.input_file)
  File "/opt/stack/cinder/cinder/image/glance.py", line 311, in update
    _reraise_translated_image_exception(image_id)
  File "/opt/stack/cinder/cinder/image/glance.py", line 309, in update
    **image_meta)
  File "/opt/stack/cinder/cinder/image/glance.py", line 177, in call
    raise exception.GlanceConnectionFailed(reason=e)
GlanceConnectionFailed: Connection to glance failed: Error communicating with http://10.20.72.32:9292 timed out

When this happens, the volume gets stuck in “Uploading” state and never completes.

Changed in cinder:
status: New → Confirmed
Mike Perez (thingee)
Changed in cinder:
milestone: none → next
Mike Perez (thingee)
Changed in cinder:
milestone: next → none
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to cinder (master)

Fix proposed to branch: master
Review: https://review.openstack.org/85031

Changed in cinder:
status: Confirmed → In Progress
tags: removed: vmdk
tags: added: icehouse-backport-potential
Revision history for this message
satyadev svn (svnsatya) wrote :

verified patch : https://review.openstack.org/#/c/85031/
created different types of volumes [thick,thin,eageraeroed ] from different data stores like vmfs,nfs,vsan found that user able to upload image to glance with out any failures .

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to cinder (master)

Reviewed: https://review.openstack.org/85031
Committed: https://git.openstack.org/cgit/openstack/cinder/commit/?id=cf18199571b7965a8fe77db3d910b0e798f12946
Submitter: Jenkins
Branch: master

commit cf18199571b7965a8fe77db3d910b0e798f12946
Author: Vipin Balachandran <email address hidden>
Date: Thu Apr 3 11:42:55 2014 +0530

    vmware: Force chunked transfer for upload-to-image

    The upload-to-image operation downloads (using stream-optimized HTTP NFC
    transfer) the virtual disk corresponding to the volume to a pipe from
    where the glance image client reads the data for upload. Due to a recent
    change in the glance image client, success in seeking the input file
    object results in forgoing the chunked transfer in favor of regular
    transfer. The glance image client expects an IOError if the input file
    object is a pipe. Currently the pipe seek() is a NOP and this results in
    upload-to-image failure. This changes fixes such failures by throwing
    an IOError indicating an illegal seek.

    Change-Id: I2e69fc4103559d49d2cee16ea04787a252dbf879
    Closes-Bug: #1295239

Changed in cinder:
status: In Progress → Fix Committed
Changed in cinder:
milestone: none → juno-2
status: Fix Committed → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to cinder (stable/icehouse)

Fix proposed to branch: stable/icehouse
Review: https://review.openstack.org/111662

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to cinder (stable/icehouse)

Reviewed: https://review.openstack.org/111662
Committed: https://git.openstack.org/cgit/openstack/cinder/commit/?id=360705a76c1352aae338466ca705dc3d317cae28
Submitter: Jenkins
Branch: stable/icehouse

commit 360705a76c1352aae338466ca705dc3d317cae28
Author: Vipin Balachandran <email address hidden>
Date: Thu Apr 3 11:42:55 2014 +0530

    vmware: Force chunked transfer for upload-to-image

    The upload-to-image operation downloads (using stream-optimized HTTP NFC
    transfer) the virtual disk corresponding to the volume to a pipe from
    where the glance image client reads the data for upload. Due to a recent
    change in the glance image client, success in seeking the input file
    object results in forgoing the chunked transfer in favor of regular
    transfer. The glance image client expects an IOError if the input file
    object is a pipe. Currently the pipe seek() is a NOP and this results in
    upload-to-image failure. This changes fixes such failures by throwing
    an IOError indicating an illegal seek.

    Conflicts:
     cinder/volume/drivers/vmware/read_write_util.py

    Change-Id: I2e69fc4103559d49d2cee16ea04787a252dbf879
    Closes-Bug: #1295239
    (cherry picked from commit cf18199571b7965a8fe77db3d910b0e798f12946)

tags: added: in-stable-icehouse
Thierry Carrez (ttx)
Changed in cinder:
milestone: juno-2 → 2014.2
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.