python-swiftclient

swiftclient hangout with -S option

Bug #1292310 reported by Tomokazu Hirai
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
python-swiftclient
New
Undecided
Unassigned

Bug Description

I use these versions Swift with Ubuntu Cloud Archive package.

# dpkg -l | grep swift
ii python-swift 1.10.0-0ubuntu1~cloud0 distributed virtual object store - Python libraries
ii python-swiftclient 1:1.6.0-0ubuntu1~cloud0 Client library for Openstack Swift API.
ii swift 1.10.0-0ubuntu1~cloud0 distributed virtual object store - common files
ii swift-object 1.10.0-0ubuntu1~cloud0 distributed virtual object store - object server

and when I do 'upload' operation with -S option, swiftclient hangout with these messages

# swift upload container01 -S 3073741824 6000M
6000M segment 2 [after 2 attempts]
6000M segment 1
Object PUT failed: http://10.200.9.112:8080:8080/v1/AUTH_8ec73c5659b64faba28e14f37a365d34/container01_segments/6000M/1394762424.516300/6291456000/3073741824/00000000 401 Unauthorized [first 60 chars of response] <html><h1>Unauthorized</h1><p>This server could not verify t
Aborting manifest creation because not all segments could be uploaded. container01/6000M

So I uploaded large object (6000M bytes File). These error does not occur with small object file.

I'm using Swift 1.10.0 with keystone 2013.2.2 (Havana). and I tested python-swiftclient 2.0.3, but these these error was occurred.

Does Anyone have a idea ?

--
Thanks from Tokyo. Tomokazu HIRAI

Revision history for this message
Tomokazu Hirai (tomokazu-hirai) wrote :

my endpoints are ...

# keystone endpoint-list
+----------------------------------+-----------+------------------------------------------------+------------------------------------------------+------------------------------------------------+----------------------------------+
| id | region | publicurl | internalurl | adminurl | service_id |
 +----------------------------------+-----------+------------------------------------------------+------------------------------------------------+------------------------------------------------+----------------------------------+
| c1690a32c393498da56d16d2d3dd77dd | RegionOne | http://10.200.9.87:5000/v2.0 | http://10.200.9.87:5000/v2.0 | http://10.200.9.87:35357/v2.0 | 681878f192fc40f0ad7386cbd9dea47f |
| d939a8740f1948cc879fcdd7a6518993 | RegionOne | http://10.200.9.112:8080/v1/AUTH_%(tenant_id)s | http://10.200.9.112:8080/v1/AUTH_%(tenant_id)s | http://10.200.9.112:8080/v1/AUTH_%(tenant_id)s | 62a692d223a740279edd1c52f1db27d8 |
 +----------------------------------+-----------+------------------------------------------------+------------------------------------------------+------------------------------------------------+----------------------------------+

So these URLs does not have such duplicated port number addresses.. and it is successful for small object uploading operation.

Revision history for this message
dba (lee203) wrote :

In my case, similar error occured at python-swiftclient-2.0.2
  I have tested on centos 6.4

# rpm -q python-swiftclient
  python-swiftclient-2.0.2-1.el6.noarch

# swift upload container01 -S 3073741824 6gfile
  Object PUT failed: https://xxx.xxx.xxx.xxx/v1/AUTH_xxxxxxxxxxf14a18ad6dd4894b0c086d/container01_segments/6gfile/1395127172.350715/6000000000/3073741824/00000000 413 Request Entity Too Large [first 60 chars of response] <html><h1>Request Entity Too Large</h1><p>The body of your r
  Object PUT failed: https://xxx.xxx.xxx.xxx/v1/AUTH_xxxxxxxxxxf14a18ad6dd4894b0c086d/container01_segments/6gfile/1395127172.350715/6000000000/3073741824/00000001 413 Request Entity Too Large [first 60 chars of response] <html><h1>Request Entity Too Large</h1><p>The body of your r
  Aborting manifest creation because not all segments could be uploaded. ccontainer01/6gfile

Revision history for this message
Tomokazu Hirai (tomokazu-hirai) wrote :

I resolved this problem. but I did workaround operation.

I edit /etc/keystone/keystone.conf at this line...

    [signing]
    token_format = PKI -> UUID # I changed value from 'PKI' to 'UUID'

I can not understand why I could resolve this problem.

Thanks !

Revision history for this message
Timur Nurlygayanov (tnurlygayanov) wrote :

This issue reproduced on my environment with 'token_format = UUID' too, looks like swift client can't upload large files

Revision history for this message
Timur Nurlygayanov (tnurlygayanov) wrote :

Looks like we have the same issue in
https://bugs.launchpad.net/swift/+bug/1381875

and we have a fix for this.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.