s3 client generating wrong URLs

[Bartlomiej Ogryczak]

S3Client generates endpoint URLs in format https://s3.amazonaws.com/bucketname/key, however for some buckets (eg. in zone EU-west) this doesn't work. Instead an error is returned

<Error>
<Code>PermanentRedirect</Code>
<Message>
The bucket you are attempting to access must be addressed using the specified endpoint. Please send all future requests to this endpoint.
</Message>
<RequestId>...</RequestId>
<Bucket>bucketnmae</Bucket>
<HostId>...</HostId>
<Endpoint>bucketname.s3.amazonaws.com</Endpoint>
</Error>

Correct URL format for accessing any bucket is http[s]://bucketname.s3.amazonaws.com/key

[Tristan Seligmann (mithrandi)]

Note that this doesn't work for buckets with a name that is invalid as a DNS component, so I suspect we need to support both methods of addressing a bucket.

[Bartlomiej Ogryczak (b-ogryczak)]

Right, it's US based vs. non-US-based buckets. http://docs.amazonwebservices.com/AmazonS3/latest/dev/BucketRestrictions.html

I'm using EU-West region.

[Bartlomiej Ogryczak (b-ogryczak)]

Or more like US-East vs. any other.

[Zooko Wilcox-O'Hearn (zooko)]

Please note that there is a patch attached to https://bugs.launchpad.net/txaws/+bug/1033324 that Least Authority Enterprises has been using in production (AWS us-east).

[Zooko Wilcox-O'Hearn (zooko)]

I created a branch to hold the https://leastauthority.com version of txAWS and here is the patch for this issue from that branch:

http://bazaar.launchpad.net/~zooko/txaws/leastauthority.com/revision/151