utf-8 in metadata and http header names

[David Hadas]

RFC2616 implicitly allows transferring utf-8 in headers (vals) but not in header names (keys)

Swift functional tests includes testing for utf-8 header names (keys) which is non aligned with the standard.
This seem to be the case when testing file metadata.
File metadata keys are than transferred as part of the http header keys (header names) as
      X-Object-Meta-<metadata_key>=metadata_name.

As a result metadata_keys in swift must be composed from a subset of ASCII characters - alpha numerics, some punctuation, not a lot else* and cannot be utf-8.

Details from the RFC:

   message-header = field-name ":" [ field-value ]
   field-name = token
   field-value = *( field-content | LWS )
   field-content = <the OCTETs making up the field-value
                    and consisting of either *TEXT or combinations
                    of token, separators, and quoted-string>

Zoom in on field-name (i.e. token)

   token = 1*<any CHAR except CTLs or separators>

Zoom on CHAR, CTL and separators:

   CHAR = <any US-ASCII character (octets 0 - 127)>

   CTL = <any US-ASCII control character
                    (octets 0 - 31) and DEL (127)>

   separators = "(" | ")" | "<" | ">" | "@"
                  | "," | ";" | ":" | "\" | <">
                  | "/" | "[" | "]" | "?" | "="
                  | "{" | "}" | SP | HT

* Thanks to Tom Anderson's summary listed in http://stackoverflow.com/questions/3561381/custom-http-headers-naming-conventions

[David Hadas (david-hadas)]

Typo: X-Object-Meta-<metadata_key>: <metadata_val>

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/14695

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/14695
Committed: http://github.com/openstack/swift/commit/56e757257e98f9203c79c8f4a1a9e5116b7320e8
Submitter: Jenkins
Branch: master

commit 56e757257e98f9203c79c8f4a1a9e5116b7320e8
Author: David Hadas <email address hidden>
Date: Tue Oct 23 09:48:24 2012 +0200

    Remove utf-8 in metadata and http header names

    RFC2616 implicitly allows transferring utf-8 in
    headers (vals) but not in header names (keys)

    Swift functional tests includes testing for utf-8
    header names (keys) which is non aligned with the standard.
    This seem to be the case when testing file metadata.
    File metadata keys are than transferred as part of
    the http header keys (header names) as
          X-Object-Meta-<metadata_key>=metadata_name.

    As a result metadata_keys in swift must be composed from
    a subset of ASCII characters - alpha numerics,
    some punctuation, not a lot else* and cannot be utf-8.

    On branch bp/wsgi-application-interface-4
    modified: test/functional/tests.py

    Change-Id: I1932e9d4ead83089e8a31a06d28a54f5625efb9c
    Fixes: bug 1068026
    Implements: blueprint wsgi-application-interface