Five.browser.decode.processInputs and ZTUtils.Zope.make_query collide because of non-ASCII characters

[Daniel Nouri]

When Five.browser.decode.processInputs decodes values, it's no longer safe for ZTUtils.Zope.make_query to do this:

    qlist[i] = '%s%s=%s' % (uq(k), m, uq(str(v)))

Obviously, str(v) will pretty quickly result in a UnicodeError. To find out the appropriate encoding, one has to probably go back to negotiating the charset.

[G. Gozadinos (ggozadinos)]

This affects a number of sites I am running which use Greek as a language in utf-8 encoding.
I temporarily fix this by adding:

if isinstance(v, unicode):
 v = v.encode('utf-8')

before qlist[i] = '%s%s=%s' % (uq(k), m, uq(str(v))) is called.
Supposedly one should use IUserPreferredCharsets utility to get the encoding and modify the above accordingly.
I assume that all multilingual plone sites will be affected by this.

[Colin Watson (cjwatson)]

The zope2 project on Launchpad has been archived at the request of the Zope developers (see https://answers.launchpad.net/launchpad/+question/683589 and https://answers.launchpad.net/launchpad/+question/685285). If this bug is still relevant, please refile it at https://github.com/zopefoundation/zope2.