HyperArch.py multibyte charset

[tkikuchi]

HyperArch.py in 2.1b5 use Utils.uquote() for
CGIescape() and html_quote() but it does not take
language argument. This is no good for multilbyte
charset because characters are escaped in separate 8bit
bytes which results in mojibake.
We should rather use Utils.uncanonstr() to honor the
legal characters within the multibyte charset.
This patch fixes other minor bugs in the current code.

[tkikuchi (tkikuchi-users)]

The file hyperarc.py.diff was added: HyperArch.py.diff

[bwarsaw (bwarsaw)]

Logged In: YES
user_id=12800

Here's a new version of the patch that applies cleanly to
current cvs. I'm not sure I'm testing it well enough, so
could you take a look?

[bwarsaw (bwarsaw)]

The file 646884.txt was added: None

[loewis (loewis-users)]

Logged In: YES
user_id=21627

Tokio, can you please explain the problem in more detail?
Utils.uquote will always return 7bit strings only,
potentially with nested HTML character references. Why could
this cause a problem in a multi-byte encoding? Can you refer
to a page that looks incorrectly because of that?

[tkikuchi (tkikuchi-users)]

Logged In: YES
user_id=67709

Thanks Barry. The patch was successfully applied and things
are worklng better. (a new i18n problem in date format, though)

[tkikuchi (tkikuchi-users)]

Logged In: YES
user_id=67709

I think I have to generate new translation regarding the
date format problem. Sorry.

[bwarsaw (bwarsaw)]

Logged In: YES
user_id=12800

Tokio, do you have an answer for Martin's question? If this
solves a real problem w/ Japanese, I'm happy to apply it,
but it would be good to have a sample or test case that
fails without it.

[bwarsaw (bwarsaw)]

Logged In: YES
user_id=12800

Never mind, I saw your follow up in mailman-i18n. That's
good enough for me, so I'll apply the patch.