DDTP translation strings breakage in Japanese(ja)/Simplified Chinese(zh_CN)/ Traditional Chinese(zh_TW)

[Nobuto Murata]

Japanese (ja) / Simplified Chinese (zh_CN) / Traditional Chinese (zh_TW) descriptions are broken at stepping over lines.

Affected files are Translation-ja, Translation-zh_CN, Translation-zh_TW in the following link,
http://archive.ubuntu.com/ubuntu/dists/lucid/main/i18n/

Exported files from Launchpad seems fine.
http://bazaar.launchpad.net/~mvo/ddtp-ubuntu/ddtp-ubuntu3/files/head%3A/main/

Actual result:
 break with [?] characters.
 http://launchpadlibrarian.net/42650262/screenshot2.png

Note: Debian's DDTP looks fine.
http://ddtp.debian.net/debian/dists/sid/main/i18n/

[Nobuto Murata (nobuto)]

This breakage affects "apt-cache show" output.
Software Center is also affected.
In Software Center, if package description contains broken characters,
description in "More Info" view is not shown at all.
Instead it just shows
"Invalid unicode in description for 'Package' ('utf8' codec can't decode bytes in position 122-124: invalid data). Please report."

[Fumihito YOSHIDA (hito)]

Nobuto, I forwarded to -translators lists, see also https://lists.ubuntu.com/archives/ubuntu-translators/2010-March/003468.html

[Michael Vogt (mvo)]

Its probably a bug in the export script, I add a apt task so that we have a milestoned task to track.

[Starboy (starboy)]

It seems that the nameing of zh_CN/zh_TW are not very clear for us non-native speakers, I've sorted them as what rosetta suggested so none of the teams' members will get unhappy, :)

[Michael Vogt (mvo)]

I updated the code now to properly deal with it. Its now all valid utf8 again and I added a check in the export script that ensures that no non-valid utf8 gets uploaded. I don't speak ja, zh_CN or zh_TW so once the freeze is over someone needs to verify if its really valid.

[Aron Xu (happyaron)]

Added zh_CN and zh_TW translators team to subscription list, please the teams (ja, zh_CN and zh_TW) drop eyes on this issue and check when freeze is over as Michael said in previous comment.

Regards,
Aron Xu

[Fumihito YOSHIDA (hito)]

@mvo:
ACKed for Ja. I verify head's DDTP Ja file, it seems valid.

[Cheng-Chia Tseng (zerng07)]

As to zh_TW, it seems good at the moment.

[Aron Xu (happyaron)]

Same for zh_CN, the strings are in good shape.

[Michael Vogt (mvo)]

Cool! Many thanks for verifying :)