Support Japanese new era "令和 (Reiwa)"

[Mathieu Trudel-Lapierre]

[Background]
Many packages are affected by the requirement to support the new era "Reiwa" (令和）

This is the meta bug to track packages that need fixes; which packages have already been SRUd to previous releases, how to prioritize the work needed, and general test cases for verifying that things are working as expected.

[Impact]
Users who run Ubuntu in Japanese.

[Test cases]

Unicode data include REIWA like it includes HEISEI. Reverse-build-depends need a rebuild to include the new data, followed by the following tests to make sure the data is taken into account.

1) Rebuild reverse-depends of unicode-data; check that they build fine (ie. no regressions due to unicode-data changes):

Reverse-Build-Depends
=====================
* console-data
* courier-unicode
* cyrus-imapd
* fntsample
* fonttools
* gucharmap
* ibus
* julia
* libxmlada
* node-unicode-data
* node-unicode-property-aliases
* node-unicode-property-aliases-ecmascript
* node-unicode-property-value-aliases
* node-unicode-property-value-aliases-ecmascript
* node-unicode-tr51
* re2
* safeclib
* slang2
* utf8proc
* wcwidth
* wine
* wine-development

2) Using gucharmap, verify that the SQUARE ERA NAME REIWA glyph point exists (there may not be a glyph associated as that is font-dependent.

== Character maps / font support ==

1) Search for character "SQUARE ERA NAME"
2) Verify that the results include at least "SQUARE ERA NAME HEISEI" and "SQUARE ERA NAME REIWA" (there should also be Syouwa, Taisyou and Meizi), and that the glyphs are readable:

 - SQUARE ERA NAME HEISEI: ㍻
 - SQUARE ERA NAME REIWA: 令和 (in a single glyph)

Display of the Reiwa square glyph is font-specific; it may show simply as a empty square or a square with hex characters. If that is the case, the unicode data supports the new character, but the selected font does not include the new glyph. Use fonts-noto-cjk to display the glyph.

[Regression potential]
This is a potentially large change as it impacts font display, character sets as well as date conversions. As such, extreme care should be taken to ensure that regressions are avoided, such that dates previous to May 1, 2019 continue to display as before, and dates onward are displayed with the new era symbols. The included test cases account for verifying the continued behavior or previous dates.

[Mathieu Trudel-Lapierre (cyphermox)]

Unicode-data 12.1 includes the new glyph. Some packages may need some light porting to make them work (see gucharmap, for example).

[Brian Murray (brian-murray)]

Hello Mathieu, or anyone else affected,

Accepted unicode-data into disco-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/unicode-data/11.0.0-1ubuntu0.19.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-disco to verification-done-disco. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-disco. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

[Brian Murray (brian-murray)]

Hello Mathieu, or anyone else affected,

Accepted unicode-data into bionic-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/unicode-data/10.0.0-3ubuntu0.18.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-bionic to verification-done-bionic. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-bionic. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

[Timo Aaltonen (tjaalton)]

Hello Mathieu, or anyone else affected,

Accepted unicode-data into xenial-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/unicode-data/8.0-3ubuntu0.16.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-xenial to verification-done-xenial. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-xenial. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

[Brian Murray (brian-murray)]

The fix for this bug has been awaiting testing feedback in the -proposed repository for xenial for more than 90 days. Please test this fix and update the bug appropriately with the results. In the event that the fix for this bug is still not verified 15 days from now, the package will be removed from the -proposed repository.

[Steve Langasek (vorlon)]

disco is EOL; this SRU will not be completed for that release.

[Matthieu Clemenceau (mclemenceau)]

tested bionic with unicode-data 10.0.0-3ubuntu0.18.04.1 from proposed.
New ERA NAME REIWA was available in /usr/share/unicode but gucharmap would not find it.
Also recompiling gucharmap, because it is a reverse-build-deps, fails with unicode-data 10.0.0-3ubuntu0.18.04.1.

Sames results with xenial with relative version from xenial and xenial proposed of unicode-data

I confirmed New ERA NAME REIWA is installed and working on Focal.
I recommend will Not Fix for this SRU in Bionic and Xenial since it requires other packages to be modified so they can recompile

[Łukasz Zemczak (sil2100)]

The version of unicode-data in the proposed pocket of Bionic that was purported to fix this bug report has been removed because one or more bugs that were to be fixed by the upload have failed verification and been in this state for more than 10 days.

[Łukasz Zemczak (sil2100)]

The version of unicode-data in the proposed pocket of Xenial that was purported to fix this bug report has been removed because one or more bugs that were to be fixed by the upload have failed verification and been in this state for more than 10 days.