Comment 18 for bug 745243

For reference, here is the summary of IRC discussions on this topic, including support from Platform with regards to a release plan for the fix.

We quickly considered the 2 alternatives today. The alternatives being:
  1. workaround in apps, no change in the library
vs
 2. patch in the library and regression testing in the apps

The library approach (2.) was chosen, as it's easier to implement and is
closer to a long term solution.

The plan of action considered now looks as follows:

1. kamstrup to start integrating the tokenizer + library patch into libxapian
2. seb128 to integrate the lib and impacted packages into a PPA for testing
3. mvo to check potential regressions with the SC test suite (western languages mostly)
4. At that point, we'd like the test teams in OEM, and CJK users in particular, to control the resulting packages.