ls/less can not understand some i18n chars

[Tim Spriggs]

This article is related: http://www.nexenta.com/corp/index.php?option=com_fireboard&Itemid=44&func=view&id=482&catid=9

This comes from pasting an i18n string into his shell but seems to work on a Linux installation. It's possible that coreutils, less and zsh simply need to be recompiled with newer i18n definitions available.

Other commands seem to exhibit similar problems. When looking into UTF8 syntax it seems that u+fffd is a special character to print when software does not understand/recognize the input character. Specifically, u+0442 and u+0440 seem to be replaced with u+fffd when piped through less, but not through more or cat. In this scenario, ls does not seem to modify the output but rather leaves that to the end program (less/more/cat).

This should really be two/three different bugs but it's likely that solving one will lead to solving all.

Note: the original reporter indicated the bug was in package 'coreutils'; however, that package was not published in Nexenta Operating System.