rev doesn't expect input in current locale's charset

[Sitsofe Wheeler]

Description of the problem:
rev doesn't seem to listen to the current locale when reading in text files and always seems to expect utf8.

Steps to reproduce:
1. Save off the iso8859-15.txt attachment.
2. Run
LANG="en_GB" rev iso8859-15.txt | iconv -fiso8859-15 -tutf8

Expected result:
£é
to be printed.

Actual result:
rev: iso8859-15.txt: Invalid or incomplete multibyte or wide character

Additional Information:
SUSE 10.1 and Fedora Core 5 both produce the expected output.

Version information:
Edgy
util-linux 2.12r-11ubuntu1

[Sitsofe Wheeler (sitsofe)]

This is still here in Feisty.

Version Information:
Ubuntu Feisty
util-linux 2.12r-17ubuntu1

[Andy Price (andy-price)]

Confirmed on feisty with util-linux 2.12r-17ubuntu1

[Sitsofe Wheeler (sitsofe)]

Still here on
Ubuntu Gutsy
util-linux 2.12r-19ubuntu1

[Sitsofe Wheeler (sitsofe)]

Still here on
Ubuntu Gutsy (development branch)
util-linux 2.13~rc3-5

[Sitsofe Wheeler (sitsofe)]

Still here on
Ubuntu hardy (development branch)
util-linux 2.13.1-3ubuntu1

[Sitsofe Wheeler (sitsofe)]

Still here on Karmic.

Version information:
Ubuntu 9.10 (Karmic)
util-linux 2.16-1ubuntu5

Additional information:
Slackware 12.1.0 and Fedora release 10 (Cambridge) produce the expected output but (unsurprisingly) Debian 5.0.3 does not.

[Sitsofe Wheeler (sitsofe)]

Still here in Ubuntu Lucid.

Version information:
Ubuntu 10.04 LTS
util-linux 2.17.2-0ubuntu1

[Sitsofe Wheeler (sitsofe)]

Still here in Ubuntu Oneiric.

Version information:
Ubuntu 11.10
util-linux 2.19.1-2ubuntu3

[Joseph Salisbury (jsalisbury)]

Would it be possible for you to test the latest upstream kernel? It will allow additional upstream developers to examine the issue. Refer to https://wiki.ubuntu.com/KernelMainlineBuilds . Please test the release candidate kernel versus the daily build. Once you've tested the upstream kernel, please remove the 'needs-upstream-testing' tag. This can be done by clicking on the yellow pencil icon next to the tag located at the bottom of the bug description and deleting the 'needs-upstream-testing' text. Please let us know your results.

Thanks in advance.

[Sitsofe Wheeler (sitsofe)]

Hi Joseph,

I can say with certainty that this is not going to be an kernel bug - locale related stuff HAS to be at the library or application level because the kernel has no awareness of how to reinterpret things according to the locale.

However, since you have requested upstream kernel testing I'll see what I can do.

[Sitsofe Wheeler (sitsofe)]

(Subscribing Joseph Salisbury)

The problem still exists with the 3.1.0-rc8 as hand built from the upstream kernel git.

Joseph:
As I have tested your request can I make a request in turn? Could you contact the upstream developers and report back what they think of this bug (perhaps its not a bug)? Thanks.