UnicodeDecodeError when delivering message

[Antti Kaihola]

I did a fresh install of Mailman 3.0.0a8 on a Debian Squeeze box, created a list, subscribed a few people and sent a message to the list. The message didn't come through, and var/logs/mailman.log has:

Mar 08 13:21:08 2012 (23645) Uncaught runner exception: 'ascii' codec can't decode byte 0xe4 in position 20: ordinal not in range(128)
Mar 08 13:21:08 2012 (23645) Traceback (most recent call last):
  File "/home/mailman/lib/python2.6/site-packages/mailman/core/runner.py", line 138, in _one_iteration
    self._process_one_file(msg, msgdata)
  File "/home/mailman/lib/python2.6/site-packages/mailman/core/runner.py", line 220, in _process_one_file
    keepqueued = self._dispose(mlist, msg, msgdata)
  File "/home/mailman/lib/python2.6/site-packages/mailman/runners/incoming.py", line 64, in _dispose
    process(mlist, msg, msgdata, mlist.start_chain)
  File "/home/mailman/lib/python2.6/site-packages/mailman/core/chains.py", line 68, in process
    if link.rule.check(mlist, msg, msgdata):
  File "/home/mailman/lib/python2.6/site-packages/mailman/rules/approved.py", line 81, in check
    if ':' in line:
UnicodeDecodeError: 'ascii' codec can't decode byte 0xe4 in position 20: ordinal not in range(128)
Mar 08 13:21:08 2012 (23645) SHUNTING: 1331212867.805197+9daec32c73ac20978b856348ada1a60fd97a364c

The message did contain an u'\xe4' in both the subject and the body. I sent the message using Thunderbird 10.0.2 on Linux Mint 12.

[Antti Kaihola (akaihola)]

I updated to mailman revno 7103, threw away the database and tried again, and still get this traceback (file paths truncated):

Mar 08 13:45:42 2012 (24526) Uncaught runner exception: 'ascii' codec can't decode byte 0xe4 in position 20: ordinal not in range(128)
Mar 08 13:45:42 2012 (24526) Traceback (most recent call last):
  File "mailman/core/runner.py", line 138, in _one_iteration
    self._process_one_file(msg, msgdata)
  File "mailman/core/runner.py", line 220, in _process_one_file
    keepqueued = self._dispose(mlist, msg, msgdata)
  File "mailman/runners/incoming.py", line 64, in _dispose
    process(mlist, msg, msgdata, mlist.posting_chain)
  File "mailman/core/chains.py", line 68, in process
    if link.rule.check(mlist, msg, msgdata):
  File "mailman/rules/approved.py", line 81, in check
    if ':' in line:
UnicodeDecodeError: 'ascii' codec can't decode byte 0xe4 in position 20: ordinal not in range(128)
Mar 08 13:45:42 2012 (24526) SHUNTING: 1331214342.4443481+a044725593fde952570648a22d7cc36546cb4a70

[Antti Kaihola (akaihola)]

The mailing list's preferred language is 'fi', and I have the following in my mailman.cfg:

[language.fi]
description: Finnish
charset: utf-8
enabled: yes

[Mark Sapiro (msapiro)]

I'm adding a patch I think will fix this.

[Bernard (unowned60)]

all my by this program receives mistake how one can put down it, thanks

2012/3/16 Launchpad Bug Tracker <email address hidden>

> ** Branch linked: lp:~msapiro/mailman/bug_949924
>
> --
> You received this bug notification because you are subscribed to GNU
> Mailman.
> Matching subscriptions: 24/7
> https://bugs.launchpad.net/bugs/949924
>
> Title:
> UnicodeDecodeError when delivering message
>
> Status in GNU Mailman:
> Confirmed
> Status in GNU Mailman 3.0 series:
> Confirmed
>
> Bug description:
> I did a fresh install of Mailman 3.0.0a8 on a Debian Squeeze box,
> created a list, subscribed a few people and sent a message to the
> list. The message didn't come through, and var/logs/mailman.log has:
>
> Mar 08 13:21:08 2012 (23645) Uncaught runner exception: 'ascii' codec
> can't decode byte 0xe4 in position 20: ordinal not in range(128)
> Mar 08 13:21:08 2012 (23645) Traceback (most recent call last):
> File
> "/home/mailman/lib/python2.6/site-packages/mailman/core/runner.py", line
> 138, in _one_iteration
> self._process_one_file(msg, msgdata)
> File
> "/home/mailman/lib/python2.6/site-packages/mailman/core/runner.py", line
> 220, in _process_one_file
> keepqueued = self._dispose(mlist, msg, msgdata)
> File
> "/home/mailman/lib/python2.6/site-packages/mailman/runners/incoming.py",
> line 64, in _dispose
> process(mlist, msg, msgdata, mlist.start_chain)
> File
> "/home/mailman/lib/python2.6/site-packages/mailman/core/chains.py", line
> 68, in process
> if link.rule.check(mlist, msg, msgdata):
> File
> "/home/mailman/lib/python2.6/site-packages/mailman/rules/approved.py", line
> 81, in check
> if ':' in line:
> UnicodeDecodeError: 'ascii' codec can't decode byte 0xe4 in position 20:
> ordinal not in range(128)
> Mar 08 13:21:08 2012 (23645) SHUNTING:
> 1331212867.805197+9daec32c73ac20978b856348ada1a60fd97a364c
>
> The message did contain an u'\xe4' in both the subject and the body. I
> sent the message using Thunderbird 10.0.2 on Linux Mint 12.
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/mailman/+bug/949924/+subscriptions
>

[Antti Kaihola (akaihola)]

I applied Mark's patch on r7141 and it does fix my original problem. Thanks!