Bug #601576 “problems with non-ascii chars in dirname with sb-po...” : Bugs : SBCL

Revision history for this message

Bernd Beuster (bernd-beuster) wrote on 2010-07-04:

#1

building-contrib.sb-posix Edit (17.4 KiB, text/plain)

Revision history for this message

Bernd Beuster (bernd-beuster) wrote on 2010-08-04:

#2

32-bit Kernel

flexo:~ bernd$ uname -a
Darwin flexo.fritz.box 10.4.0 Darwin Kernel Version 10.4.0: Fri Apr 23 18:28:53 PDT 2010; root:xnu-1504.7.4~1/RELEASE_I386 i386

Revision history for this message

Nikodemus Siivola (nikodemus) wrote on 2010-10-18:

#3

Additional information:

Philippe Mechaï to sbcl-devel:

As already reported (see https://bugs.launchpad.net/sbcl/+bug/601576), sb-posix tests fail (at least on Mac OS X) when a folder name contains special characters (in my case a trademark sign).
The bug is still present in latest version from Git (v1.0.43.65). This is non blocking as I can disable the readdir test if I need to, but I thought it was worth mentioning.

Changed in sbcl:
assignee:	nobody → Nikodemus Siivola (nikodemus)

Revision history for this message

Nikodemus Siivola (nikodemus) wrote on 2010-10-19:

#4

Download full text (10.1 KiB)

Wow, this is pretty spectacular.

> LANG=C sh run-sbcl.sh
(running SBCL from: /Users/nikodemus/src/sbcl-öäå)
This is SBCL 1.0.43.75, an implementation of ANSI Common Lisp.
More information about SBCL is available at <http://www.sbcl.org/>.

SBCL is free software, provided as is, with absolutely no warranty.
It is mostly in the public domain; some portions are provided under
BSD-style licenses. See the CREDITS and COPYING files in the
distribution for more information.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x1000729b2f, sp=0x31ff490)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Enabling blocked gc signals to allow returning to Lisp without risking
gc deadlocks. Since GC signals are only blocked in signal handlers when
they are not safe to interrupt at all, this is a pretty severe occurrence.

The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x100072aa3b, sp=0x31feef0)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x1000729b2f, sp=0x31fe530)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x100072aa3b, sp=0x31fdf90)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x1000729b2f, sp=0x31fd5d0)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x100072aa3b, sp=0x31fd030)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x1000729b2f, sp=0x31fc670)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x100072aa3b, sp=0x31fc0d0)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x1000729b2f, sp=0x31fb710)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x100072aa3b, sp=0x31fb170)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x1000729b2f, sp=0x31fa7b0)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x100072aa3b, sp=0x31fa210)
The integrity of this image is possibly compro...

Wow, this is pretty spectacular.

> LANG=C sh run-sbcl.sh 
(running SBCL from: /Users/nikodemus/src/sbcl-öäå)
This is SBCL 1.0.43.75, an implementation of ANSI Common Lisp.
More information about SBCL is available at <http://www.sbcl.org/>.

SBCL is free software, provided as is, with absolutely no warranty.
It is mostly in the public domain; some portions are provided under
BSD-style licenses.  See the CREDITS and COPYING files in the
distribution for more information.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x1000729b2f, sp=0x31ff490)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Enabling blocked gc signals to allow returning to Lisp without risking
gc deadlocks. Since GC signals are only blocked in signal handlers when 
they are not safe to interrupt at all, this is a pretty severe occurrence.

The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x100072aa3b, sp=0x31feef0)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x1000729b2f, sp=0x31fe530)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x100072aa3b, sp=0x31fdf90)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x1000729b2f, sp=0x31fd5d0)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x100072aa3b, sp=0x31fd030)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x1000729b2f, sp=0x31fc670)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x100072aa3b, sp=0x31fc0d0)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x1000729b2f, sp=0x31fb710)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x100072aa3b, sp=0x31fb170)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x1000729b2f, sp=0x31fa7b0)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x100072aa3b, sp=0x31fa210)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x1000729b2f, sp=0x31f9850)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x100072aa3b, sp=0x31f92b0)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x1000729b2f, sp=0x31f88f0)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x100072aa3b, sp=0x31f8350)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x1000729b2f, sp=0x31f7990)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x100072aa3b, sp=0x31f73f0)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x1000729b2f, sp=0x31f6a30)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x100072aa3b, sp=0x31f6490)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 152000 (pc=0x1000729b2f, sp=0x31f5ad0)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
CORRUPTION WARNING in SBCL pid 45397(tid 140735072831232):
Memory fault at 153000 (pc=0x100072ab7a, sp=0x31f53d0)
The integrity of this image is possibly compromised.
Continuing with fingers crossed.
internal error #26 (An attempt was made to use an undefined SYMBOL-VALUE.)
    SC: 21, Offset: 0	$1=	  0x1000144a0f: other pointer
fatal error encountered in SBCL pid 45397(tid 140735072831232):
internal error too early in init, can't recover

Welcome to LDB, a low-level debugger for the Lisp runtime environment.
ldb> ba
Backtrace:
   0: Foreign function lose, fp = 0x31f4850, ra = 0x1065cf
   1: Foreign function interrupt_internal_error, fp = 0x31f4880, ra = 0x107bab
   2: Foreign function signal_emulation_wrapper, fp = 0x31f48d0, ra = 0x1107f1
   3: Foreign function stack_allocation_recover, fp = 0x31f4940, ra = 0x1101d0
   4: Foreign function stack_allocation_recover, fp = 0x31f4db8, ra = 0x1101d0
   5: SB-IMPL::GET-BUFFER
   6: SB-IMPL::SET-FD-STREAM-ROUTINES
   7: (SB-C::TL-XEP SB-SYS::MAKE-FD-STREAM)
   8: (SB-C::HAIRY-ARG-PROCESSOR SB-IMPL::STREAM-REINIT)
   9: SB-KERNEL::STREAM-COLD-INIT-OR-RESET
  10: (SB-C::TL-XEP SB-IMPL::ERROR-ERROR)
  11: SB-IMPL::INFINITE-ERROR-PROTECTOR
  12: (SB-C::TL-XEP COMMON-LISP::ERROR)
  13: SB-SYS::MEMORY-FAULT-ERROR
  14: Foreign function call_into_lisp, fp = 0x31f5338, ra = 0x118220
  15: Foreign function post_signal_tramp, fp = 0x31f53c0, ra = 0x118310
  16: SB-IMPL::OUTPUT-BYTES/ASCII
  17: (SB-C::VARARGS-ENTRY (COMMON-LISP::LAMBDA (COMMON-LISP::&REST COMMON-LISP::REST)))
  18: (SB-C::&MORE-PROCESSOR (COMMON-LISP::LAMBDA (COMMON-LISP::&REST COMMON-LISP::REST)))
  19: SB-IMPL::FD-SOUT
  20: SB-IMPL::%WRITE-STRING
  21: SB-IMPL::%WRITE-STRING
  22: (SB-C::HAIRY-ARG-PROCESSOR COMMON-LISP::PRINC)
  23: (COMMON-LISP::LAMBDA ())
  24: SB-IMPL::%WITH-STANDARD-IO-SYNTAX
  25: (SB-C::TL-XEP SB-IMPL::ERROR-ERROR)
  26: SB-IMPL::INFINITE-ERROR-PROTECTOR
  27: (SB-C::TL-XEP COMMON-LISP::ERROR)
  28: SB-SYS::MEMORY-FAULT-ERROR
  29: Foreign function call_into_lisp, fp = 0x31f5a38, ra = 0x118220
  30: Foreign function post_signal_tramp, fp = 0x31f5ac0, ra = 0x118310
  31: SB-IMPL::OUTPUT-CHAR-ASCII-LINE-BUFFERED
  32: (SB-C::VARARGS-ENTRY (COMMON-LISP::LAMBDA (COMMON-LISP::&REST COMMON-LISP::REST)))
  33: (SB-C::&MORE-PROCESSOR (COMMON-LISP::LAMBDA (COMMON-LISP::&REST COMMON-LISP::REST)))
  34: (SB-C::HAIRY-ARG-PROCESSOR COMMON-LISP::WRITE-CHAR)
  35: (SB-C::HAIRY-ARG-PROCESSOR COMMON-LISP::TERPRI)
  36: SB-FORMAT::&-FORMAT-DIRECTIVE-INTERPRETER
  37: SB-FORMAT::INTERPRET-DIRECTIVE-LIST
  38: (SB-C::HAIRY-ARG-PROCESSOR SB-FORMAT::%FORMAT)
  39: (SB-C::TL-XEP COMMON-LISP::FORMAT)
  40: SB-DEBUG::%PRINT-DEBUGGER-INVOCATION-REASON
  41: SB-DEBUG::%INVOKE-DEBUGGER
  42: (COMMON-LISP::LAMBDA ())
  43: SB-IMPL::CALL-WITH-SANE-IO-SYNTAX
  44: SB-IMPL::%WITH-STANDARD-IO-SYNTAX
  45: COMMON-LISP::INVOKE-DEBUGGER
  46: (SB-C::TL-XEP COMMON-LISP::ERROR)
  47: SB-SYS::MEMORY-FAULT-ERROR
  48: Foreign function call_into_lisp, fp = 0x31f63f8, ra = 0x118220
  49: Foreign function post_signal_tramp, fp = 0x31f6480, ra = 0x118310
  50: SB-IMPL::OUTPUT-BYTES/ASCII
  51: (SB-C::VARARGS-ENTRY (COMMON-LISP::LAMBDA (COMMON-LISP::&REST COMMON-LISP::REST)))
  52: (SB-C::&MORE-PROCESSOR (COMMON-LISP::LAMBDA (COMMON-LISP::&REST COMMON-LISP::REST)))
  53: SB-IMPL::FD-SOUT
  54: SB-IMPL::%WRITE-STRING
  55: SB-IMPL::%WRITE-STRING
  56: SB-PRETTY::OUTPUT-LINE
  57: SB-PRETTY::MAYBE-OUTPUT
  58: (SB-C::HAIRY-ARG-PROCESSOR COMMON-LISP::PPRINT-NEWLINE)
  59: SB-FORMAT::_-FORMAT-DIRECTIVE-INTERPRETER
  60: SB-FORMAT::INTERPRET-DIRECTIVE-LIST
  61: (COMMON-LISP::LABELS BODY-NAME-[WITH-PRETTY-STREAM922]924)
  62: SB-FORMAT::INTERPRET-FORMAT-LOGICAL-BLOCK
  63: SB-FORMAT::<-FORMAT-DIRECTIVE-INTERPRETER
  64: SB-FORMAT::INTERPRET-DIRECTIVE-LIST
  65: (SB-C::HAIRY-ARG-PROCESSOR SB-FORMAT::%FORMAT)
  66: (SB-C::TL-XEP COMMON-LISP::FORMAT)
  67: SB-DEBUG::%INVOKE-DEBUGGER
  68: (COMMON-LISP::LAMBDA ())
  69: SB-IMPL::CALL-WITH-SANE-IO-SYNTAX
  70: SB-IMPL::%WITH-STANDARD-IO-SYNTAX
  71: COMMON-LISP::INVOKE-DEBUGGER
  72: (SB-C::TL-XEP COMMON-LISP::ERROR)
  73: SB-SYS::MEMORY-FAULT-ERROR
  74: Foreign function call_into_lisp, fp = 0x31f7358, ra = 0x118220
  75: Foreign function post_signal_tramp, fp = 0x31f73e0, ra = 0x118310
  76: SB-IMPL::OUTPUT-BYTES/ASCII
  77: (SB-C::VARARGS-ENTRY (COMMON-LISP::LAMBDA (COMMON-LISP::&REST COMMON-LISP::REST)))
  78: (SB-C::&MORE-PROCESSOR (COMMON-LISP::LAMBDA (COMMON-LISP::&REST COMMON-LISP::REST)))
  79: SB-IMPL::FD-SOUT
  80: SB-IMPL::%WRITE-STRING
  81: SB-IMPL::%WRITE-STRING
  82: SB-PRETTY::OUTPUT-LINE
  83: SB-PRETTY::MAYBE-OUTPUT
  84: (SB-C::HAIRY-ARG-PROCESSOR COMMON-LISP::PPRINT-NEWLINE)
  85: SB-FORMAT::_-FORMAT-DIRECTIVE-INTERPRETER
  86: SB-FORMAT::INTERPRET-DIRECTIVE-LIST
  87: (COMMON-LISP::LABELS BODY-NAME-[WITH-PRETTY-STREAM922]924)
  88: SB-FORMAT::INTERPRET-FORMAT-LOGICAL-BLOCK
  89: SB-FORMAT::<-FORMAT-DIRECTIVE-INTERPRETER
  90: SB-FORMAT::INTERPRET-DIRECTIVE-LIST
  91: (SB-C::HAIRY-ARG-PROCESSOR SB-FORMAT::%FORMAT)
  92: (SB-C::TL-XEP COMMON-LISP::FORMAT)
  93: SB-DEBUG::%INVOKE-DEBUGGER
  94: (COMMON-LISP::LAMBDA ())
  95: SB-IMPL::CALL-WITH-SANE-IO-SYNTAX
  96: SB-IMPL::%WITH-STANDARD-IO-SYNTAX
  97: COMMON-LISP::INVOKE-DEBUGGER
  98: (SB-C::TL-XEP COMMON-LISP::ERROR)
  99: SB-SYS::MEMORY-FAULT-ERROR
ldb>

Nikodemus Siivola (nikodemus) on 2010-10-19

Changed in sbcl:
status:	New → In Progress

Nikodemus Siivola (nikodemus) on 2011-02-16

Changed in sbcl:
importance:	Undecided → Medium
status:	In Progress → Triaged

Nikodemus Siivola (nikodemus) on 2011-08-15

summary:

- Build of sb-posix fails with 1.0.40 and MacOSX 10.6.4
+ problems with non-ascii chars in dirname with sb-posix build and run-
+ sbcl.sh

Revision history for this message

Nikodemus Siivola (nikodemus) wrote on 2011-12-02:

#5

This doesn't make it all better, but at least allows SBCL to start up when the dirname contains non-ASCII characters.

https://github.com/nikodemus/SBCL/commit/78f303541c0b0a3ff324b4d5e1da7650e8311126

Changed in sbcl:
status:	Triaged → In Progress

Revision history for this message

Nikodemus Siivola (nikodemus) wrote on 2012-05-20:

#6

I think the right thing here look like this:

1. Implement UTF-8b.

2. Add *system-external-format*. Default on Windows is UCS-2, and UTF-8b everywhere else.

3. Use it for pathnames and environment variables.

Changed in sbcl:
assignee:	Nikodemus Siivola (nikodemus) → nobody
status:	In Progress → Triaged

Revision history for this message

Mark.Evenson (evenson-not-org) wrote on 2013-10-28:

#7

Still an active problem on OS X, cf. <https://trac.macports.org/ticket/40980>.

Revision history for this message

Stas Boukarev (stassats) wrote on 2013-10-28:

#8

I can't comment there, but if it's such an active problem, why can't they set LANG or LC_CTYPE to a proper value?

Revision history for this message

ciel (cielavenir) wrote on 2013-10-31:

#9

Hi,

OSX (Japanese) has /ユーザ情報, which contains ENERGYSTAR.pdf. Other non-European OSX Installation are similar.
By the way, LANG=ja_JP.UTF-8, so it should be alright.

SBCL

problems with non-ascii chars in dirname with sb-posix build and run-sbcl.sh

Bug Description

Duplicates of this bug

Other bug subscribers

Bug attachments

Remote bug watches