cuneiform crashes right after launching

[Serge Poltavsky]

gdb output:

GNU gdb 6.8
Copyright (C) 2008 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "i586-suse-linux"...
"/home/serj/download/src/cuneiform-0.3/builddir/stock_gs200.bmp" is not a core dump: File format not recognized
(gdb) run
Starting program: /home/serj/download/src/cuneiform-0.3/builddir/cuneiform
Cuneiform for Linux 0.3.0
Usage: /home/serj/download/src/cuneiform-0.3/builddir/cuneiform [-l languagename --html -o result_file] imagefile

Program exited normally.
(gdb) run stock_gs200.bmp
Starting program: /home/serj/download/src/cuneiform-0.3/builddir/cuneiform stock_gs200.bmp
Cuneiform for Linux 0.3.0
The image depth is 8 at this point.
Warning: RSL said that the lines do not have to withdraw.

Program received signal SIGSEGV, Segmentation fault.
0xb77d36a0 in cur_line (tt=0 '\0', cur_segm=0x0) at /home/serj/download/src/cuneiform-0.3/cuneiform_src/Kern/rling/sources/c/speledf1.c:458
458 if (cur_segm->prev_in_fragm == NULL)
Current language: auto; currently c
(gdb) Quit

[Alex Samorukov (samm-os2)]

Oops, i did duplicate report. I have the same problem. revision 229 from bazaar works fine, at least with test.bmp.

Also, please take a note that cur_segm is 0, in working version (229) there is a correct pointer. Also SPQ.st.cur_segm is 0 too, so i think that the problem is somewhere around.

[Jussi Pakkanen (jpakkane)]

The reason this bug happens is at come point Cuneiform writes its internal data state to a long string. This is parsed in the file speledf1.c and particularly in function do_fragm. The culprit is the commit that removes #pragma packs from the source (221.1.14).

I don't know a proper fix yet, but I'm working on it.

[Jussi Pakkanen (jpakkane)]

I have pushed a fix to trunk that works for me on amd64 (revision 234). Please check whether it works for you.

[yaleks (yaleks)]

 bzr diff -r232..234 >~/cuneiform/cuneiform-0.3-pragma-fix.patch

Not fixed.

(gdb) run book_1.tif
Starting program: /usr/bin/cuneiform book_1.tif
[Thread debugging using libthread_db enabled]
Cuneiform for Linux 0.3.0
[New Thread 0x7fdd36d43790 (LWP 30003)]
[New Thread 0x4187b950 (LWP 30004)]
The image depth is 1 at this point.
Warning: RSL said that the lines do not have to withdraw.

Program received signal SIGSEGV, Segmentation fault.
[Switching to Thread 0x7fdd36d43790 (LWP 30003)]
0x00007fdd394091b9 in p2_Comp2Raster (lt=<value optimized out>, lp=<value optimized out>, w=10, h=<value optimized out>,
    rec=0x7fff45283340) at /var/tmp/portage/app-text/cuneiform-0.3/work/cuneiform-0.3/cuneiform_src/Kern/pass2/src/p2_tools.c:149
149 /var/tmp/portage/app-text/cuneiform-0.3/work/cuneiform-0.3/cuneiform_src/Kern/pass2/src/p2_tools.c: No such file or directory.
        in /var/tmp/portage/app-text/cuneiform-0.3/work/cuneiform-0.3/cuneiform_src/Kern/pass2/src/p2_tools.c
Current language: auto; currently c

(gdb) run test.bmp
The program being debugged has been started already.
Start it from the beginning? (y or n) y
Starting program: /usr/bin/cuneiform test.bmp
[Thread debugging using libthread_db enabled]
Cuneiform for Linux 0.3.0
[New Thread 0x7f2be9462790 (LWP 30005)]
The image depth is 24 at this point.

Program received signal SIGSEGV, Segmentation fault.
[Switching to Thread 0x7f2be9462790 (LWP 30005)]
CTCMemoryList::DeleteItem (this=0x1a22e40, hMemory=0x23ca7b0, wParam=<value optimized out>)
    at /var/tmp/portage/app-text/cuneiform-0.3/work/cuneiform-0.3/cuneiform_src/Kern/cfio/sources/cpp/ctcmemory.cpp:222
222 /var/tmp/portage/app-text/cuneiform-0.3/work/cuneiform-0.3/cuneiform_src/Kern/cfio/sources/cpp/ctcmemory.cpp: No such file or directory.
        in /var/tmp/portage/app-text/cuneiform-0.3/work/cuneiform-0.3/cuneiform_src/Kern/cfio/sources/cpp/ctcmemory.cpp
Current language: auto; currently c++

[Alex Samorukov (samm-os2)]

Strage, i don`t see revision 234 in the https://code.launchpad.net/cuneiform-linux

srvadm@debian:~/src/cuneiform-linux$ bzr revert -r 234
bzr: ERROR: Requested revision: u'234' does not exist in branch: BzrBranch6('file:///home/srvadm/src/cuneiform-linux/')

[Jussi Pakkanen (jpakkane)]

The web page updates quite slowly sometimes. Just do "bzr pull" and you should get the newest code.

[yaleks (yaleks)]

 gdb ./cuneiform
GNU gdb 6.8
Copyright (C) 2008 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-pc-linux-gnu"...
(gdb) run /home/yaleks/cuneiform/cuneiform-0.3/images/book_1.tif
Starting program: /var/tmp/portage/app-text/cuneiform-0.3/work/cuneiform_build/cuneiform /home/yaleks/cuneiform/cuneiform-0.3/images/book_1.tif
[Thread debugging using libthread_db enabled]
Cuneiform for Linux 0.3.0
[New Thread 0x7f83021d4790 (LWP 6290)]
[New Thread 0x424c5950 (LWP 6293)]
The image depth is 1 at this point.
Warning: RSL said that the lines do not have to withdraw.

Program received signal SIGSEGV, Segmentation fault.
[Switching to Thread 0x7f83021d4790 (LWP 6290)]
0x00007f830489a1f9 in p2_Comp2Raster (lt=<value optimized out>, lp=<value optimized out>, w=10, h=<value optimized out>,
    rec=0x7fff107137b0) at /var/tmp/portage/app-text/cuneiform-0.3/work/cuneiform-0.3/cuneiform_src/Kern/pass2/src/p2_tools.c:149
149 for(line=linerep,len=0; len<size && line->lth; len+=line->lth,line=(CCOM_lnhead *)((int)line+line->lth))
Current language: auto; currently c
(gdb) run /home/yaleks/cuneiform/cuneiform-0.3/images/clipb.bmp
The program being debugged has been started already.
Start it from the beginning? (y or n) y

Starting program: /var/tmp/portage/app-text/cuneiform-0.3/work/cuneiform_build/cuneiform /home/yaleks/cuneiform/cuneiform-0.3/images/clipb.bmp
[Thread debugging using libthread_db enabled]
Cuneiform for Linux 0.3.0
[New Thread 0x7f68f6ff2790 (LWP 6305)]
[New Thread 0x408cd950 (LWP 6306)]
The image depth is 8 at this point.

Program received signal SIGSEGV, Segmentation fault.
[Switching to Thread 0x7f68f6ff2790 (LWP 6305)]
CTCMemoryList::DeleteItem (this=0x1b6a930, hMemory=0x1eb7bf0, wParam=<value optimized out>)
    at /var/tmp/portage/app-text/cuneiform-0.3/work/cuneiform-0.3/cuneiform_src/Kern/cfio/sources/cpp/ctcmemory.cpp:222
222 if ( Current->GetHandle() == hMemory )

[Alex Samorukov (samm-os2)]

Still no luck. May be this is because i`m not using lauchpad login...

I will try to upload my key now

[yaleks (yaleks)]

Alex, I use "lp:~jpakkane/cuneiform-linux/cf-64" branch

[Alex Samorukov (samm-os2)]

2yaleks - thanks a lot, i`m a newbie in bazaar

I`m glad to notice that it work on i386 (tested with test.bmp).
gcc v3, debian linux. I will now test on 86_64 ubuntu

[Alex Samorukov (samm-os2)]

srvadm@debian:~/src/cf-64/builddir$ uname -a
Linux debian 2.6.18-6-686 #1 SMP Tue Jun 17 21:31:27 UTC 2008 i686 GNU/Linux

srvadm@debian:~/src/cf-64/builddir$ gcc-3.4 -v
Reading specs from /usr/lib/gcc/i486-linux-gnu/3.4.6/specs
Configured with: ../src/configure -v --enable-languages=c,c++,f77,pascal --prefix=/usr --libexecdir=/usr/lib --with-gxx-include-dir=/usr/include/c++/3.4 --enable-shared --with-system-zlib --enable-nls --without-included-gettext --program-suffix=-3.4 --enable-__cxa_atexit --enable-clocale=gnu --enable-libstdcxx-debug --with-tune=i686 i486-linux-gnu
Thread model: posix
gcc version 3.4.6 (Debian 3.4.6-5)

srvadm@debian:~/src/cf-64/builddir$ ./cuneiform -l rus ../images/test.bmp
Cuneiform for Linux 0.3.0
The image depth is 24 at this point.
Warning: RSL said that the lines do not have to withdraw.

cuneiform-out.txt contain correct text :)

And it fail on ubuntu 86_64:

samm@samm-laptop:~/src/cf-64/builddir$ ./cuneiform ../images/test.bmp
Cuneiform for Linux 0.3.0
The image depth is 24 at this point.
*** glibc detected *** ./cuneiform: double free or corruption (!prev): 0x0000000000a0ca10 ***
======= Backtrace: =========
/lib/libc.so.6[0x7f81a4b6e08a]
/lib/libc.so.6(cfree+0x8c)[0x7f81a4b71c1c]
/home/samm/src/cf-64/builddir/libcfio.so(_ZN15CTCMemoryHeaderD1Ev+0x34)[0x7f81a9505abc]
/home/samm/src/cf-64/builddir/libcfio.so(_ZN13CTCMemoryList8KillItemEP15CTCMemoryHeaderS1_+0x73)[0x7f81a9505b3b]
/home/samm/src/cf-64/builddir/libcfio.so(_ZN13CTCMemoryList10DeleteItemEPvj+0x56)[0x7f81a9505ba2]
/home/samm/src/cf-64/builddir/libcfio.so(_ZN10CTCControl20DeleteMemoryFromListEPv+0x22)[0x7f81a9502d48]
/home/samm/src/cf-64/builddir/libcfio.so(_ZN10CTCControl10FreeMemoryEPvj+0x3e)[0x7f81a9502f1c]
/home/samm/src/cf-64/builddir/libcfio.so(_ZN10CTCControl4FreeEPv+0x22)[0x7f81a9502f5c]
/home/samm/src/cf-64/builddir/libcfio.so(CFIO_FreeMemory+0x38)[0x7f81a9507322]
/home/samm/src/cf-64/builddir/librimage.so(RIMAGEFree+0x15)[0x7f81aa1e4d23]
/home/samm/src/cf-64/builddir/librimage.so(memory_free+0xd3)[0x7f81aa1e1945]
/home/samm/src/cf-64/builddir/librimage.so(grey_from+0xfb)[0x7f81aa1dc3bc]
/home/samm/src/cf-64/builddir/librimage.so(_ZN14CRIBinarizator15KronrodGreyFromEPh+0x2c)[0x7f81aa1e223e]
/home/samm/src/cf-64/builddir/librimage.so(_ZN14CRIBinarizator14OnBinarizeLoopEv+0x1db)[0x7f81aa1e2933]
/home/samm/src/cf-64/builddir/librimage.so(_ZN14CRIBinarizator13OnBinarizatorEv+0x2e)[0x7f81aa1e29f0]
/home/samm/src/cf-64/builddir/librimage.so(_ZN14CRIBinarizator8BinarizeE10CTBinarizej+0x7d)[0x7f81aa1e2fe5]
/home/samm/src/cf-64/builddir/librimage.so(_ZN10CRIControl8BinariseEPcS0_jj+0x149)[0x7f81aa1e43f9]
/home/samm/src/cf-64/builddir/librimage.so(RIMAGE_Binarise+0x4f)[0x7f81aa1e4b75]
/home/samm/src/cf-64/builddir/libpuma.so(_Z13BinariseImagev+0x18b)[0x7f81ac581fab]
/home/samm/src/cf-64/builddir/libpuma.so(_Z6LayoutPh+0xfa)[0x7f81ac57e1b6]
/home/samm/src/cf-64/builddir/libpuma.so(PUMA_XFinalRecognition+0x80)[0x7f81ac5812ca]
./cuneiform(main+0x2bc)[0x401b4a]
/lib/libc.so.6(__libc_start_main+0xf4)[0x7f81a4b181c4]
./cuneiform(__gxx_personality_v0+0xa1)[0x4013c9]
======= Memory map: ========
00400000-00403000 r-xp 00000000 08:05 1344519 ...

[Alex Samorukov (samm-os2)]

still crash on 86_64:
samm@samm-laptop:~/src/cf-64/builddir$ uname -a
Linux samm-laptop 2.6.24-19-generic #1 SMP Fri Jul 11 21:01:46 UTC 2008 x86_64 GNU/Linux
samm@samm-laptop:~/src/cf-64/builddir$ gcc -v
Using built-in specs.
Target: x86_64-linux-gnu
Configured with: ../src/configure -v --enable-languages=c,c++,fortran,objc,obj-c++,treelang --prefix=/usr --enable-shared --with-system-zlib --libexecdir=/usr/lib --without-included-gettext --enable-threads=posix --enable-nls --with-gxx-include-dir=/usr/include/c++/4.2 --program-suffix=-4.2 --enable-clocale=gnu --enable-libstdcxx-debug --enable-objc-gc --enable-mpfr --enable-checking=release --build=x86_64-linux-gnu --host=x86_64-linux-gnu --target=x86_64-linux-gnu
Thread model: posix
gcc version 4.2.3 (Ubuntu 4.2.3-2ubuntu7)

gdb ./cuneiform
samm@samm-laptop:~/src/cf-64/builddir$ gdb ./cuneiform
GNU gdb 6.8-debian
Copyright (C) 2008 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu"...

(gdb) run ../images/test.bmp
Starting program: /home/samm/src/cf-64/builddir/cuneiform ../images/test.bmp
Cuneiform for Linux 0.3.0
The image depth is 24 at this point.

Program received signal SIGSEGV, Segmentation fault.
0x00007fac8a5ccb2a in CTCGlobalHeader::GetHandle (this=0x0) at /home/samm/src/cf-64/cuneiform_src/Kern/cfio/sources/h/ctcbaseclasses.h:144
144 Handle GetHandle(void) { return hGlobalHandle; };

(gdb) bt
#0 0x00007fac8a5ccb2a in CTCGlobalHeader::GetHandle (this=0x0) at /home/samm/src/cf-64/cuneiform_src/Kern/cfio/sources/h/ctcbaseclasses.h:144
#1 0x00007fac8a5cdb86 in CTCMemoryList::DeleteItem (this=0x623850, hMemory=0x6d4290, wParam=0)
    at /home/samm/src/cf-64/cuneiform_src/Kern/cfio/sources/cpp/ctcmemory.cpp:222
#2 0x00007fac8a5cad48 in CTCControl::DeleteMemoryFromList (this=0x623850, hMemory=0x6d4290)
    at /home/samm/src/cf-64/cuneiform_src/Kern/cfio/sources/cpp/ctccontrol.cpp:740
#3 0x00007fac8a5caf1c in CTCControl::FreeMemory (this=0x623850, hMemory=0x6d4290, wFlag=0)
    at /home/samm/src/cf-64/cuneiform_src/Kern/cfio/sources/cpp/ctccontrol.cpp:758
#4 0x00007fac8a5caf5c in CTCControl::Free (this=0x623850, hMem=0x6d4290) at /home/samm/src/cf-64/cuneiform_src/Kern/cfio/sources/cpp/ctccontrol.cpp:568
#5 0x00007fac8a5cf322 in CFIO_FreeMemory (hMem=0x6d4290) at /home/samm/src/cf-64/cuneiform_src/Kern/cfio/sources/cpp/dll_main.cpp:534
#6 0x00007fac8b2acd23 in RIMAGEFree (mem=0x6d4290) at /home/samm/src/cf-64/cuneiform_src/Kern/rimage/sources/main/crimemory.cpp:183
#7 0x00007fac8b2a98ae in memory_free () at /home/samm/src/cf-64/cuneiform_src/Kern/rimage/sources/main/kronrod/grey-wnd.c:2179
#8 0x00007fac8b2a43bc in grey_from (pKuda=0x6bbbf0 "") at /home/samm/src/cf-64/cuneiform_src/Kern/rimage/sources/main/kronrod/grey-wnd.c:596
#9 0x00007fac8b2aa23e in CRIBinarizator::KronrodGreyFrom (this=0x6d3c70, pGFrom=0x6bbbf0 "")
    at /home/samm/src/cf-64/cuneiform_src/Kern/rimage...

[Jussi Pakkanen (jpakkane)]

I seemed to have pushed the patch to the cf-64 branch by accident. It should have been pushed to trunk. I have fixed this now.

The current state seems to be the following:

Works: all 32 bit platforms: Linux, FreeBSD and OS X.

Does not work: amd64, which crashes on the memory deallocation thingy as described on the previous comment.

Once I fix the crashing bug, I'll probably release a bug fix version 0.3.1.

[Jussi Pakkanen (jpakkane)]

I have pushed a fix to trunk. Please check whether it works for you.

[Alex Samorukov (samm-os2)]

no, its not,but error is different.

samm@samm-laptop:~/src/cuneiform-linux/builddir$ ./cuneiform ../images/test.bmp
Cuneiform for Linux 0.3.0
The image depth is 24 at this point.
Warning: RSL said that the lines do not have to withdraw.
Segmentation fault

samm@samm-laptop:~/src/cuneiform-linux/builddir$ gdb ./cuneiform
GNU gdb 6.8-debian
Copyright (C) 2008 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu"...
(gdb) run ../images/test.bmp
Starting program: /home/samm/src/cuneiform-linux/builddir/cuneiform ../images/test.bmp
Cuneiform for Linux 0.3.0
The image depth is 24 at this point.
Warning: RSL said that the lines do not have to withdraw.

Program received signal SIGSEGV, Segmentation fault.
0x00007fd48d261db0 in Lines2Raster (linerep=0x7fd489af003a, size=140, w=26,
    h=30, rec=0x7fff995c9970)
    at /home/samm/src/cuneiform-linux/cuneiform_src/Kern/pass2/src/p2_tools.c:149
149 for(line=linerep,len=0; len<size && line->lth; len+=line->lth,line=(CCOM_lnhead *)((int)line+line->lth))

(gdb) bt
#0 0x00007fd48d261db0 in Lines2Raster (linerep=0x7fd489af003a, size=140,
    w=26, h=30, rec=0x7fff995c9970)
    at /home/samm/src/cuneiform-linux/cuneiform_src/Kern/pass2/src/p2_tools.c:149
#1 0x00007fd48d261e9d in p2_Comp2Raster (lt=142, lp=0x7fd489af0038 "\216",
    w=26, h=30, rec=0x7fff995c9970)
    at /home/samm/src/cuneiform-linux/cuneiform_src/Kern/pass2/src/p2_tools.c:201
#2 0x00007fd48d260d7d in p2_RecogCompLp (sizeLp=142,
    lp=0x7fd489af0038 "\216", w=26, h=30, col=97, row=11, vers=0x7fff995ca9e0)
    at /home/samm/src/cuneiform-linux/cuneiform_src/Kern/pass2/src/p2_proc.c:3178
#3 0x00007fd48d78c951 in estletter (BC=0x7fd489b31010, GL=0x0)
    at /home/samm/src/cuneiform-linux/cuneiform_src/Kern/rstr/src/rstr_p2.c:802
#4 0x00007fd48d730e63 in dmBOX (BC=0x7fd489b31010, GL=0x7fff995cafb0)
    at /home/samm/src/cuneiform-linux/cuneiform_src/Kern/rstr/src/dmbox.c:898
#5 0x00007fd48d7203c7 in rec_own (B1=0x7fd489b31010, GL=0x7fff995cafb0,
    bnd1=170, bnd2=100, dupf=0, disd=0x7fff995cad22)
    at /home/samm/src/cuneiform-linux/cuneiform_src/Kern/rstr/src/dm1.c:687
#6 0x00007fd48d722710 in estcomp (user=97 'a', B1=0x7fd489b31010,
    save=0x7fff995cb350, trs=220, bnd1=170, bnd2=100, GL=0x7fff995cafb0,
    cpos1=0x7fff995cb3e0, cpos2=0x7fff995cb3e0, pnt1=0 '\0', pnt2=0 '\0',
    iv=0 '\0')
---Type <return> to continue, or q <return> to quit---
    at /home/samm/src/cuneiform-linux/cuneiform_src/Kern/rstr/src/dm1.c:1268
#7 0x00007fd48d72347f in make_all_cuts ()
    at /home/samm/src/cuneiform-linux/cuneiform_src/Kern/rstr/src/dm1.c:1591
#8 0x00007fd48d78cfad in p2_RecogCutGlu (first=0xae6980, last=0xae64a0,
    lineFon=0xae6310, p2glob=0x7fd48d468e60)
    at /home/samm/src/cuneiform-linux/cuneiform_src/Kern/rstr/src/rstr_p2.c:909
#9 0x00007fd48d260f02 in RecogWord (first=0xae6980, last=0xae64a0,
    lineFon=0xae6310, fontinfo=0x7fff995cb850, nNakl...

[Jussi Pakkanen (jpakkane)]

I cannot replicate this, but try the following and tell me if it fixes it for you:

Change the end of the line

(CCOM_lnhead *)((int)line+line->lth))

to

(CCOM_lnhead *)((intptr_t)line+line->lth))

[Alex Samorukov (samm-os2)]

Great news, it finally works!

samm@samm-laptop:~/src/cuneiform-linux/builddir$ ./cuneiform -l rus ../images/test.bmp -o /dev/stdout
Cuneiform for Linux 0.3.0
The image depth is 24 at this point.
Warning: RSL said that the lines do not have to withdraw.
Во время наполеоновского нашествия все дере~ рой Хомутовки, а также замечательный сад сгор~ Н. Б. Юсупов предпринимает большое строителы стороны сооружается «двухэтажный дом, что в с кульным «приделком» под руководством архитек ва, а с западной стороны в том же году Е. Тюрины вый трехэтажный дом, причем интерьеры оформл~ лов.
Здание предназначается для картинной гале и театра, о чем свидетельствуют «сметы и щеты пс а также своеобразная внутренняя планировка пс
После смерти Н. Б. Юсупова его сын и насле~ начинает дело о продаже домов по четной сторо~ Попечительному совету заведений общественногс 1839 году дома переходят в казну. Здесь устраи дом, «куда полиция приводила задержанных н; и бродяг».

[Jussi Pakkanen (jpakkane)]

Fixed it is, then.

[Kuzemko Aleksandr (kuzemkoa-rambler)]

Some bug report.
When I recognize my test image (0096.tif) with English language it recognize it without segfaults (but ukrainian text text is show as english letters).
When I recognize my test image (0096.tif) with -l rus or -l ukr options it recognize it with segfaults.
When I recognize my test image (0096.tif) with -l ruseng options it recognize it without segfaults.
But when I use another test image (0005.tif)I can recognize it fine (with proper language and without segfaults )

[Jussi Pakkanen (jpakkane)]

Please file a new bug report as this one is closed and your error is clearly different than the one discussed here. This ensures that your bug does not get lost.