Basenji

crashes while indexing volume in Ubuntu 10.10

Bug #658781 reported by Mitch Hayes
14
This bug affects 2 people
Affects Status Importance Assigned to Milestone
Basenji
Fix Released
Undecided
Patrick Ulbrich
Basenji 0.9

Bug Description

I successfully added two Kingston flash drives (2GB and 4GB). I was indexing another 4GB drive when the program crashed. I tried two subsequent times and basenji crashed again. Background: This is a FAT32 formatted drive which contains a slax install, a large number of portable apps (windows) and various data files. I ran it from the terminal the final time:

Here is the last bit of output:

/tmp/tmp.TKWwS6Ttwa: clr_important field in bitmap should be zero
/tmp/tmp.TKWwS6Ttwa: clr_important field in bitmap should be zero
XMP Toolkit error 202: XML namespace required for all elements and attributes
Warning: Failed to decode XMP metadata.
wrestool: /media/MITCH/PortableApps/ThunderbirdPortable/App/Thunderbird/nsldap32v60.dll: file contains no resources
wrestool: /media/MITCH/PortableApps/ThunderbirdPortable/App/Thunderbird/nsldappr32v60.dll: file contains no resources
wrestool: /media/MITCH/PortableApps/ThunderbirdPortable/App/Thunderbird/nsldif32v60.dll: file contains no resources
XMP Toolkit error 202: XML namespace required for all elements and attributes
Warning: Failed to decode XMP metadata.
XMP Toolkit error 202: XML namespace required for all elements and attributes
Warning: Failed to decode XMP metadata.
XMP Toolkit error 203: Top level typedNode not allowed
Warning: Failed to decode XMP metadata.
XMP Toolkit error 202: XML namespace required for all elements and attributes
Warning: Failed to decode XMP metadata.
XMP Toolkit error 203: Mismatched top level rdf:about values
Warning: Failed to decode XMP metadata.
/tmp/tmp.f1nomOhFRh: clr_important field in bitmap should be zero
/tmp/tmp.f1nomOhFRh: clr_important field in bitmap should be zero
/tmp/tmp.f1nomOhFRh: clr_important field in bitmap should be zero
/tmp/tmp.f1nomOhFRh: clr_important field in bitmap should be zero
/tmp/tmp.f1nomOhFRh: clr_important field in bitmap should be zero
/tmp/tmp.f1nomOhFRh: clr_important field in bitmap should be zero
/tmp/tmp.f1nomOhFRh: clr_important field in bitmap should be zero
/tmp/tmp.f1nomOhFRh: clr_important field in bitmap should be zero
/tmp/tmp.f1nomOhFRh: clr_important field in bitmap should be zero
/tmp/tmp.f1nomOhFRh: clr_important field in bitmap should be zero
wrestool: /media/MITCH/TrueCrypt/truecrypt-x64.sys: premature end
wrestool: /media/MITCH/boot/syslinux/syslinux.exe: file contains no resources
Stacktrace:

  at (wrapper managed-to-native) LibExtractor.Extractor.EXTRACTOR_getKeywords (intptr,string) <0x00004>
  at (wrapper managed-to-native) LibExtractor.Extractor.EXTRACTOR_getKeywords (intptr,string) <0x00004>
  at LibExtractor.Extractor.GetKeywords (string) <0x00044>
  at VolumeDB.VolumeScanner.FilesystemVolumeScanner.RecursiveDump (string,System.IO.DirectoryInfo,VolumeDB.BufferedVolumeItemWriter,long) <0x006be>
  at VolumeDB.VolumeScanner.FilesystemVolumeScanner.RecursiveDump (string,System.IO.DirectoryInfo,VolumeDB.BufferedVolumeItemWriter,long) <0x00ecb>
  at VolumeDB.VolumeScanner.FilesystemVolumeScanner.RecursiveDump (string,System.IO.DirectoryInfo,VolumeDB.BufferedVolumeItemWriter,long) <0x00ecb>
  at VolumeDB.VolumeScanner.FilesystemVolumeScanner.ScanningThreadMain (Platform.Common.IO.DriveInfo,VolumeDB.FileSystemVolume,VolumeDB.BufferedVolumeItemWriter) <0x00163>
  at VolumeDB.VolumeScanner.AbstractVolumeScanner`3<object, object, object>.ScanningThread (Platform.Common.IO.DriveInfo,object,VolumeDB.BufferedVolumeItemWriter) <0x000a1>
  at (wrapper runtime-invoke) <Module>.runtime_invoke_void__this___object_object_object (object,intptr,intptr,intptr) <0x00051>

Native stacktrace:

 mono() [0x80d4d0b]
 mono() [0x810ffeb]
 [0x49b40c]
 /usr/lib/libextractor.so.1.1.1(EXTRACTOR_getKeywords+0x127) [0x1a6c257]
 [0x66d2a17]
 [0x66d28ad]
 [0x8b5985f]
 [0x8b5a06c]
 [0x8b5a06c]
 [0x8b57a54]
 [0x8b56e8a]
 [0x8b56d92]
 mono() [0x8061328]
 mono(mono_runtime_invoke+0x40) [0x813c890]
 mono(mono_runtime_invoke_array+0x2a4) [0x81421a4]
 mono() [0x814266e]
 mono() [0x81d2341]
 mono() [0x81d2858]
 mono() [0x81b11db]
 mono() [0x81e8e4e]
 mono() [0x8214f85]
 /lib/libpthread.so.0(+0x5cc9) [0x5d5cc9]
 /lib/libc.so.6(clone+0x5e) [0x2af6ae]

Debug info from gdb:

ptrace: Operation not permitted.

=================================================================
Got a SIGSEGV while executing native code. This usually indicates
a fatal error in the mono runtime or one of the native libraries
used by your application.
=================================================================

Aborted

Tags: crash ubuntu
Revision history for this message
Patrick Ulbrich (pulb) wrote :

Some of your .exe files appear to have invalid metadata, causing the ole2 plugin of the libextractor library to crash.
Please try the solution posted here: https://bugs.launchpad.net/basenji/+bug/656391 and report if it fixes the crash.

Changed in basenji:
assignee: nobody → Patrick Ulbrich (pulb)
Revision history for this message
Mitch Hayes (mitch-mitchellhayes) wrote :

I added ole2
to ~/.config/Basenji/settings

...
ScannerExtractionBlacklist = ole2
...

I still get the error.

Revision history for this message
Mitch Hayes (mitch-mitchellhayes) wrote :

Actually, the stacktrace is a bit different so I'll post it:

Native stacktrace:

 mono() [0x80d4d0b]
 mono() [0x810ffeb]
 [0x48140c]
 /usr/lib/libextractor.so.1.1.1(EXTRACTOR_getKeywords+0x127) [0x1693257]
 [0x26b5d7f]
 [0x26b5c85]
 [0x26b0cc7]
 [0x26b14d4]
 [0x26b14d4]
 [0x26af3e4]
 [0x26ae2fa]
 [0x26ae202]
 mono() [0x8061328]
 mono(mono_runtime_invoke+0x40) [0x813c890]
 mono(mono_runtime_invoke_array+0x2a4) [0x81421a4]
 mono() [0x814266e]
 mono() [0x81d2341]
 mono() [0x81d2858]
 mono() [0x81b11db]
 mono() [0x81e8e4e]
 mono() [0x8214f85]
 /lib/libpthread.so.0(+0x5cc9) [0x6bccc9]
 /lib/libc.so.6(clone+0x5e) [0x29f6ae]

Debug info from gdb:

ptrace: Operation not permitted.

=================================================================
Got a SIGSEGV while executing native code. This usually indicates
a fatal error in the mono runtime or one of the native libraries
used by your application.
=================================================================

Revision history for this message
Patrick Ulbrich (pulb) wrote :

A new build with debugging capabilities should be available in the daily ppa by tomorrow. it will be able to print out currently processed files, so that the file responsible for the crash can be determined easily.

Revision history for this message
Patrick Ulbrich (pulb) wrote :

A new build is now available in the daily PPA (https://edge.launchpad.net/~pulb/+archive/basenji-daily) and is considered stable.
Please run "basenji --debug" and post the last indexed file here.

Revision history for this message
Sheldor (tobias-e-gmx) wrote :

Same problem here with Basenji 0.7.2.0, Ubuntu 10.10 and a 500gb external HDD.

The last indexed files are:

[VolumeDB DBG]: Indexing file '/media/500 GB extren/Other/Music/Scrubs/Scrubs Season 5 Soundtrack/57 The Turtles- So Happy Together.mp3'
[VolumeDB DBG]: Indexing file '/media/500 GB extren/Other/Music/Scrubs/Scrubs Season 5 Soundtrack/58 The Weepies- World Spins Madly On.mp3'
[VolumeDB DBG]: Indexing file '/media/500 GB extren/Other/Music/Scrubs/Scrubs Season 5 Soundtrack/59 ToTo- Africa.mp3'
[VolumeDB DBG]: Indexing file '/media/500 GB extren/Other/Music/Scrubs/Scrubs Season 5 Soundtrack/60 Village People- Macho Man.mp3'
[VolumeDB DBG]: Indexing file '/media/500 GB extren/Other/Music/Scrubs/Scrubs Season 5 Soundtrack/61 Weekend Excursion- Moving On.mp3'
[VolumeDB DBG]: Indexing file '/media/500 GB extren/Other/Music/Scrubs/Scrubs Season 5 Soundtrack/cover.jpg'
[VolumeDB DBG]: Indexing file '/media/500 GB extren/Other/Music/Scrubs/Scrubs Season 6 Soundtrack/00 Matt Nathanson - I Saw.wma'
Segmentation fault

After this the program just closes.

Revision history for this message
Will Price (will-price94) wrote :

I tried to add my cdrom drive and it crashes:
(run with --debug)

[Basenji DBG]: Basenji 0.7.2.0
[Basenji DBG]: Used runtime: /usr/lib/mono/2.0
[VolumeDB DBG]: _SearchVolume() executes query: 'SELECT * FROM Volumes;'
[Basenji DBG]: selected drive '/dev/sr0'
[VolumeDB DBG]: Indexing file '/media/OFFICE2003/autorun.inf'
Stacktrace:

  at (wrapper managed-to-native) LibExtractor.Extractor.EXTRACTOR_getKeywords (intptr,string) <0x00004>
  at (wrapper managed-to-native) LibExtractor.Extractor.EXTRACTOR_getKeywords (intptr,string) <0x00004>
  at LibExtractor.Extractor.GetKeywords (string) <0x00044>
  at VolumeDB.VolumeScanner.FilesystemVolumeScanner.RecursiveDump (string,System.IO.DirectoryInfo,VolumeDB.BufferedVolumeItemWriter,long) <0x0071b>
  at VolumeDB.VolumeScanner.FilesystemVolumeScanner.ScanningThreadMain (Platform.Common.IO.DriveInfo,VolumeDB.FileSystemVolume,VolumeDB.BufferedVolumeItemWriter) <0x00163>
  at VolumeDB.VolumeScanner.AbstractVolumeScanner`3<object, object, object>.ScanningThread (Platform.Common.IO.DriveInfo,object,VolumeDB.BufferedVolumeItemWriter) <0x000a1>
  at (wrapper runtime-invoke) <Module>.runtime_invoke_void__this___object_object_object (object,intptr,intptr,intptr) <0x00051>

Native stacktrace:

 mono() [0x80d4d0b]
 mono() [0x810ffeb]
 [0xb76fb40c]
 /usr/lib/libextractor.so.1.1.1(EXTRACTOR_getKeywords+0x127) [0xb1e4a257]
 [0xb16cfbd7]
 [0xb16cfa1d]
 [0xb16ca49c]
 [0xb16c936c]
 [0xb16c87a2]
 [0xb16c84ba]
 mono() [0x8061328]
 mono(mono_runtime_invoke+0x40) [0x813c890]
 mono(mono_runtime_invoke_array+0x2a4) [0x81421a4]
 mono() [0x814266e]
 mono() [0x81d2341]
 mono() [0x81d2858]
 mono() [0x81b11db]
 mono() [0x81e8e4e]
 mono() [0x8214f85]
 /lib/libpthread.so.0(+0x5cc9) [0xb75f0cc9]
 /lib/libc.so.6(clone+0x5e) [0xb75376ae]

Debug info from gdb:

ptrace: Operation not permitted.

=================================================================
Got a SIGSEGV while executing native code. This usually indicates
a fatal error in the mono runtime or one of the native libraries
used by your application.
=================================================================

Aborted

Revision history for this message
Patrick Ulbrich (pulb) wrote :

rocker9455, sheldor:
Please close Basenji first (important) and then add ole2,asf to the extraction blacklist as shown in comment #2.
Please let me know if it fixes the crash. Unfortunately some libextractor plugins are unstable and I didn't find the time to migrate to new plugin api yet...

Revision history for this message
Patrick Ulbrich (pulb) wrote :

Do you guys run 32 or 64 bit systems?

Revision history for this message
Sheldor (tobias-e-gmx) wrote :

hey this did the trick, thank you, i tried adding just ole2 before, but this didn't fixte it, but with ole2,asf it works now.
I am using 64bit.

Revision history for this message
Patrick Ulbrich (pulb) wrote :

rocker9455, Mitch Hayes: Does it always crash on the same file?
rocker9455: can you attach your autrun.inf file?

Revision history for this message
Will Price (will-price94) wrote :

Adding asf to the blocklist fixed it! Cheers.
For the record here is the autorun.inf file:
[AutoRun]
OPEN=setup.exe
ICON=SETUP.exe,0

Patrick Ulbrich (pulb)
Changed in basenji:
milestone: none → 0.9
Patrick Ulbrich (pulb)
Changed in basenji:
status: New → Fix Committed
Patrick Ulbrich (pulb)
Changed in basenji:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.