openjdk-6 SIGSEGV when web crawling using apache-nutch-1.2

[David Dombrowsky]

The following fetch command will eventually fail every time:

bin/nutch fetch crawl/segments/20101102144948 -threads 50

#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV (0xb) at pc=0x00007fc75fab2066, pid=29840, tid=140492972836624
#
# JRE version: 6.0_18-b18
# Java VM: OpenJDK 64-Bit Server VM (16.0-b13 mixed mode linux-amd64 )
# Derivative: IcedTea6 1.8.2
# Distribution: Ubuntu 10.04.1 LTS, package 6b18-1.8.2-4ubuntu2
# Problematic frame:
# V [libjvm.so+0x5da066]
#
# An error report file with more information is saved as:
# /home/david/apache-nutch-1.2/hs_err_pid29840.log
#

I'm not sure what to do about it, but it makes it impossible to run the nutch web crawler. I will use this note in the Release Notes for Lucid (10.04) to try the Sun-released java:

https://wiki.ubuntu.com/LucidLynx/ReleaseNotes#Sun%20Java%20moved%20to%20the%20Partner%20repository

[David Dombrowsky (davek)]

FYI: switching to sun-released Java seemed to do the trick. I've been running the Apache Nutch crawler for a week now and it has not crashed since I made the change.