Hello all,

This problem still exists, and has become a much worse problem for us since moving to TPAC (not sure of any actual causation, but just an observation).

I have implemented both Bill's code fix and Jason's ejabberd config change, but the problem still happens.  It used to be maybe once a week, now it is multiple times per day.

I have attempted to get a Carp stacktrace using the kill -USR2 technique, and here is the result (apologies for the lack of formatting) using EG 2.3 and OSRF 2.1:

[Wed Mar 20 18:36:12 2013] [error] [client 153.106.144.241] egweb: Context Loader error: caught SIGUSR2! at /etc/apache2/startup.pl line 29\n\tStartUp::__ANON__('USR2')

called at /usr/local/share/perl/5.10.1/OpenSRF/Transport/SlimJabber/XMPPReader.pm line 177\n\teval {...}

called at /usr/local/share/perl/5.10.1/OpenSRF/Transport/SlimJabber/XMPPReader.pm line 177\n\tOpenSRF::Transport::SlimJabber::XMPPReader::set_block('IO::Socket::INET=GLOB(0x7f521399f1f8)')

called at /usr/local/share/perl/5.10.1/OpenSRF/Transport/SlimJabber/XMPPReader.pm line 202\n\tOpenSRF::Transport::SlimJabber::XMPPReader::wait('OpenSRF::Transport::SlimJabber::XMPPReader=HASH(0x7f521399f000)', 0)

called at /usr/local/share/perl/5.10.1/OpenSRF/Transport/SlimJabber/XMPPReader.pm line 257\n\tOpenSRF::Transport::SlimJabber::XMPPReader::wait_msg('OpenSRF::Transport::SlimJabber::XMPPReader=HASH(0x7f521399f000)', 0)

called at /usr/local/share/perl/5.10.1/OpenSRF/Transport/SlimJabber/Client.pm line 199\n\tOpenSRF::Transport::SlimJabber::Client::process('OpenSRF::Transport::PeerHandle=HASH(0x7f521387abd8)', 0)

called at /usr/local/share/perl/5.10.1/OpenSRF/Transport/SlimJabber/PeerConnection.pm line 84\n\tOpenSRF::Transport::SlimJabber::PeerConnection::process('OpenSRF::Transport::PeerHandle=HASH(0x7f521387abd8)', 0)

called at /usr/local/share/perl/5.10.1/OpenSRF/AppSession.pm line 790\n\tOpenSRF::AppSession::queue_wait('OpenSRF::AppSession=HASH(0x7f5214edfa10)', 0)

called at /usr/local/share/perl/5.10.1/OpenSRF/AppSession.pm line 911\n\tOpenSRF::AppRequest::complete('OpenSRF::AppRequest=HASH(0x7f5214c2d968)')

called at /usr/local/share/perl/5.10.1/OpenSRF/MultiSession.pm line 240\n\tOpenSRF::MultiSession::session_reap('OpenSRF::MultiSession=HASH(0x7f5214ded850)')

called at /usr/local/share/perl/5.10.1/OpenSRF/MultiSession.pm line 223\n\tOpenSRF::MultiSession::session_wait('OpenSRF::MultiSession=HASH(0x7f5214ded850)', 1)

called at /usr/local/share/perl/5.10.1/OpenILS/WWW/EGCatLoader/Util.pm line 306\n\tOpenILS::WWW::EGCatLoader::get_records_and_facets('OpenILS::WWW::EGCatLoader=HASH(0x7f5215202a58)', 'ARRAY(0x7f52152a31f0)', 'open-ils.search_9c4a6eb89e374cd0d19abe19d3fb4ac5_facets', 'HASH(0x7f5214def980)')

called at /usr/local/share/perl/5.10.1/OpenILS/WWW/EGCatLoader/Search.pm line 447\n\tOpenILS::WWW::EGCatLoader::load_rresults('OpenILS::WWW::EGCatLoader=HASH(0x7f5215202a58)')

called at /usr/local/share/perl/5.10.1/OpenILS/WWW/EGCatLoader.pm line 127\n\tOpenILS::WWW::EGCatLoader::load('OpenILS::WWW::EGCatLoader=HASH(0x7f5215202a58)')

called at /usr/local/share/perl/5.10.1/OpenILS/WWW/EGWeb.pm line 98\n\teval {...}

called at /usr/local/share/perl/5.10.1/OpenILS/WWW/EGWeb.pm line 96\n\tOpenILS::WWW::EGWeb::run_context_loader('Apache2::RequestRec=SCALAR(0x7f5213b9da38)', 'HASH(0x7f5214b9d278)')

called at /usr/local/share/perl/5.10.1/OpenILS/WWW/EGWeb.pm line 29\n\tOpenILS::WWW::EGWeb::handler('Apache2::RequestRec=SCALAR(0x7f5213b9da38)')

called at -e line 0\n\teval {...}

called at -e line 0\n


I will try to make sense of this if and when I find some free time, but my real hope is that others more familiar with the OpenSRF code might take a look and see what, if anything, jumps out at them.

Thanks!