| 2013-04-16 21:34:25 |
Jon Tai |
bug |
|
|
added bug |
| 2013-04-16 21:34:25 |
Jon Tai |
attachment added |
|
Stack trace when rsyslog is hung https://bugs.launchpad.net/bugs/1169740/+attachment/3645960/+files/stack-trace.txt |
|
| 2013-04-16 21:40:36 |
Launchpad Janitor |
rsyslog (Ubuntu): status |
New |
Confirmed |
|
| 2013-04-16 21:42:23 |
Pierre Carrier |
tags |
|
precise |
|
| 2013-04-16 21:43:47 |
Pierre Carrier |
tags |
precise |
patch precise |
|
| 2013-04-16 21:46:26 |
Pierre Carrier |
attachment added |
|
rsyslog-startup-deadlock.patch https://bugs.launchpad.net/ubuntu/+source/rsyslog/+bug/1169740/+attachment/3645970/+files/rsyslog-startup-deadlock.patch |
|
| 2013-04-17 00:18:42 |
Ubuntu Foundations Team Bug Bot |
bug |
|
|
added subscriber Ubuntu Review Team |
| 2013-04-17 04:58:47 |
Adam Stokes |
bug |
|
|
added subscriber Adam Stokes |
| 2013-04-17 04:59:09 |
Adam Stokes |
nominated for series |
|
Ubuntu Precise |
|
| 2013-04-17 04:59:09 |
Adam Stokes |
nominated for series |
|
Ubuntu Quantal |
|
| 2013-04-17 04:59:09 |
Adam Stokes |
nominated for series |
|
Ubuntu Raring |
|
| 2013-04-17 08:08:40 |
Colin Watson |
bug task added |
|
rsyslog (Ubuntu Precise) |
|
| 2013-04-17 08:08:52 |
Colin Watson |
bug task added |
|
rsyslog (Ubuntu Quantal) |
|
| 2013-04-17 08:09:02 |
Colin Watson |
bug task added |
|
rsyslog (Ubuntu Raring) |
|
| 2013-04-18 00:44:04 |
Adam Stokes |
attachment added |
|
rsyslog_5.8.6-1ubuntu8.2.precise.debdiff https://bugs.launchpad.net/ubuntu/+source/rsyslog/+bug/1169740/+attachment/3646944/+files/rsyslog_5.8.6-1ubuntu8.2.precise.debdiff |
|
| 2013-04-18 00:44:29 |
Adam Stokes |
attachment added |
|
rsyslog_5.8.11-2ubuntu1.1.raring.debdiff https://bugs.launchpad.net/ubuntu/+source/rsyslog/+bug/1169740/+attachment/3646945/+files/rsyslog_5.8.11-2ubuntu1.1.raring.debdiff |
|
| 2013-04-18 00:44:52 |
Adam Stokes |
attachment added |
|
rsyslog_5.8.6-1ubuntu9.2.quantal.debdiff https://bugs.launchpad.net/ubuntu/+source/rsyslog/+bug/1169740/+attachment/3646946/+files/rsyslog_5.8.6-1ubuntu9.2.quantal.debdiff |
|
| 2013-04-18 00:48:05 |
Adam Stokes |
description |
We have rsyslog configured to listen for forwarded logs on TCP and UDP, and to forward logs on to a central log host. On a number of occasions we have observed rsyslog in a hung state on our production machines -- not fowarding logs and not writing them to disk locally. It doesn't happen all the time, so I believe there's some sort of race condition involved.
I've attached a stack trace taken when the process was hung. I believe the issue is the same as the one discussed here: http://www.gossamer-threads.com/lists/rsyslog/users/5873 There is a patch attached to that thread.
Ubuntu 12.04.1 LTS x86_64
rsyslog 5.8.6-1ubuntu8 |
[Impact]
We have rsyslog configured to listen for forwarded logs on TCP and UDP, and to forward logs on to a central log host. On a number of occasions we have observed rsyslog in a hung state on our production machines -- not fowarding logs and not writing them to disk locally. It doesn't happen all the time, so I believe there's some sort of race condition involved.
I've attached a stack trace taken when the process was hung. I believe the issue is the same as the one discussed here: http://www.gossamer-threads.com/lists/rsyslog/users/5873 There is a patch attached to that thread.
[Test Case]
<< TBD >>
[Regression Potential]
This is a fix for a deadlock issue it is pretty difficult to determine if fixing a race condition would impact anything else, however, testing from the community hasn't raised any concerns.
Ubuntu 12.04.1 LTS x86_64
rsyslog 5.8.6-1ubuntu8 |
|
| 2013-04-18 06:29:25 |
Jon Tai |
attachment added |
|
Restart rsyslog and check for new log messages https://bugs.launchpad.net/ubuntu/+source/rsyslog/+bug/1169740/+attachment/3647106/+files/lp-1169740.sh |
|
| 2013-04-18 13:09:46 |
Adam Stokes |
description |
[Impact]
We have rsyslog configured to listen for forwarded logs on TCP and UDP, and to forward logs on to a central log host. On a number of occasions we have observed rsyslog in a hung state on our production machines -- not fowarding logs and not writing them to disk locally. It doesn't happen all the time, so I believe there's some sort of race condition involved.
I've attached a stack trace taken when the process was hung. I believe the issue is the same as the one discussed here: http://www.gossamer-threads.com/lists/rsyslog/users/5873 There is a patch attached to that thread.
[Test Case]
<< TBD >>
[Regression Potential]
This is a fix for a deadlock issue it is pretty difficult to determine if fixing a race condition would impact anything else, however, testing from the community hasn't raised any concerns.
Ubuntu 12.04.1 LTS x86_64
rsyslog 5.8.6-1ubuntu8 |
[Impact]
We have rsyslog configured to listen for forwarded logs on TCP and UDP, and to forward logs on to a central log host. On a number of occasions we have observed rsyslog in a hung state on our production machines -- not fowarding logs and not writing them to disk locally. It doesn't happen all the time, so I believe there's some sort of race condition involved.
I've attached a stack trace taken when the process was hung. I believe the issue is the same as the one discussed here: http://www.gossamer-threads.com/lists/rsyslog/users/5873 There is a patch attached to that thread.
[Test Case]
#!/bin/sh
while [ 1 ]; do
service rsyslog stop
sleep 1
killall -9 rsyslogd > /dev/null 2>&1
service rsyslog start
sleep 1
nonce=$(date '+%s')
logger $nonce
if grep $nonce /var/log/hourly/* > /dev/null; then
echo found nonce $nonce
else
echo FAIL
exit 1
fi
done
[Regression Potential]
This is a fix for a deadlock issue it is pretty difficult to determine if fixing a race condition would impact anything else, however, testing from the community hasn't raised any concerns.
[Additional Info]
Ubuntu 12.04.1 LTS x86_64
rsyslog 5.8.6-1ubuntu8
Here is the (obscured) section of our rsyslog config that I believe is causing the issue.
$ActionQueueType LinkedList
$ActionQueueFileName central_syslog
$ActionQueueMaxDiskSpace 256M
$ActionResumeRetryCount -1
$ActionQueueSaveOnShutdown on
$ActionSendTCPRebindInterval 100000
*.* @@central_syslog.domain:514
$ModLoad imudp
$UDPServerRun 514
$ModLoad imtcp
$InputTCPServerRun 514 |
|
| 2013-04-18 13:09:56 |
Adam Stokes |
bug |
|
|
added subscriber Ubuntu Stable Release Updates Team |
| 2013-04-18 13:10:06 |
Adam Stokes |
bug |
|
|
added subscriber Ubuntu Sponsors Team |
| 2013-04-18 16:20:34 |
Launchpad Janitor |
branch linked |
|
lp:ubuntu/rsyslog |
|
| 2013-04-18 18:59:07 |
Launchpad Janitor |
branch linked |
|
lp:ubuntu/raring-proposed/rsyslog |
|
| 2013-04-18 19:46:17 |
Launchpad Janitor |
rsyslog (Ubuntu Raring): status |
Confirmed |
Fix Released |
|
| 2013-04-22 16:08:15 |
Michael Terry |
bug |
|
|
added subscriber Michael Terry |
| 2013-04-22 16:08:18 |
Michael Terry |
removed subscriber Ubuntu Sponsors Team |
|
|
|
| 2013-05-09 22:42:47 |
Brian Murray |
rsyslog (Ubuntu Precise): status |
New |
Fix Committed |
|
| 2013-05-09 22:42:51 |
Brian Murray |
bug |
|
|
added subscriber SRU Verification |
| 2013-05-09 22:42:54 |
Brian Murray |
tags |
patch precise |
patch precise verification-needed |
|
| 2013-05-09 22:45:36 |
Brian Murray |
rsyslog (Ubuntu Quantal): status |
New |
Fix Committed |
|
| 2013-05-09 23:09:53 |
Launchpad Janitor |
branch linked |
|
lp:ubuntu/precise-proposed/rsyslog |
|
| 2013-05-09 23:09:54 |
Launchpad Janitor |
branch linked |
|
lp:ubuntu/quantal-proposed/rsyslog |
|
| 2013-05-17 15:44:10 |
Louis Bouchard |
tags |
patch precise verification-needed |
patch precise verification-done |
|
| 2013-05-21 18:27:05 |
Dave Walker |
removed subscriber Ubuntu Stable Release Updates Team |
|
|
|
| 2013-05-21 18:27:13 |
Launchpad Janitor |
rsyslog (Ubuntu Precise): status |
Fix Committed |
Fix Released |
|
| 2013-05-21 18:27:19 |
Launchpad Janitor |
rsyslog (Ubuntu Quantal): status |
Fix Committed |
Fix Released |
|
