Call Traces found while executing fsracer tests

Bug #1274479 reported by Harini M Patgar
12
This bug affects 1 person
Affects Status Importance Assigned to Milestone
linux (Ubuntu)
Fix Released
Medium
Andy Whitcroft

Bug Description

Host machine : 9.3.189.114(roo/.pasroot)

run "virsh console harini" to get the console access

Description:
-----------------

fs racer test from ltp test suite was being run on ubuntu alpha 1 guest. After couple of hours of testing got some errors on the command prompt along with call trace in dmesg.

Location for fsracer test : /root/ltp-full-20140115/testcases/kernel/fs/racer/

Ran :

 nohup /root/ltp-full-20140115/testcases/kernel/fs/racer/fs_racer.sh -t 10000000 &

=========================================================================================
On command prompt:
---------------------------------
root@ubuntu:~# [88680.412397] INFO: task ln:16792 blocked for more than 120 seconds.
[88680.412527] Not tainted 3.13.0-5-generic #20-Ubuntu
[88680.412595] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[88680.412992] INFO: task mkdir:16801 blocked for more than 120 seconds.
[88680.413079] Not tainted 3.13.0-5-generic #20-Ubuntu
[88680.413145] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[88680.413290] INFO: task dd:17882 blocked for more than 120 seconds.
[88680.413401] Not tainted 3.13.0-5-generic #20-Ubuntu
[88680.413468] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[88680.413625] INFO: task fs_racer_file_c:29630 blocked for more than 120 seconds.
[88680.413726] Not tainted 3.13.0-5-generic #20-Ubuntu
[88680.413793] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[88680.414025] INFO: task fs_racer_file_c:29631 blocked for more than 120 seconds.
[88680.414127] Not tainted 3.13.0-5-generic #20-Ubuntu
[88680.414196] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[88680.414341] INFO: task ln:29635 blocked for more than 120 seconds.
[88680.414425] Not tainted 3.13.0-5-generic #20-Ubuntu
[88680.414491] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[88680.414632] INFO: task ln:29637 blocked for more than 120 seconds.
[88680.414715] Not tainted 3.13.0-5-generic #20-Ubuntu
[88680.414782] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[88680.415139] INFO: task fs_racer_file_c:29641 blocked for more than 120 seconds.
[88680.415243] Not tainted 3.13.0-5-generic #20-Ubuntu
[88680.415311] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[88680.415456] INFO: task mkdir:29646 blocked for more than 120 seconds.
[88680.415539] Not tainted 3.13.0-5-generic #20-Ubuntu
[88680.415605] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[88680.415748] INFO: task mkdir:29647 blocked for more than 120 seconds.
[88680.415835] Not tainted 3.13.0-5-generic #20-Ubuntu
[88680.415983] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.

==============================================================================

Call trace:
-------------

[88680.412397] INFO: task ln:16792 blocked for more than 120 seconds.
[88680.412527] Not tainted 3.13.0-5-generic #20-Ubuntu
[88680.412595] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[88680.412696] ln D 00003fff9b89ea68 0 16792 25258 0x00040000
[88680.412703] Call Trace:
[88680.412732] [c000000c76ad74b0] [c000000c765eeae0] 0xc000000c765eeae0 (unreliable)
[88680.412852] [c000000c76ad7680] [c0000000000154c0] .__switch_to+0x1d0/0x340
[88680.412917] [c000000c76ad7730] [c000000000abd968] .__schedule+0x368/0x8c0
[88680.412922] [c000000c76ad79b0] [c000000000abe498] .schedule_preempt_disabled+0x18/0x30
[88680.412926] [c000000c76ad7a20] [c000000000ac078c] .__mutex_lock_slowpath+0x18c/0x2c0
[88680.412930] [c000000c76ad7af0] [c000000000ac0924] .mutex_lock+0x64/0x68
[88680.412975] [c000000c76ad7b70] [c0000000002303e0] .kern_path_create+0xb0/0x1e0
[88680.412979] [c000000c76ad7cd0] [c000000000232a48] .user_path_create+0x68/0xa0
[88680.412983] [c000000c76ad7d60] [c000000000233c88] .SyS_symlinkat+0x78/0x140
[88680.412989] [c000000c76ad7e30] [c000000000009e58] syscall_exit+0x0/0x98

===================================================================================

File system status at that moment
--------------------------------------
root@ubuntu:~# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/sda 50G 18G 29G 39% /
none 4.0K 0 4.0K 0% /sys/fs/cgroup
devtmpfs 25G 8.0K 25G 1% /dev
none 5.0G 216K 5.0G 1% /run
none 5.0M 0 5.0M 0% /run/lock
none 25G 0 25G 0% /run/shm
none 100M 0 100M 0% /run/user
root@ubuntu:~#

root@ubuntu:~# uname -a
Linux ubuntu 3.13.0-5-generic #20-Ubuntu SMP Mon Jan 20 20:03:57 UTC 2014 ppc64le ppc64le ppc64le GNU/Linux
root@ubuntu:~#
---
ApportVersion: 2.13.2-0ubuntu2
Architecture: ppc64el
CRDA: Error: command ['iw', 'reg', 'get'] failed with exit code 1: nl80211 not found.
DistroRelease: Ubuntu 14.04
IwConfig:
 lo no wireless extensions.

 tunl0 no wireless extensions.

 eth0 no wireless extensions.
Lsusb: Bus 001 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
Package: linux (not installed)
ProcEnviron:
 TERM=vt102
 PATH=(custom, no user)
 LANG=en_US.UTF-8
 SHELL=/bin/bash
ProcFB:

ProcKernelCmdLine: root=/dev/sda
ProcModules:
 dm_crypt 29694 0 - Live 0xd000000006b36000
 pseries_rng 3309 0 - Live 0xd000000006a7f000
 rtc_generic 2711 0 - Live 0xd000000006a33000
ProcVersionSignature: Ubuntu 3.13.0-5.20-generic 3.13.0
RelatedPackageVersions:
 linux-restricted-modules-3.13.0-5-generic N/A
 linux-backports-modules-3.13.0-5-generic N/A
 linux-firmware 1.122
RfKill: Error: [Errno 2] No such file or directory
Tags: trusty uec-images
Uname: Linux 3.13.0-5-generic ppc64le
UpgradeStatus: No upgrade log present (probably fresh install)
UserGroups:

_MarkForUpload: True
---
ApportVersion: 2.13.2-0ubuntu2
Architecture: ppc64el
CRDA: Error: command ['iw', 'reg', 'get'] failed with exit code 1: nl80211 not found.
DistroRelease: Ubuntu 14.04
IwConfig:
 lo no wireless extensions.

 tunl0 no wireless extensions.

 eth0 no wireless extensions.
Lsusb: Bus 001 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
Package: linux (not installed)
ProcEnviron:
 TERM=vt102
 PATH=(custom, no user)
 LANG=en_US.UTF-8
 SHELL=/bin/bash
ProcFB:

ProcKernelCmdLine: root=/dev/sda
ProcModules:
 dm_crypt 29694 0 - Live 0xd000000006b36000
 pseries_rng 3309 0 - Live 0xd000000006a7f000
 rtc_generic 2711 0 - Live 0xd000000006a33000
ProcVersionSignature: Ubuntu 3.13.0-5.20-generic 3.13.0
RelatedPackageVersions:
 linux-restricted-modules-3.13.0-5-generic N/A
 linux-backports-modules-3.13.0-5-generic N/A
 linux-firmware 1.122
RfKill: Error: [Errno 2] No such file or directory
Tags: trusty uec-images
Uname: Linux 3.13.0-5-generic ppc64le
UpgradeStatus: No upgrade log present (probably fresh install)
UserGroups:

_MarkForUpload: True

Revision history for this message
Brad Figg (brad-figg) wrote : Missing required logs.

This bug is missing log files that will aid in diagnosing the problem. From a terminal window please run:

apport-collect 1274479

and then change the status of the bug to 'Confirmed'.

If, due to the nature of the issue you have encountered, you are unable to run this command, please add a comment stating that fact and change the bug status to 'Confirmed'.

This change has been made by an automated script, maintained by the Ubuntu Kernel Team.

Changed in linux (Ubuntu):
status: New → Incomplete
tags: added: trusty
Changed in linux (Ubuntu):
importance: Undecided → Medium
tags: added: kernel-da-key
Changed in linux (Ubuntu):
status: Incomplete → Confirmed
Revision history for this message
Harini M Patgar (hapatgar) wrote : AlsaInfo.txt

apport information

tags: added: apport-collected uec-images
description: updated
Revision history for this message
Harini M Patgar (hapatgar) wrote : AudioDevicesInUse.txt

apport information

Revision history for this message
Harini M Patgar (hapatgar) wrote : BootDmesg.txt

apport information

Revision history for this message
Harini M Patgar (hapatgar) wrote : CurrentDmesg.txt

apport information

Revision history for this message
Harini M Patgar (hapatgar) wrote : Lspci.txt

apport information

Revision history for this message
Harini M Patgar (hapatgar) wrote : ProcCpuinfo.txt

apport information

Revision history for this message
Harini M Patgar (hapatgar) wrote : ProcInterrupts.txt

apport information

Revision history for this message
Harini M Patgar (hapatgar) wrote :

One information that I missed adding is before I saw Call trace i.e around 5 -1 01 min before it I had run stressapptest .

I found the below message in dmesg after stressapptest
stressapptest[6384]: unhandled signal 11 at 000000fe27f0f438 nip 0000000010014440 lr 0000000010014424 code 30001

ran : zzuf stressapptest -s 20 100
and fsracer tests was in background.

Revision history for this message
Harini M Patgar (hapatgar) wrote : AlsaInfo.txt

apport information

description: updated
Revision history for this message
Harini M Patgar (hapatgar) wrote : AudioDevicesInUse.txt

apport information

Revision history for this message
Harini M Patgar (hapatgar) wrote : BootDmesg.txt

apport information

Revision history for this message
Harini M Patgar (hapatgar) wrote : CurrentDmesg.txt

apport information

Revision history for this message
Harini M Patgar (hapatgar) wrote : Lspci.txt

apport information

Revision history for this message
Harini M Patgar (hapatgar) wrote : ProcCpuinfo.txt

apport information

Revision history for this message
Harini M Patgar (hapatgar) wrote : ProcInterrupts.txt

apport information

Revision history for this message
Harini M Patgar (hapatgar) wrote : UdevDb.txt

apport information

Revision history for this message
Harini M Patgar (hapatgar) wrote : UdevLog.txt

apport information

Revision history for this message
Harini M Patgar (hapatgar) wrote : WifiSyslog.txt

apport information

information type: Public → Private Security
information type: Private Security → Public
Changed in linux (Ubuntu):
assignee: nobody → Andy Whitcroft (apw)
Revision history for this message
Abdul (abdhalee) wrote :

Hello,

On beta1 ( ubuntu 3.13.0-14-generic), the problem is no more reproducible.

I repeated the similar test scenarios + a few new test scenarios. but no more call traces are seen in dmesg

fsracer and stressaptest are running fine in parallel with no issues.

we can close this bug for now and can reopen if we see the traces again in future.

Thanks for all your support

Revision history for this message
Kalpana S Shetty (kalshett) wrote :

We can close this bug; not seen with latest build.

Revision history for this message
Andy Whitcroft (apw) wrote :

As per comment #21 closing this one as fixed.

Changed in linux (Ubuntu):
status: Confirmed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.