Ubuntu server 14.04.1 LTS freeze

[Sami Pietila]

Ubuntu server 14.04 LTS freezes. Before the total freeze, kernel.log is showing messages like:

Nov 2 07:03:56 node1 kernel: [1941380.104003] BUG: soft lockup - CPU#0 stuck for 23s! [nfsd:1320]
Nov 2 07:03:56 node1 kernel: [1941380.104003] Modules linked in: btrfs raid6_pq xor ufs qnx4 hfsplus hfs minix ntfs msdos jfs xfs libcrc32c nfsd auth_rpcgss nfs_acl nfs lockd sunrpc fscache cirrus ttm drm_kms_helper drm crct10dif_pclmul crc32_pclmul ghash_clmulni_intel syscopyarea joydev sysfillrect aesni_intel i2c_piix4 sysimgblt aes_x86_64 lrw gf128mul mac_hid glue_helper serio_raw ablk_helper cryptd lp parport hid_generic usbhid hid psmouse floppy
Nov 2 07:03:56 node1 kernel: [1941380.104003] CPU: 0 PID: 1320 Comm: nfsd Not tainted 3.13.0-37-generic #64-Ubuntu
Nov 2 07:03:56 node1 kernel: [1941380.104003] Hardware name: Red Hat Inc. OpenStack Nova, BIOS 0.5.1 01/01/2007
Nov 2 07:03:56 node1 kernel: [1941380.104003] task: ffff880ecaeb1800 ti: ffff880ec7744000 task.ti: ffff880ec7744000
Nov 2 07:03:56 node1 kernel: [1941380.104003] RIP: 0010:[<ffffffff81726d02>] [<ffffffff81726d02>] _raw_spin_lock+0x32/0x50
Nov 2 07:03:56 node1 kernel: [1941380.104003] RSP: 0018:ffff880ec7745da8 EFLAGS: 00000206
Nov 2 07:03:56 node1 kernel: [1941380.104003] RAX: 0000000000006072 RBX: ffff880eca3ae3c0 RCX: 000000000000eed2
Nov 2 07:03:56 node1 kernel: [1941380.104003] RDX: 000000000000eed8 RSI: 000000000000eed8 RDI: ffffffffa029ac80
Nov 2 07:03:56 node1 kernel: [1941380.104003] RBP: ffff880ec7745da8 R08: 18bb555400000000 R09: 18282e0518bb5554
Nov 2 07:03:56 node1 kernel: [1941380.104003] R10: 000000006a81e9b4 R11: 18282e0518bb5554 R12: ffff880ec7745d78
Nov 2 07:03:56 node1 kernel: [1941380.104003] R13: ffff880ec784c200 R14: 0000000000000000 R15: 00000000ee626da3
Nov 2 07:03:56 node1 kernel: [1941380.104003] FS: 0000000000000000(0000) GS:ffff880f1fc00000(0000) knlGS:0000000000000000
Nov 2 07:03:56 node1 kernel: [1941380.104003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Nov 2 07:03:56 node1 kernel: [1941380.104003] CR2: 00007f554c039000 CR3: 0000000ecbcd8000 CR4: 00000000000406f0
Nov 2 07:03:56 node1 kernel: [1941380.104003] Stack:
Nov 2 07:03:56 node1 kernel: [1941380.104003] ffff880ec7745de8 ffffffffa026d666 000000000000006c ffff880ec807e000
Nov 2 07:03:56 node1 kernel: [1941380.104003] ffffffffa02974d8 ffff88010317e018 ffff88010317e000 000000000000001c
Nov 2 07:03:56 node1 kernel: [1941380.104003] ffff880ec7745e20 ffffffffa0261e12 ffff880ec807e1e0 ffff880ec807e000
Nov 2 07:03:56 node1 kernel: [1941380.104003] Call Trace:
Nov 2 07:03:56 node1 kernel: [1941380.104003] [<ffffffffa026d666>] nfsd_cache_update+0x76/0x150 [nfsd]
Nov 2 07:03:56 node1 kernel: [1941380.104003] [<ffffffffa0261e12>] nfsd_dispatch+0x192/0x200 [nfsd]
Nov 2 07:03:56 node1 kernel: [1941380.104003] [<ffffffffa016462d>] svc_process_common+0x46d/0x6d0 [sunrpc]
Nov 2 07:03:56 node1 kernel: [1941380.104003] [<ffffffffa0164997>] svc_process+0x107/0x170 [sunrpc]
Nov 2 07:03:56 node1 kernel: [1941380.104003] [<ffffffffa026171f>] nfsd+0xbf/0x130 [nfsd]
Nov 2 07:03:56 node1 kernel: [1941380.104003] [<ffffffffa0261660>] ? nfsd_destroy+0x80/0x80 [nfsd]
Nov 2 07:03:56 node1 kernel: [1941380.104003] [<ffffffff8108b492>] kthread+0xd2/0xf0
Nov 2 07:03:56 node1 kernel: [1941380.104003] [<ffffffff8108b3c0>] ? kthread_create_on_node+0x1c0/0x1c0
Nov 2 07:03:56 node1 kernel: [1941380.104003] [<ffffffff8172f77c>] ret_from_fork+0x7c/0xb0
Nov 2 07:03:56 node1 kernel: [1941380.104003] [<ffffffff8108b3c0>] ? kthread_create_on_node+0x1c0/0x1c0
Nov 2 07:03:56 node1 kernel: [1941380.104003] Code: 89 e5 b8 00 00 02 00 f0 0f c1 07 89 c2 c1 ea 10 66 39 c2 75 02 5d c3 83 e2 fe 0f b7 f2 b8 00 80 00 00 eb 0c 0f 1f 44 00 00 f3 90 <83> e8 01 74 0a 0f b7 0f 66 39 ca 75 f1 5d c3 66 66 66 90 66 66

----

Nov 2 07:03:56 node1 kernel: [1941352.144608] CPU: 2 PID: 135 Comm: khugepaged Not tainted 3.13.0-37-generic #64-Ubuntu
Nov 2 07:03:56 node1 kernel: [1941352.144608] Hardware name: Red Hat Inc. OpenStack Nova, BIOS 0.5.1 01/01/2007
Nov 2 07:03:56 node1 kernel: [1941352.144608] task: ffff880ec97e6000 ti: ffff880ec9080000 task.ti: ffff880ec9080000
Nov 2 07:03:56 node1 kernel: [1941352.144608] RIP: 0010:[<ffffffff8136e333>] [<ffffffff8136e333>] copy_page+0x23/0xe0
Nov 2 07:03:56 node1 kernel: [1941352.144608] RSP: 0018:ffff880ec9081d90 EFLAGS: 00010206
Nov 2 07:03:56 node1 kernel: [1941352.144608] RAX: 0000000023ba7000 RBX: ffff880ee3010c00 RCX: 000000000000003a
Nov 2 07:03:56 node1 kernel: [1941352.144608] RDX: ffffffffffffffed RSI: ffff88085076c000 RDI: ffff880023ba7000
Nov 2 07:03:56 node1 kernel: [1941352.144608] RBP: ffff880ec9081e50 R08: 0000000000000008 R09: 00000000ffffffee
Nov 2 07:03:56 node1 kernel: [1941352.144608] R10: 57ff199b23194440 R11: 0000000000000016 R12: 0000000000000001
Nov 2 07:03:56 node1 kernel: [1941352.144608] R13: ffffea0034194440 R14: ffff880ed62e5110 R15: ffff880f1ffc1f00
Nov 2 07:03:56 node1 kernel: [1941352.144608] FS: 0000000000000000(0000) GS:ffff880f1fc40000(0000) knlGS:0000000000000000
Nov 2 07:03:56 node1 kernel: [1941352.144608] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Nov 2 07:03:56 node1 kernel: [1941352.144608] CR2: 00007f1bc5fb0740 CR3: 000000014ee48000 CR4: 00000000000406e0
Nov 2 07:03:56 node1 kernel: [1941352.144608] Stack:
Nov 2 07:03:56 node1 kernel: [1941352.144608] ffffea002141db00 ffff8801779b1d38 ffffffff811aa6b7 00000001779b1067
Nov 2 07:03:56 node1 kernel: [1941352.144608] 0000000031600000 0000000000000286 0000000031800000 ffff88087ce73190
Nov 2 07:03:56 node1 kernel: [1941352.144608] ffff880ec9081e70 ffffea00008e8000 ffffea000466aff0 ffff880ec788e5e0
Nov 2 07:03:56 node1 kernel: [1941352.144608] Call Trace:
Nov 2 07:03:56 node1 kernel: [1941352.144608] [<ffffffff811aa6b7>] ? khugepaged_scan_mm_slot+0x9e7/0xc90
Nov 2 07:03:56 node1 kernel: [1941352.144608] [<ffffffff811aabaf>] khugepaged+0x24f/0x460
Nov 2 07:03:56 node1 kernel: [1941352.144608] [<ffffffff810aafd0>] ? prepare_to_wait_event+0x100/0x100
Nov 2 07:03:56 node1 kernel: [1941352.144608] [<ffffffff811aa960>] ? khugepaged_scan_mm_slot+0xc90/0xc90
Nov 2 07:03:56 node1 kernel: [1941352.144608] [<ffffffff8108b492>] kthread+0xd2/0xf0
Nov 2 07:03:56 node1 kernel: [1941352.144608] [<ffffffff8108b3c0>] ? kthread_create_on_node+0x1c0/0x1c0
Nov 2 07:03:56 node1 kernel: [1941352.144608] [<ffffffff8172f77c>] ret_from_fork+0x7c/0xb0
Nov 2 07:03:56 node1 kernel: [1941352.144608] [<ffffffff8108b3c0>] ? kthread_create_on_node+0x1c0/0x1c0

ProblemType: Bug
DistroRelease: Ubuntu 14.04
Package: linux-image-3.13.0-39-generic 3.13.0-39.66
ProcVersionSignature: Ubuntu 3.13.0-39.66-generic 3.13.11.8
Uname: Linux 3.13.0-39-generic x86_64
AlsaDevices:
 total 0
 crw-rw---- 1 root audio 116, 1 marra 3 12:03 seq
 crw-rw---- 1 root audio 116, 33 marra 3 12:03 timer
AplayDevices: Error: [Errno 2] No such file or directory: 'aplay'
ApportVersion: 2.14.1-0ubuntu3.5
Architecture: amd64
ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord'
AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1:
CRDA: Error: [Errno 2] No such file or directory: 'iw'
CurrentDmesg:
 [ 5.862722] NFSD: starting 90-second grace period (net ffffffff81cda580)
 [ 7.726451] init: plymouth-upstart-bridge main process ended, respawning
 [ 27.661652] random: nonblocking pool is initialized
 [ 326.463238] hrtimer: interrupt took 21589787 ns
Date: Mon Nov 3 12:30:50 2014
InstallationDate: Installed on 2014-07-07 (118 days ago)
InstallationMedia: Ubuntu-Server 14.04 LTS "Trusty Tahr" - Release amd64 (20140416.2)
IwConfig:
 eth0 no wireless extensions.

 eth1 no wireless extensions.

 lo no wireless extensions.
Lsusb:
 Bus 001 Device 002: ID 0627:0001 Adomax Technology Co., Ltd
 Bus 001 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
MachineType: Red Hat Inc. OpenStack Nova
PciMultimedia:

ProcFB: 0 cirrusdrmfb
ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-3.13.0-39-generic root=/dev/mapper/vg0-lv0 ro
RelatedPackageVersions:
 linux-restricted-modules-3.13.0-39-generic N/A
 linux-backports-modules-3.13.0-39-generic N/A
 linux-firmware 1.127.7
RfKill: Error: [Errno 2] No such file or directory: 'rfkill'
SourcePackage: linux
UpgradeStatus: No upgrade log present (probably fresh install)
dmi.bios.date: 01/01/2007
dmi.bios.vendor: Seabios
dmi.bios.version: 0.5.1
dmi.chassis.type: 1
dmi.chassis.vendor: Red Hat
dmi.modalias: dmi:bvnSeabios:bvr0.5.1:bd01/01/2007:svnRedHatInc.:pnOpenStackNova:pvr2013.1.3-2.el6:cvnRedHat:ct1:cvr:
dmi.product.name: OpenStack Nova
dmi.product.version: 2013.1.3-2.el6
dmi.sys.vendor: Red Hat Inc.

[Brad Figg (brad-figg)]

This change was made by a bot.

[Joseph Salisbury (jsalisbury)]

Would it be possible for you to test the latest upstream kernel? Refer to https://wiki.ubuntu.com/KernelMainlineBuilds . Please test the latest v3.18 kernel[0].

If this bug is fixed in the mainline kernel, please add the following tag 'kernel-fixed-upstream'.

If the mainline kernel does not fix this bug, please add the tag: 'kernel-bug-exists-upstream'.

If you are unable to test the mainline kernel, for example it will not boot, please add the tag: 'kernel-unable-to-test-upstream'.
Once testing of the upstream kernel is complete, please mark this bug as "Confirmed".

Thanks in advance.

[0] http://kernel.ubuntu.com/~kernel-ppa/mainline/v3.18-rc3-vivid/

[Sami Pietila (sampie)]

The machine is a production server. Is this kernel something that can be considered for production server usage? I am thinking could there be any security conserns.

[Launchpad Janitor (janitor)]

[Expired for linux (Ubuntu) because there has been no activity for 60 days.]