Happens in two nodes at the same time.
Node 1:
[205458.631304] ------------[ cut here ]------------
[205458.633636] kernel BUG at /build/buildd/linux-3.13.0/fs/fscache/page.c:244!
[205458.633636] invalid opcode: 0000 [#1] SMP
[205458.633636] Modules linked in: veth xt_nat xt_tcpudp xt_addrtype xt_conntrack ipt_MASQUERADE iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 iptable_filter ip_tables x_tables nf_nat nf_conntrack bridge stp llc dm_thin_pool dm_persistent_data dm_bufio dm_bio_prison libcrc32c cachefiles nfsv3 nfsd auth_rpcgss nfs_acl nfs lockd sunrpc fscache dm_crypt syscopyarea sysfillrect sysimgblt fb_sys_fops serio_raw isofs crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd floppy psmouse
[205458.633636] CPU: 3 PID: 6217 Comm: php5-fpm Not tainted 3.13.0-53-generic #89-Ubuntu
[205458.633636] Hardware name: Xen HVM domU, BIOS 4.2.amazon 05/06/2015
[205458.633636] task: ffff8801e3ede000 ti: ffff880107ace000 task.ti: ffff880107ace000
[205458.633636] RIP: 0010:[<ffffffffa00b8c14>] [<ffffffffa00b8c14>] fscache_release_retrieval_op+0x74/0x80 [fscache]
[205458.633636] RSP: 0018:ffff880107acfad8 EFLAGS: 00010286
[205458.633636] RAX: 000000000000000f RBX: ffff880014be1a80 RCX: 0000000000000000
[205458.633636] RDX: ffff8801efc6f020 RSI: ffff8801efc6d408 RDI: 0000000000000246
[205458.633636] RBP: ffff880107acfae0 R08: 0000000000000096 R09: 0000000000000231
[205458.633636] R10: ffffffff8185ade0 R11: ffff880107acf806 R12: ffff8800c3e469f8
[205458.633636] R13: ffff880107acfbbc R14: 00000000ffffff97 R15: ffff8801e3ff9b68
[205458.633636] FS: 00007f383346c740(0000) GS:ffff8801efc60000(0000) knlGS:0000000000000000
[205458.633636] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[205458.633636] CR2: 00007f382032cf08 CR3: 00000001206ea000 CR4: 00000000001406e0
[205458.633636] Stack:
[205458.633636] ffff880014be1a80 ffff880107acfb08 ffffffffa00b6eab ffff880014be1a80
[205458.633636] ffff8800c3e469f8 ffff880107acfbbc ffff880107acfb58 ffffffffa00b9753
[205458.633636] ffff8800c3e46a00 ffff8801e3ff9b00 ffff880107acfcb8 00000000ffffff97
[205458.633636] Call Trace:
[205458.633636] [<ffffffffa00b6eab>] fscache_put_operation+0x5b/0x220 [fscache]
[205458.633636] [<ffffffffa00b9753>] __fscache_read_or_alloc_pages+0x1b3/0x350 [fscache]
[205458.633636] [<ffffffffa01645c1>] __nfs_readpages_from_fscache+0x71/0x1b0 [nfs]
[205458.633636] [<ffffffffa015b7b8>] nfs_readpages+0xa8/0x190 [nfs]
[205458.633636] [<ffffffff81197c53>] ? alloc_pages_current+0xa3/0x160
[205458.633636] [<ffffffff8114f757>] ? __page_cache_alloc+0x97/0xc0
[205458.633636] [<ffffffff8115ba39>] __do_page_cache_readahead+0x1b9/0x260
[205458.633636] [<ffffffff8115bf12>] ondemand_readahead+0x152/0x2a0
[205458.633636] [<ffffffff8115c091>] page_cache_sync_readahead+0x31/0x50
[205458.633636] [<ffffffff81151b65>] generic_file_aio_read+0x4c5/0x700
[205458.633636] [<ffffffffa0150949>] nfs_file_read+0x69/0xf0 [nfs]
[205458.633636] [<ffffffff811bd8ba>] do_sync_read+0x5a/0x90
[205458.633636] [<ffffffff811bdf55>] vfs_read+0x95/0x160
[205458.633636] [<ffffffff811bea69>] SyS_read+0x49/0xa0
[205458.633636] [<ffffffff8173391d>] system_call_fastpath+0x1a/0x1f
[205458.633636] Code: c0 e8 92 3b 66 e1 48 c7 c7 ae cc 0b a0 31 c0 e8 84 3b 66 e1 48 63 b3 90 00 00 00 31 d2 48 c7 c7 e3 cc 0b a0 31 c0 e8 6d 3b 66 e1 <0f> 0b 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5
[205458.633636] RIP [<ffffffffa00b8c14>] fscache_release_retrieval_op+0x74/0x80 [fscache]
[205458.633636] RSP <ffff880107acfad8>
[205458.833163] ---[ end trace 30960a6ba86a197f ]---
Node 2:
[360136.745210] FS-Cache: Assertion failed
[360136.747121] 1 == 0 is false
[360136.748704] ------------[ cut here ]------------
[360136.751217] kernel BUG at /build/buildd/linux-3.13.0/fs/fscache/page.c:244!
[360136.752666] invalid opcode: 0000 [#1] SMP
[360136.752666] Modules linked in: veth xt_nat xt_tcpudp xt_addrtype xt_conntrack ipt_MASQUERADE iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 iptable_filter ip_tables x_tables nf_nat nf_conntrack bridge stp llc dm_thin_pool dm_persistent_data dm_bufio dm_bio_prison libcrc32c cachefiles nfsv3 nfsd auth_rpcgss nfs_acl nfs lockd sunrpc fscache dm_crypt syscopyarea sysfillrect sysimgblt fb_sys_fops serio_raw isofs crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd psmouse floppy
[360136.752666] CPU: 2 PID: 7105 Comm: php5-fpm Not tainted 3.13.0-53-generic #89-Ubuntu
[360136.752666] Hardware name: Xen HVM domU, BIOS 4.2.amazon 05/06/2015
[360136.752666] task: ffff880116254800 ti: ffff88010cb8a000 task.ti: ffff88010cb8a000
[360136.752666] RIP: 0010:[<ffffffffa00b1c14>] [<ffffffffa00b1c14>] fscache_release_retrieval_op+0x74/0x80 [fscache]
[360136.752666] RSP: 0018:ffff88010cb8bad8 EFLAGS: 00010286
[360136.752666] RAX: 000000000000000f RBX: ffff88001fa9a300 RCX: 0000000000000006
[360136.752666] RDX: 0000000000000007 RSI: 000000004cae4cac RDI: 0000000000000246
[360136.752666] RBP: ffff88010cb8bae0 R08: 0000000000000096 R09: 0000000000000239
[360136.752666] R10: ffffffff8185ade0 R11: ffff88010cb8b806 R12: ffff8800d4e4ae18
[360136.752666] R13: ffff88010cb8bbbc R14: 00000000ffffff97 R15: ffff88008df750e8
[360136.752666] FS: 00007f4233932740(0000) GS:ffff8801efc40000(0000) knlGS:0000000000000000
[360136.752666] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[360136.752666] CR2: 00000000040e9008 CR3: 000000010de9c000 CR4: 00000000001406e0
[360136.752666] Stack:
[360136.752666] ffff88001fa9a300 ffff88010cb8bb08 ffffffffa00afeab ffff88001fa9a300
[360136.752666] ffff8800d4e4ae18 ffff88010cb8bbbc ffff88010cb8bb58 ffffffffa00b2753
[360136.752666] ffff8800d4e4ae20 ffff88008df75080 ffff88010cb8bcb8 00000000ffffff97
[360136.752666] Call Trace:
[360136.752666] [<ffffffffa00afeab>] fscache_put_operation+0x5b/0x220 [fscache]
[360136.752666] [<ffffffffa00b2753>] __fscache_read_or_alloc_pages+0x1b3/0x350 [fscache]
[360136.752666] [<ffffffffa015d5c1>] __nfs_readpages_from_fscache+0x71/0x1b0 [nfs]
[360136.752666] [<ffffffffa01547b8>] nfs_readpages+0xa8/0x190 [nfs]
[360136.752666] [<ffffffff81197c53>] ? alloc_pages_current+0xa3/0x160
[360136.752666] [<ffffffff8114f757>] ? __page_cache_alloc+0x97/0xc0
[360136.752666] [<ffffffff8115ba39>] __do_page_cache_readahead+0x1b9/0x260
[360136.752666] [<ffffffff8115bf12>] ondemand_readahead+0x152/0x2a0
[360136.752666] [<ffffffff8115c091>] page_cache_sync_readahead+0x31/0x50
[360136.752666] [<ffffffff81151b65>] generic_file_aio_read+0x4c5/0x700
[360136.752666] [<ffffffffa0149949>] nfs_file_read+0x69/0xf0 [nfs]
[360136.752666] [<ffffffff811bd8ba>] do_sync_read+0x5a/0x90
[360136.752666] [<ffffffff811bdf55>] vfs_read+0x95/0x160
[360136.752666] [<ffffffff811bea69>] SyS_read+0x49/0xa0
[360136.752666] [<ffffffff8173391d>] system_call_fastpath+0x1a/0x1f
[360136.752666] Code: c0 e8 92 ab 66 e1 48 c7 c7 ae 5c 0b a0 31 c0 e8 84 ab 66 e1 48 63 b3 90 00 00 00 31 d2 48 c7 c7 e3 5c 0b a0 31 c0 e8 6d ab 66 e1 <0f> 0b 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5
[360136.752666] RIP [<ffffffffa00b1c14>] fscache_release_retrieval_op+0x74/0x80 [fscache]
[360136.752666] RSP <ffff88010cb8bad8>
[360136.935505] ---[ end trace 5e0dd6a39f65225d ]---
[361660.951453]
[361660.952687] FS-Cache: Assertion failed
[361660.954870] 1 == 0 is false
[361660.956679] ------------[ cut here ]------------
[361660.959155] kernel BUG at /build/buildd/linux-3.13.0/fs/fscache/page.c:244!
[361660.960653] invalid opcode: 0000 [#2] SMP
[361660.960653] Modules linked in: veth xt_nat xt_tcpudp xt_addrtype xt_conntrack ipt_MASQUERADE iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 iptable_filter ip_tables x_tables nf_nat nf_conntrack bridge stp llc dm_thin_pool dm_persistent_data dm_bufio dm_bio_prison libcrc32c cachefiles nfsv3 nfsd auth_rpcgss nfs_acl nfs lockd sunrpc fscache dm_crypt syscopyarea sysfillrect sysimgblt fb_sys_fops serio_raw isofs crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd psmouse floppy
[361660.960653] CPU: 0 PID: 7839 Comm: php5-fpm Tainted: G D 3.13.0-53-generic #89-Ubuntu
[361660.960653] Hardware name: Xen HVM domU, BIOS 4.2.amazon 05/06/2015
[361660.960653] task: ffff8800094c0000 ti: ffff880007daa000 task.ti: ffff880007daa000
[361660.960653] RIP: 0010:[<ffffffffa00b1c14>] [<ffffffffa00b1c14>] fscache_release_retrieval_op+0x74/0x80 [fscache]
[361660.960653] RSP: 0018:ffff880007dabad8 EFLAGS: 00010286
[361660.960653] RAX: 000000000000000f RBX: ffff88000903be40 RCX: 0000000000000006
[361660.960653] RDX: 0000000000000007 RSI: 0000000053625360 RDI: 0000000000000246
[361660.960653] RBP: ffff880007dabae0 R08: 0000000000000096 R09: 0000000000000265
[361660.960653] R10: ffffffff8185ade0 R11: ffff880007dab806 R12: ffff8800117e3aa8
[361660.960653] R13: ffff880007dabbbc R14: 00000000ffffff97 R15: ffff8800e7b707e8
[361660.960653] FS: 00007f4233932740(0000) GS:ffff8801efc00000(0000) knlGS:0000000000000000
[361660.960653] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[361660.960653] CR2: 00007faa5c88e208 CR3: 000000001fbe0000 CR4: 00000000001406f0
[361660.960653] Stack:
[361660.960653] ffff88000903be40 ffff880007dabb08 ffffffffa00afeab ffff88000903be40
[361660.960653] ffff8800117e3aa8 ffff880007dabbbc ffff880007dabb58 ffffffffa00b2753
[361660.960653] ffff8800117e3ab0 ffff8800e7b70780 ffff880007dabcb8 00000000ffffff97
[361660.960653] Call Trace:
[361660.960653] [<ffffffffa00afeab>] fscache_put_operation+0x5b/0x220 [fscache]
[361660.960653] [<ffffffffa00b2753>] __fscache_read_or_alloc_pages+0x1b3/0x350 [fscache]
[361660.960653] [<ffffffffa015d5c1>] __nfs_readpages_from_fscache+0x71/0x1b0 [nfs]
[361660.960653] [<ffffffffa01547b8>] nfs_readpages+0xa8/0x190 [nfs]
[361660.960653] [<ffffffff81197c53>] ? alloc_pages_current+0xa3/0x160
[361660.960653] [<ffffffff8114f757>] ? __page_cache_alloc+0x97/0xc0
[361660.960653] [<ffffffff8115ba39>] __do_page_cache_readahead+0x1b9/0x260
[361660.960653] [<ffffffff8115bf12>] ondemand_readahead+0x152/0x2a0
[361660.960653] [<ffffffff8115c091>] page_cache_sync_readahead+0x31/0x50
[361660.960653] [<ffffffff81151b65>] generic_file_aio_read+0x4c5/0x700
[361660.960653] [<ffffffffa0149949>] nfs_file_read+0x69/0xf0 [nfs]
[361660.960653] [<ffffffff811bd8ba>] do_sync_read+0x5a/0x90
[361660.960653] [<ffffffff811bdf55>] vfs_read+0x95/0x160
[361660.960653] [<ffffffff811bea69>] SyS_read+0x49/0xa0
[361660.960653] [<ffffffff8173391d>] system_call_fastpath+0x1a/0x1f
[361660.960653] Code: c0 e8 92 ab 66 e1 48 c7 c7 ae 5c 0b a0 31 c0 e8 84 ab 66 e1 48 63 b3 90 00 00 00 31 d2 48 c7 c7 e3 5c 0b a0 31 c0 e8 6d ab 66 e1 <0f> 0b 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5
[361660.960653] RIP [<ffffffffa00b1c14>] fscache_release_retrieval_op+0x74/0x80 [fscache]
[361660.960653] RSP <ffff880007dabad8>
[361661.134212] ---[ end trace 5e0dd6a39f65225e ]---
[363766.284093]
[363766.285960] FS-Cache: Assertion failed
[363766.289822] 1 == 0 is false
[363766.292641] ------------[ cut here ]------------
[363766.295666] kernel BUG at /build/buildd/linux-3.13.0/fs/fscache/page.c:244!
[363766.296609] invalid opcode: 0000 [#3] SMP
[363766.296609] Modules linked in: veth xt_nat xt_tcpudp xt_addrtype xt_conntrack ipt_MASQUERADE iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 iptable_filter ip_tables x_tables nf_nat nf_conntrack bridge stp llc dm_thin_pool dm_persistent_data dm_bufio dm_bio_prison libcrc32c cachefiles nfsv3 nfsd auth_rpcgss nfs_acl nfs lockd sunrpc fscache dm_crypt syscopyarea sysfillrect sysimgblt fb_sys_fops serio_raw isofs crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd psmouse floppy
[363766.296609] CPU: 0 PID: 8794 Comm: php5-fpm Tainted: G D 3.13.0-53-generic #89-Ubuntu
[363766.296609] Hardware name: Xen HVM domU, BIOS 4.2.amazon 05/06/2015
[363766.296609] task: ffff88003704b000 ti: ffff8801025ce000 task.ti: ffff8801025ce000
[363766.296609] RIP: 0010:[<ffffffffa00b1c14>] [<ffffffffa00b1c14>] fscache_release_retrieval_op+0x74/0x80 [fscache]
[363766.296609] RSP: 0018:ffff8801025cfad8 EFLAGS: 00010286
[363766.296609] RAX: 000000000000000f RBX: ffff880105a92780 RCX: 0000000000000000
[363766.296609] RDX: ffff8801efc0f020 RSI: ffff8801efc0d408 RDI: 0000000000000246
[363766.296609] RBP: ffff8801025cfae0 R08: 0000000000000096 R09: 0000000000000291
[363766.296609] R10: ffffffff8185ade0 R11: ffff8801025cf806 R12: ffff8800117e3aa8
[363766.296609] R13: ffff8801025cfbbc R14: 00000000ffffff97 R15: ffff8800e7b707e8
[363766.296609] FS: 00007f4233932740(0000) GS:ffff8801efc00000(0000) knlGS:0000000000000000
[363766.296609] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[363766.296609] CR2: 00000000030ba160 CR3: 0000000100915000 CR4: 00000000001406f0
[363766.296609] Stack:
[363766.296609] ffff880105a92780 ffff8801025cfb08 ffffffffa00afeab ffff880105a92780
[363766.296609] ffff8800117e3aa8 ffff8801025cfbbc ffff8801025cfb58 ffffffffa00b2753
[363766.296609] ffff8800117e3ab0 ffff8800e7b70780 ffff8801025cfcb8 00000000ffffff97
[363766.296609] Call Trace:
[363766.296609] [<ffffffffa00afeab>] fscache_put_operation+0x5b/0x220 [fscache]
[363766.296609] [<ffffffffa00b2753>] __fscache_read_or_alloc_pages+0x1b3/0x350 [fscache]
[363766.296609] [<ffffffffa015d5c1>] __nfs_readpages_from_fscache+0x71/0x1b0 [nfs]
[363766.296609] [<ffffffffa01547b8>] nfs_readpages+0xa8/0x190 [nfs]
[363766.296609] [<ffffffff81197c53>] ? alloc_pages_current+0xa3/0x160
[363766.296609] [<ffffffff8114f757>] ? __page_cache_alloc+0x97/0xc0
[363766.296609] [<ffffffff8115ba39>] __do_page_cache_readahead+0x1b9/0x260
[363766.296609] [<ffffffff8115bf12>] ondemand_readahead+0x152/0x2a0
[363766.296609] [<ffffffff8115c091>] page_cache_sync_readahead+0x31/0x50
[363766.296609] [<ffffffff81151b65>] generic_file_aio_read+0x4c5/0x700
[363766.296609] [<ffffffffa0149949>] nfs_file_read+0x69/0xf0 [nfs]
[363766.296609] [<ffffffff811bd8ba>] do_sync_read+0x5a/0x90
[363766.296609] [<ffffffff811bdf55>] vfs_read+0x95/0x160
[363766.296609] [<ffffffff811bea69>] SyS_read+0x49/0xa0
[363766.296609] [<ffffffff8173391d>] system_call_fastpath+0x1a/0x1f
[363766.296609] Code: c0 e8 92 ab 66 e1 48 c7 c7 ae 5c 0b a0 31 c0 e8 84 ab 66 e1 48 63 b3 90 00 00 00 31 d2 48 c7 c7 e3 5c 0b a0 31 c0 e8 6d ab 66 e1 <0f> 0b 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5
[363766.296609] RIP [<ffffffffa00b1c14>] fscache_release_retrieval_op+0x74/0x80 [fscache]
[363766.296609] RSP <ffff8801025cfad8>
[363766.499901] ---[ end trace 5e0dd6a39f65225f ]---
---
AlsaDevices:
total 0
crw-rw---- 1 root audio 116, 1 May 31 09:49 seq
crw-rw---- 1 root audio 116, 33 May 31 09:49 timer
AplayDevices: Error: [Errno 2] No such file or directory
ApportVersion: 2.14.1-0ubuntu3.10
Architecture: amd64
ArecordDevices: Error: [Errno 2] No such file or directory
AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1:
CRDA: Error: [Errno 2] No such file or directory
DistroRelease: Ubuntu 14.04
Ec2AMI: ami-e3e89994
Ec2AMIManifest: (unknown)
Ec2AvailabilityZone: eu-west-1a
Ec2InstanceType: c3.xlarge
Ec2Kernel: unavailable
Ec2Ramdisk: unavailable
IwConfig: Error: [Errno 2] No such file or directory
Lsusb: Error: command ['lsusb'] failed with exit code 1: unable to initialize libusb: -99
MachineType: Xen HVM domU
Package: linux (not installed)
PciMultimedia:
ProcEnviron:
TERM=xterm
PATH=(custom, no user)
XDG_RUNTIME_DIR=<set>
LANG=en_US.UTF-8
SHELL=/bin/bash
ProcFB:
ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-3.13.0-53-generic root=UUID=efbeda5e-eb44-475f-83dc-eb9b42239a4a ro console=tty1 console=ttyS0
ProcVersionSignature: Ubuntu 3.13.0-53.89-generic 3.13.11-ckt19
RelatedPackageVersions:
linux-restricted-modules-3.13.0-53-generic N/A
linux-backports-modules-3.13.0-53-generic N/A
linux-firmware N/A
RfKill: Error: [Errno 2] No such file or directory
Tags: trusty ec2-images
Uname: Linux 3.13.0-53-generic x86_64
UpgradeStatus: No upgrade log present (probably fresh install)
UserGroups:
WifiSyslog:
_MarkForUpload: True
dmi.bios.date: 05/06/2015
dmi.bios.vendor: Xen
dmi.bios.version: 4.2.amazon
dmi.chassis.type: 1
dmi.chassis.vendor: Xen
dmi.modalias: dmi:bvnXen:bvr4.2.amazon:bd05/06/2015:svnXen:pnHVMdomU:pvr4.2.amazon:cvnXen:ct1:cvr:
dmi.product.name: HVM domU
dmi.product.version: 4.2.amazon
dmi.sys.vendor: Xen
This bug is missing log files that will aid in diagnosing the problem. From a terminal window please run:
apport-collect 1460402
and then change the status of the bug to 'Confirmed'.
If, due to the nature of the issue you have encountered, you are unable to run this command, please add a comment stating that fact and change the bug status to 'Confirmed'.
This change has been made by an automated script, maintained by the Ubuntu Kernel Team.