Sep 29 21:06:52 w1a kernel: [64310.585869] Sep 29 21:06:52 w1a kernel: [64310.589452] FS-Cache: Assertion failed Sep 29 21:06:52 w1a kernel: [64310.592963] 1 == 0 is false Sep 29 21:06:52 w1a kernel: [64310.596459] ------------[ cut here ]------------ Sep 29 21:06:52 w1a kernel: [64310.599894] Kernel BUG at ffffffffa073fc7e [verbose debug info unavailable] Sep 29 21:06:52 w1a kernel: [64310.600401] invalid opcode: 0000 [#1] SMP Sep 29 21:06:52 w1a kernel: [64310.600401] Modules linked in: rpcsec_gss_krb5 nfsv4 nfsd nfs_acl auth_rpcgss nfs lockd sunrpc cachefiles fscache xt_TCPMSS act_police cls_flow cl s_fw cls_u32 sch_htb sch_hfsc sch_ingress sch_sfq bridge xt_LOG xt_time xt_connlimit xt_realm xt_addrtype iptable_raw xt_comment xt_recent xt_policy xt_nat ipt_ULOG ipt_REJECT i pt_MASQUERADE ipt_ECN ipt_CLUSTERIP ipt_ah nf_nat_tftp nf_nat_snmp_basic nf_conntrack_snmp nf_nat_sip nf_nat_pptp nf_nat_proto_gre nf_nat_irc nf_nat_h323 nf_nat_ftp nf_nat_amand a ts_kmp nf_conntrack_amanda nf_conntrack_sane nf_conntrack_tftp nf_conntrack_sip nf_conntrack_proto_sctp nf_conntrack_pptp nf_conntrack_proto_gre nf_conntrack_netlink nf_conntr ack_netbios_ns nf_conntrack_broadcast nf_conntrack_irc nf_conntrack_h323 nf_conntrack_ftp xt_TPROXY nf_defrag_ipv6 xt_tcpmss xt_pkttype xt_physdev xt_owner xt_NFQUEUE xt_NFLOG n fnetlink_log xt_multiport xt_mark xt_mac xt_limit xt_length xt_iprange xt_helper xt_hashlimit xt_DSCP xt_dscp xt_dccp xt_conntrack xt_connm Sep 29 21:06:52 w1a kernel: ark xt_CLASSIFY xt_tcpudp xt_state iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_conntrack iptable_mangle nfnetlink iptable_filt er ip_tables x_tables ipip ip_tunnel tunnel4 bonding 8021q mrp garp stp llc xfs libcrc32c r8169 kvm_amd kvm radeon snd_pcm pata_acpi tg3 snd_timer ptp ttm snd soundcore pps_core snd_page_alloc edac_core sata_svw edac_mce_amd mac_hid ohci_pci drm_kms_helper pcspkr drm psmouse pata_serverworks tpm_tis e100 i2c_piix4 k8temp serio_raw mii i2c_algo_bit sata _via sata_sis sata_sil sata_nv raid1 arcmsr shpchp Sep 29 21:06:52 w1a kernel: [64310.600401] CPU: 2 PID: 4176 Comm: apache2 Tainted: G W 3.12.0-031200rc2-generic #201309231935 Sep 29 21:06:52 w1a kernel: [64310.600401] Hardware name: empty empty/Tyan Transport GT24-B3992, BIOS 080011 06/05/2007 Sep 29 21:06:52 w1a kernel: [64310.600401] task: ffff88007246de80 ti: ffff88002fc7c000 task.ti: ffff88002fc7c000 Sep 29 21:06:52 w1a kernel: [64310.600401] RIP: 0010:[] [] fscache_release_retrieval_op+0x7e/0x80 [fscache] Sep 29 21:06:52 w1a kernel: [64310.600401] RSP: 0018:ffff88002fc7d978 EFLAGS: 00010292 Sep 29 21:06:52 w1a kernel: [64310.600401] RAX: 000000000000000f RBX: ffff88025762f0c0 RCX: 0000000000000000 Sep 29 21:06:52 w1a kernel: [64310.600401] RDX: ffff88043fc10050 RSI: ffff88043fc0e458 RDI: 0000000000000246 Sep 29 21:06:52 w1a kernel: [64310.600401] RBP: ffff88002fc7d988 R08: 0000000000000000 R09: 0000000000000001 Sep 29 21:06:52 w1a kernel: [64310.600401] R10: 0000000000000377 R11: 0000000000002000 R12: ffff88025762f0c0 Sep 29 21:06:52 w1a kernel: [64310.600401] R13: ffff8801c1014ae8 R14: ffff88002fc7dab4 R15: ffff88002fc7dc38 Sep 29 21:06:52 w1a kernel: [64310.600401] FS: 00007fee0b924740(0000) GS:ffff88043fc00000(0000) knlGS:0000000000000000 Sep 29 21:06:52 w1a kernel: [64310.600401] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Sep 29 21:06:52 w1a kernel: [64310.600401] CR2: 00007fee0ed66428 CR3: 000000002e132000 CR4: 00000000000007e0 Sep 29 21:06:52 w1a kernel: [64310.600401] Stack: Sep 29 21:06:52 w1a kernel: [64310.600401] ffff88025762f0c0 ffff88025762f0c0 ffff88002fc7d9b8 ffffffffa073dfed Sep 29 21:06:52 w1a kernel: [64310.600401] ffff88002fc7d9d8 ffff88025762f0c0 ffff88025762f0c0 ffff8801c1014ae8 Sep 29 21:06:52 w1a kernel: [64310.600401] ffff88002fc7d9d8 ffffffffa073e1ab ffff88002fc7dab4 ffff880082e2cbb0 Sep 29 21:06:52 w1a kernel: [64310.600401] Call Trace: Sep 29 21:06:52 w1a kernel: [64310.600401] [] fscache_put_operation.part.3+0x3d/0x1d0 [fscache] Sep 29 21:06:52 w1a kernel: [64310.600401] [] fscache_put_operation+0x2b/0x70 [fscache] Sep 29 21:06:52 w1a kernel: [64310.600401] [] __fscache_read_or_alloc_pages+0x19e/0x2f0 [fscache] Sep 29 21:06:52 w1a kernel: [64310.600401] [] __nfs_readpages_from_fscache+0x70/0x1b0 [nfs] Sep 29 21:06:52 w1a kernel: [64310.600401] [] nfs_readpages+0xb2/0x1c0 [nfs] Sep 29 21:06:52 w1a kernel: [64310.600401] [] ? __alloc_pages_nodemask+0x18e/0xa30 Sep 29 21:06:52 w1a kernel: [64310.600401] [] ? ttwu_do_activate.constprop.84+0x66/0x70 Sep 29 21:06:52 w1a kernel: [64310.600401] [] read_pages+0x48/0x100 Sep 29 21:06:52 w1a kernel: [64310.600401] [] __do_page_cache_readahead+0x15b/0x170 Sep 29 21:06:52 w1a kernel: [64310.600401] [] ra_submit+0x21/0x30 Sep 29 21:06:52 w1a kernel: [64310.600401] [] ondemand_readahead+0x115/0x230 Sep 29 21:06:52 w1a kernel: [64310.600401] [] page_cache_sync_readahead+0x31/0x50 Sep 29 21:06:52 w1a kernel: [64310.600401] [] do_generic_file_read.constprop.35+0x2b6/0x440 Sep 29 21:06:52 w1a kernel: [64310.600401] [] generic_file_aio_read+0xe1/0x220 Sep 29 21:06:52 w1a kernel: [64310.600401] [] ? invalidate_inode_pages2+0x17/0x20 Sep 29 21:06:52 w1a kernel: [64310.600401] [] nfs_file_read+0x89/0x100 [nfs] Sep 29 21:06:52 w1a kernel: [64310.600401] [] do_sync_read+0x5a/0x90 Sep 29 21:06:52 w1a kernel: [64310.600401] [] vfs_read+0xb4/0x180 Sep 29 21:06:52 w1a kernel: [64310.600401] [] SyS_read+0x52/0xa0 Sep 29 21:06:52 w1a kernel: [64310.600401] [] tracesys+0xe1/0xe6 Sep 29 21:06:52 w1a kernel: [64310.600401] Code: f6 a5 ff e0 48 c7 c7 21 36 74 a0 31 c0 e8 e8 a5 ff e0 8b b3 90 00 00 00 31 d2 48 c7 c7 56 36 74 a0 31 c0 48 63 f6 e8 cf a5 ff e0 <0f> 0b 66 66 66 66 90 55 48 89 e5 48 83 ec 30 4c 89 65 e0 4c 8d Sep 29 21:06:52 w1a kernel: [64310.600401] RIP [] fscache_release_retrieval_op+0x7e/0x80 [fscache] Sep 29 21:06:52 w1a kernel: [64310.600401] RSP Sep 29 21:06:52 w1a kernel: [64310.888215] ---[ end trace 32b2838663010e0e ]--- Sep 29 22:07:07 w1a kernel: [67925.796044] nfs: server 192.168.100.200 not responding, still trying Sep 29 22:07:08 w1a kernel: [67926.920155] nfs: server 192.168.100.200 OK Sep 30 00:04:38 w1a kernel: [74976.471762] ------------[ cut here ]------------ Sep 30 00:04:38 w1a kernel: [74976.475646] Kernel BUG at ffffffffa0884515 [verbose debug info unavailable] Sep 30 00:04:38 w1a kernel: [74976.479037] invalid opcode: 0000 [#2] SMP Sep 30 00:04:38 w1a kernel: [74976.479037] Modules linked in: rpcsec_gss_krb5 nfsv4 nfsd nfs_acl auth_rpcgss nfs lockd sunrpc cachefiles fscache xt_TCPMSS act_police cls_flow cl s_fw cls_u32 sch_htb sch_hfsc sch_ingress sch_sfq bridge xt_LOG xt_time xt_connlimit xt_realm xt_addrtype iptable_raw xt_comment xt_recent xt_policy xt_nat ipt_ULOG ipt_REJECT i pt_MASQUERADE ipt_ECN ipt_CLUSTERIP ipt_ah nf_nat_tftp nf_nat_snmp_basic nf_conntrack_snmp nf_nat_sip nf_nat_pptp nf_nat_proto_gre nf_nat_irc nf_nat_h323 nf_nat_ftp nf_nat_amand a ts_kmp nf_conntrack_amanda nf_conntrack_sane nf_conntrack_tftp nf_conntrack_sip nf_conntrack_proto_sctp nf_conntrack_pptp nf_conntrack_proto_gre nf_conntrack_netlink nf_conntr ack_netbios_ns nf_conntrack_broadcast nf_conntrack_irc nf_conntrack_h323 nf_conntrack_ftp xt_TPROXY nf_defrag_ipv6 xt_tcpmss xt_pkttype xt_physdev xt_owner xt_NFQUEUE xt_NFLOG n fnetlink_log xt_multiport xt_mark xt_mac xt_limit xt_length xt_iprange xt_helper xt_hashlimit xt_DSCP xt_dscp xt_dccp xt_conntrack xt_connm Sep 30 00:04:38 w1a kernel: ark xt_CLASSIFY xt_tcpudp xt_state iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_conntrack iptable_mangle nfnetlink iptable_filt er ip_tables x_tables ipip ip_tunnel tunnel4 bonding 8021q mrp garp stp llc xfs libcrc32c r8169 kvm_amd kvm radeon snd_pcm pata_acpi tg3 snd_timer ptp ttm snd soundcore pps_core snd_page_alloc edac_core sata_svw edac_mce_amd mac_hid ohci_pci drm_kms_helper pcspkr drm psmouse pata_serverworks tpm_tis e100 i2c_piix4 k8temp serio_raw mii i2c_algo_bit sata _via sata_sis sata_sil sata_nv raid1 arcmsr shpchp Sep 30 00:04:38 w1a kernel: [74976.497579] CPU: 3 PID: 4393 Comm: kworker/3:2 Tainted: G D W 3.12.0-031200rc2-generic #201309231935 Sep 30 00:04:38 w1a kernel: [74976.497579] Hardware name: empty empty/Tyan Transport GT24-B3992, BIOS 080011 06/05/2007 Sep 30 00:04:38 w1a kernel: [74976.497579] Workqueue: rpciod rpc_async_schedule [sunrpc] Sep 30 00:04:38 w1a kernel: [74976.497579] task: ffff8804344c46e0 ti: ffff8802d6c5e000 task.ti: ffff8802d6c5e000 Sep 30 00:04:38 w1a kernel: [74976.497579] RIP: 0010:[] [] reserve_space+0x15/0x20 [nfsv4] Sep 30 00:04:38 w1a kernel: [74976.497579] RSP: 0018:ffff8802d6c5fbd8 EFLAGS: 00010246 Sep 30 00:04:38 w1a kernel: [74976.497579] RAX: 0000000000000000 RBX: 000000000000d600 RCX: ffff8802d6c5fc34 Sep 30 00:04:38 w1a kernel: [74976.497579] RDX: ffff88007ef28e64 RSI: 000000000000d604 RDI: ffff8802d6c5fc98 Sep 30 00:04:38 w1a kernel: [74976.497579] RBP: ffff8802d6c5fbd8 R08: ffff8802d6c5fc50 R09: ffff88007ef1b837 Sep 30 00:04:38 w1a kernel: [74976.497579] R10: dff2360de65d5b88 R11: 0000000000000094 R12: ffff8800bf9611c2 Sep 30 00:04:38 w1a kernel: [74976.497579] R13: ffff8802d6c5fc34 R14: ffff880433b11600 R15: ffffffffa08881b0 Sep 30 00:04:38 w1a kernel: [74976.497579] FS: 00007fee0b924740(0000) GS:ffff88043fc80000(0000) knlGS:0000000000000000 Sep 30 00:04:38 w1a kernel: [74976.497579] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b Sep 30 00:04:38 w1a kernel: [74976.497579] CR2: 00007fee05f731db CR3: 000000015be26000 CR4: 00000000000007e0 Sep 30 00:04:38 w1a kernel: [74976.497579] Stack: Sep 30 00:04:38 w1a kernel: [74976.497579] ffff8802d6c5fbf8 ffffffffa0884542 ffff8802d6c5fc98 ffff8800bf9611c0 Sep 30 00:04:38 w1a kernel: [74976.497579] ffff8802d6c5fc18 ffffffffa08864e4 ffff8802d6c5fc98 ffff8803a00831d0 Sep 30 00:04:38 w1a kernel: [74976.497579] ffff8802d6c5fc78 ffffffffa0888222 ffff8802ccf94008 0000000100000000 Sep 30 00:04:38 w1a kernel: [74976.497579] Call Trace: Sep 30 00:04:38 w1a kernel: [74976.497579] [] encode_string+0x22/0x40 [nfsv4] Sep 30 00:04:38 w1a kernel: [74976.497579] [] encode_putfh+0x44/0x50 [nfsv4] Sep 30 00:04:38 w1a kernel: [74976.497579] [] nfs4_xdr_enc_open_confirm+0x72/0xd0 [nfsv4] Sep 30 00:04:38 w1a kernel: [74976.497579] [] rpcauth_wrap_req+0x9d/0xd0 [sunrpc] Sep 30 00:04:38 w1a kernel: [74976.497579] [] ? rpcauth_marshcred+0x41/0x80 [sunrpc] Sep 30 00:04:38 w1a kernel: [74976.497579] [] rpc_xdr_encode+0xb9/0x110 [sunrpc] Sep 30 00:04:38 w1a kernel: [74976.497579] [] call_transmit.part.10+0x29/0xb0 [sunrpc] Sep 30 00:04:38 w1a kernel: [74976.497579] [] call_transmit+0x46/0x80 [sunrpc] Sep 30 00:04:38 w1a kernel: [74976.497579] [] __rpc_execute+0x90/0x280 [sunrpc] Sep 30 00:04:38 w1a kernel: [74976.497579] [] ? call_transmit.part.10+0xb0/0xb0 [sunrpc] Sep 30 00:04:38 w1a kernel: [74976.497579] [] ? call_transmit.part.10+0xb0/0xb0 [sunrpc] Sep 30 00:04:38 w1a kernel: [74976.497579] [] rpc_async_schedule+0x2a/0x40 [sunrpc] Sep 30 00:04:38 w1a kernel: [74976.497579] [] process_one_work+0x17f/0x4d0 Sep 30 00:04:38 w1a kernel: [74976.497579] [] worker_thread+0x11b/0x3d0 Sep 30 00:04:38 w1a kernel: [74976.497579] [] ? manage_workers.isra.20+0x1b0/0x1b0 Sep 30 00:04:38 w1a kernel: [74976.497579] [] kthread+0xc0/0xd0 Sep 30 00:04:38 w1a kernel: [74976.497579] [] ? flush_kthread_worker+0xb0/0xb0 Sep 30 00:04:38 w1a kernel: [74976.497579] [] ret_from_fork+0x7c/0xb0 Sep 30 00:04:38 w1a kernel: [74976.497579] [] ? flush_kthread_worker+0xb0/0xb0 Sep 30 00:04:38 w1a kernel: [74976.497579] Code: 65 f0 4c 8b 6d f8 c9 c3 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 55 48 89 e5 e8 52 7d ef ff 48 85 c0 74 02 5d c3 <0f> 0b 66 0f 1f 84 00 00 00 00 00 66 66 66 66 90 55 48 89 e5 48 Sep 30 00:04:38 w1a kernel: [74976.497579] RIP [] reserve_space+0x15/0x20 [nfsv4] Sep 30 00:04:38 w1a kernel: [74976.497579] RSP Sep 30 00:04:38 w1a kernel: [74976.770047] ---[ end trace 32b2838663010e0f ]--- Sep 30 00:04:38 w1a kernel: [74976.774349] BUG: unable to handle kernel paging request at ffffffffffffffd8 Write failed: Broken pipe root@backup03 ~ #