System crashes in kswapd0 with kernel BUG at fs/inode.c:534

[Geoff Silver]

I've been getting regular systems crashes for the last few months. Because it was being triggered in kswapd0 I recently disabled swap completed, but the issue still continues. I also moved swap to another disk but again the problem persists several times per week. No other changes other than periodic ubuntu security updates.

root@nas:/# uname -a
Linux nas 5.15.0-94-generic #104-Ubuntu SMP Tue Jan 9 15:25:40 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

root@nas:/# lsb_release -rd
Description: Ubuntu 22.04.3 LTS
Release: 22.04

root@nas:/# cat /proc/version_signature
Ubuntu 5.15.0-94.104-generic 5.15.136

Jan 29 12:42:44 nas kernel: [589525.766990] ------------[ cut here ]------------
Jan 29 12:42:44 nas kernel: [589525.766992] kernel BUG at fs/inode.c:534!
Jan 29 12:42:44 nas kernel: [589525.767008] invalid opcode: 0000 [#1] SMP NOPTI
Jan 29 12:42:44 nas kernel: [589525.767019] CPU: 5 PID: 134 Comm: kswapd0 Not tainted 5.15.0-94-generic #104-Ubuntu
Jan 29 12:42:44 nas kernel: [589525.767036] Hardware name: Gigabyte Technology Co., Ltd. Z390 GAMING X/Z390 GAMING X-CF, BIOS F6 12/04/2018
Jan 29 12:42:44 nas kernel: [589525.767055] RIP: 0010:clear_inode+0x82/0x90
Jan 29 12:42:44 nas kernel: [589525.767067] Code: 40 75 2d 48 8b 93 28 01 00 00 48 8d 83 28 01 00 00 48 39 c2 75 1c 48 c7 83 98 00 00 00 60 00 00 00 5b
41 5c 5d c3 cc cc cc cc <0f> 0b 0f 0b 0f 0b 0f 0b 0f 0b 0f 1f 40 00 0f 1f 44 00 00 55 48 89
Jan 29 12:42:44 nas kernel: [589525.767102] RSP: 0018:ffffaec4c0d8fac0 EFLAGS: 00010006
Jan 29 12:42:44 nas kernel: [589525.767114] RAX: 0000000000000000 RBX: ffff8a7bd5497cc0 RCX: ffff8a7bd5497a08
Jan 29 12:42:44 nas kernel: [589525.767129] RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffff8a7bd5497e40
Jan 29 12:42:44 nas kernel: [589525.767143] RBP: ffffaec4c0d8fad0 R08: ffffffffc0af594e R09: ffff8a7960377538
Jan 29 12:42:44 nas kernel: [589525.767158] R10: 0000000000000000 R11: 00000000067b8400 R12: ffff8a7bd5497e40
Jan 29 12:42:44 nas kernel: [589525.767173] R13: ffff8a7bd5497dd8 R14: ffff8a795576f070 R15: 0000000000020c03
Jan 29 12:42:44 nas kernel: [589525.767187] FS: 0000000000000000(0000) GS:ffff8a80de540000(0000) knlGS:0000000000000000
Jan 29 12:42:44 nas kernel: [589525.767204] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 29 12:42:44 nas kernel: [589525.767216] CR2: 00007fdff1f00000 CR3: 0000000416810003 CR4: 00000000003706e0
Jan 29 12:42:44 nas kernel: [589525.767230] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jan 29 12:42:44 nas kernel: [589525.767244] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Jan 29 12:42:44 nas kernel: [589525.767259] Call Trace:
Jan 29 12:42:44 nas kernel: [589525.767266] <TASK>
Jan 29 12:42:44 nas kernel: [589525.767272] ? show_trace_log_lvl+0x1d6/0x2ea
Jan 29 12:42:44 nas kernel: [589525.767284] ? show_trace_log_lvl+0x1d6/0x2ea
Jan 29 12:42:44 nas kernel: [589525.767294] ? evict+0x17a/0x190
Jan 29 12:42:44 nas kernel: [589525.767302] ? show_regs.part.0+0x23/0x29
Jan 29 12:42:44 nas kernel: [589525.767312] ? __die_body.cold+0x8/0xd
Jan 29 12:42:44 nas kernel: [589525.767321] ? __die+0x2b/0x37
Jan 29 12:42:44 nas kernel: [589525.767329] ? die+0x30/0x60
Jan 29 12:42:44 nas kernel: [589525.767337] ? do_trap+0xbe/0x100
Jan 29 12:42:44 nas kernel: [589525.767346] ? do_error_trap+0x6f/0xb0
Jan 29 12:42:44 nas kernel: [589525.767354] ? clear_inode+0x82/0x90
Jan 29 12:42:44 nas kernel: [589525.767362] ? exc_invalid_op+0x53/0x70
Jan 29 12:42:44 nas kernel: [589525.767372] ? clear_inode+0x82/0x90
Jan 29 12:42:44 nas kernel: [589525.767380] ? asm_exc_invalid_op+0x1b/0x20
Jan 29 12:42:44 nas kernel: [589525.767391] ? xfs_inodegc_set_reclaimable+0xbe/0x110 [xfs]
Jan 29 12:42:44 nas kernel: [589525.767460] ? clear_inode+0x82/0x90
Jan 29 12:42:44 nas kernel: [589525.767945] evict+0x17a/0x190
Jan 29 12:42:44 nas kernel: [589525.768448] prune_icache_sb+0x81/0xc0
Jan 29 12:42:44 nas kernel: [589525.768952] super_cache_scan+0x169/0x200
Jan 29 12:42:44 nas kernel: [589525.769491] do_shrink_slab+0x155/0x2c0
Jan 29 12:42:44 nas kernel: [589525.769993] shrink_slab_memcg+0xcf/0x1e0
Jan 29 12:42:44 nas kernel: [589525.770494] shrink_slab+0x10a/0x120
Jan 29 12:42:44 nas kernel: [589525.770995] ? shrink_slab+0x10a/0x120
Jan 29 12:42:44 nas kernel: [589525.771492] shrink_node_memcgs+0x188/0x1d0
Jan 29 12:42:44 nas kernel: [589525.771986] shrink_node+0x16e/0x600
Jan 29 12:42:44 nas kernel: [589525.772480] balance_pgdat+0x36e/0x810
Jan 29 12:42:44 nas kernel: [589525.772972] ? finish_task_switch.isra.0+0x7e/0x280
Jan 29 12:42:44 nas kernel: [589525.773508] kswapd+0x10c/0x1c0
Jan 29 12:42:44 nas kernel: [589525.773996] ? balance_pgdat+0x810/0x810
Jan 29 12:42:44 nas kernel: [589525.774487] kthread+0x127/0x150
Jan 29 12:42:44 nas kernel: [589525.774978] ? set_kthread_struct+0x50/0x50
Jan 29 12:42:44 nas kernel: [589525.775467] ret_from_fork+0x1f/0x30
Jan 29 12:42:44 nas kernel: [589525.775955] </TASK>
Jan 29 12:42:44 nas kernel: [589525.776433] Modules linked in: tls xt_conntrack nft_chain_nat xt_MASQUERADE nf_nat nf_conntrack_netlink nf_conntrack nf_
defrag_ipv6 nf_defrag_ipv4 xfrm_user xfrm_algo xt_addrtype br_netfilter bridge stp llc nvme_fabrics nvme_core ipt_REJECT nf_reject_ipv4 xt_multiport nft
_compat nft_counter nf_tables nfnetlink overlay binfmt_misc nls_iso8859_1 intel_rapl_msr snd_sof_pci_intel_cnl snd_hda_codec_hdmi snd_sof_intel_hda_comm
on soundwire_intel mei_hdcp soundwire_generic_allocation soundwire_cadence snd_sof_intel_hda snd_sof_pci snd_sof_xtensa_dsp snd_sof snd_soc_hdac_hda snd
_hda_ext_core snd_hda_codec_realtek snd_soc_acpi_intel_match snd_soc_acpi snd_hda_codec_generic soundwire_bus ledtrig_audio snd_soc_core intel_rapl_comm
on snd_compress intel_tcc_cooling ac97_bus snd_pcm_dmaengine x86_pkg_temp_thermal intel_powerclamp snd_hda_intel kvm_intel snd_intel_dspcfg snd_intel_sd
w_acpi snd_hda_codec kvm snd_hda_core rapl input_leds snd_hwdep intel_cstate snd_pcm gigabyte_wmi intel_wmi_thunderbolt
Jan 29 12:42:44 nas kernel: [589525.776465] wmi_bmof serio_raw ee1004 snd_timer snd soundcore mei_me mei intel_pch_thermal mac_hid acpi_pad sch_fq_code
l dm_multipath scsi_dh_rdac scsi_dh_emc scsi_dh_alua coretemp msr parport_pc ppdev lp parport efi_pstore ip_tables x_tables autofs4 xfs btrfs blake2b_ge
neric zstd_compress raid10 raid0 multipath linear raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 i915 i
2c_algo_bit ttm drm_kms_helper syscopyarea sysfillrect crct10dif_pclmul sysimgblt crc32_pclmul ghash_clmulni_intel fb_sys_fops aesni_intel cec crypto_si
md rc_core cryptd mpt3sas raid_class drm scsi_transport_sas ahci i2c_i801 xhci_pci e1000e i2c_smbus xhci_pci_renesas libahci wmi video pinctrl_cannonlak
e
Jan 29 12:42:44 nas kernel: [589525.783594] ---[ end trace 802dc8bb5ac8e009 ]---