kernel BUG at mm/migrate.c:663 on 6.8.0-1009-aws #9-Ubuntu

[Ariel E]

We are getting the following messages in dmesg:
```
[359194.763852] kernel BUG at mm/migrate.c:663!
[359194.767140] invalid opcode: 0000 [#1] SMP NOPTI
[359194.770426] CPU: 112 PID: 2260980 Comm: memclean Tainted: P O L 6.8.0-1009-aws #9-Ubuntu
[359194.776735] Hardware name: Amazon EC2 u-12tb1.112xlarge/, BIOS 1.0 10/16/2017
[359194.782789] RIP: 0010:migrate_folio_extra+0x86/0x90
[359194.786501] Code: 31 ff 45 31 c0 c3 cc cc cc cc e8 35 d5 ff ff 44 89 e8 5b 41 5c 41 5d 41 5e 5d 31 d2 31 c9 31 f6 31 ff 45 31 c0 c3 cc cc cc cc <0f> 0b 90 0f 1f 80 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90
[359194.797861] RSP: 0018:ffffb86108a7b9b0 EFLAGS: 00010202
[359194.801321] RAX: 0017ffffe000010b RBX: fffff1d2c813fc00 RCX: 0000000000000002
[359194.807051] RDX: fffff1d2c813fc00 RSI: fffff1d60f12c780 RDI: ffff9541535953e0
[359194.812679] RBP: ffffb86108a7b9d8 R08: 0000000000000000 R09: ffffb86108a7ba60
[359194.818816] R10: 0000000000000000 R11: 0000000000000000 R12: ffff9541535953e0
[359194.825429] R13: 0000000000000002 R14: fffff1d60f12c780 R15: ffffb86108a7bc10
[359194.890548] FS: 00007a6ed99d3740(0000) GS:ffff9cb771600000(0000) knlGS:0000000000000000
[359194.896525] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[359194.900332] CR2: 000071d3c83fe000 CR3: 0000018b946c2003 CR4: 00000000007706f0
[359194.906216] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[359194.911922] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[359194.917705] PKRU: 55555554
[359194.920380] Call Trace:
[359194.923041] <TASK>
[359194.925534] ? show_regs+0x6d/0x80
[359194.928429] ? die+0x37/0xa0
[359194.931476] ? do_trap+0xd4/0xf0
[359194.934539] ? do_error_trap+0x71/0xb0
[359194.937621] ? migrate_folio_extra+0x86/0x90
[359194.940788] ? exc_invalid_op+0x52/0x80
[359194.943812] ? migrate_folio_extra+0x86/0x90
[359194.946975] ? asm_exc_invalid_op+0x1b/0x20
[359194.950130] ? migrate_folio_extra+0x86/0x90
[359194.953265] ? move_to_new_folio+0x158/0x170
[359194.956424] migrate_pages_batch+0x5ff/0x940
[359194.959661] ? __pfx_compaction_free+0x10/0x10
[359194.963228] ? __pfx_remove_migration_pte+0x10/0x10
[359194.967014] migrate_pages_sync+0x130/0x1e0
[359194.970488] ? __pfx_compaction_free+0x10/0x10
[359194.974061] ? __pfx_compaction_alloc+0x10/0x10
[359194.977419] migrate_pages+0x3c0/0x4a0
[359194.980470] ? __pfx_compaction_free+0x10/0x10
[359194.983757] ? __pfx_compaction_alloc+0x10/0x10
[359194.987134] compact_zone+0x2ea/0x600
[359194.990426] compact_node+0x8d/0xe0
[359194.993577] sysctl_compaction_handler+0x5d/0xb0
[359194.996898] proc_sys_call_handler+0x1df/0x300
[359195.000114] proc_sys_write+0x13/0x20
[359195.003073] vfs_write+0x288/0x440
[359195.005989] ksys_write+0x73/0x100
[359195.008898] __x64_sys_write+0x19/0x30
[359195.012177] x64_sys_call+0x7e/0x25c0
[359195.015531] do_syscall_64+0x7f/0x180
[359195.018748] ? exc_page_fault+0x94/0x190
[359195.021941] entry_SYSCALL_64_after_hwframe+0x78/0x80
[359195.025346] RIP: 0033:0x7a6ed971c574
[359195.028304] Code: c7 00 16 00 00 00 b8 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 80 3d d5 ea 0e 00 00 74 13 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 54 c3 0f 1f 00 55 48 89 e5 48 83 ec 20 48 89
[359195.039738] RSP: 002b:00007fff1eab2b58 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[359195.046311] RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007a6ed971c574
[359195.052254] RDX: 0000000000000002 RSI: 000061390d1006f0 RDI: 0000000000000001
[359195.057968] RBP: 00007fff1eab2b80 R08: 00007a6ed9803b20 R09: 0000000000000410
[359195.063960] R10: 0000000000000001 R11: 0000000000000202 R12: 0000000000000002
[359195.070291] R13: 000061390d1006f0 R14: 00007a6ed98045c0 R15: 00007a6ed9801ee0
[359195.076175] </TASK>
[359195.078671] Modules linked in: rpcsec_gss_krb5 nfsv4 nfs netfs netlink_diag nfsd auth_rpcgss nfs_acl lockd grace xt_tcpudp xt_conntrack nft_chain_nat xt_MASQUERADE nf_nat nf_conntrack_netlink nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 xfrm_user xfrm_algo xt_addrtype nft_compat nf_tables libcrc32c br_netfilter bridge stp llc tls wireguard curve25519_x86_64 libchacha20poly1305 chacha_x86_64 poly1305_x86_64 ip6_udp_tunnel udp_tunnel libcurve25519_generic libchacha overlay sunrpc binfmt_misc ppdev crct10dif_pclmul nls_iso8859_1 crc32_pclmul polyval_clmulni polyval_generic ghash_clmulni_intel raid0 sha256_ssse3 sha1_ssse3 aesni_intel crypto_simd parport_pc cryptd zfs(PO) parport psmouse spl(O) ena input_leds serio_raw dm_multipath nvme_fabrics efi_pstore nfnetlink ip_tables x_tables autofs4
[359195.119058] ---[ end trace 0000000000000000 ]---
[359195.122595] RIP: 0010:migrate_folio_extra+0x86/0x90
[359195.126023] Code: 31 ff 45 31 c0 c3 cc cc cc cc e8 35 d5 ff ff 44 89 e8 5b 41 5c 41 5d 41 5e 5d 31 d2 31 c9 31 f6 31 ff 45 31 c0 c3 cc cc cc cc <0f> 0b 90 0f 1f 80 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90
[359195.137005] RSP: 0018:ffffb86108a7b9b0 EFLAGS: 00010202
[359195.140522] RAX: 0017ffffe000010b RBX: fffff1d2c813fc00 RCX: 0000000000000002
[359195.146339] RDX: fffff1d2c813fc00 RSI: fffff1d60f12c780 RDI: ffff9541535953e0
[359195.152712] RBP: ffffb86108a7b9d8 R08: 0000000000000000 R09: ffffb86108a7ba60
[359195.159039] R10: 0000000000000000 R11: 0000000000000000 R12: ffff9541535953e0
[359195.164903] R13: 0000000000000002 R14: fffff1d60f12c780 R15: ffffb86108a7bc10
[359195.170711] FS: 00007a6ed99d3740(0000) GS:ffff9cb771600000(0000) knlGS:0000000000000000
[359195.176783] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[359195.180704] CR2: 000071d3c83fe000 CR3: 0000018b946c2003 CR4: 00000000007706f0
[359195.186580] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[359195.192261] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[359195.198053] PKRU: 55555554
[370972.279917] audit: type=1400 audit(1718081003.248:14155): apparmor="DENIED" operation="change_onexec" class="file" info="label not found" error=-2 profile="unconfined" name="ubuntu_pro_apt_news" pid=2372118 comm="(python3)"
[370972.338154] audit: type=1400 audit(1718081003.306:14156): apparmor="DENIED" operation="change_onexec" class="file" info="label not found" error=-2 profile="unconfined" name="ubuntu_pro_esm_cache" pid=2372119 comm="(python3)"
[379428.118372] perf: interrupt took too long (19671 > 19630), lowering kernel.perf_event_max_sample_rate to 10000
[379428.674625] perf: interrupt took too long (24599 > 24588), lowering kernel.perf_event_max_sample_rate to 8000
[379432.729582] WARNING: kernel stack frame pointer at 00000000deb68ab7 in z_wr_iss:891234 has bad value 0000000025fda466
[379432.729600] unwind stack type:0 next_sp:0000000000000000 mask:0x2 graph_idx:0
[379432.729603] 00000000184ad90a: ffffb8605191f3d8 (0xffffb8605191f3d8)
[379432.729653] 000000009c550c6b: ffffffffc141e14e (LZ4_readLE16+0x1e/0x40 [zfs])
[379432.731631] 000000008e0f0754: ffff9cefe6751fe5 (0xffff9cefe6751fe5)
[379432.731647] 00000000c0edb14a: ffffb8605191f468 (0xffffb8605191f468)
[379432.731651] 00000000fc0082bf: ffffffffc141e617 (LZ4_uncompress_unknownOutputSize+0x467/0x940 [zfs])
[379432.732206] 000000000b9a82c1: 00042c2000001000 (0x42c2000001000)
[379432.732220] 000000000e6adb58: 0000000000000000 ...
[379432.732222] 00000000a32eaf6f: ffffb8605191f988 (0xffffb8605191f988)
[379432.732226] 00000000ed964405: b6d50b96074dce46 (0xb6d50b96074dce46)
[379432.732229] 000000002308c685: 4dd6fccb0ee1952b (0x4dd6fccb0ee1952b)
[379432.732233] 000000003067191a: 5ddd84b06ca861b3 (0x5ddd84b06ca861b3)
[379432.732237] 0000000052078169: e3615de38f6fd3fd (0xe3615de38f6fd3fd)
[379432.732241] 000000005ebc3b2d: df09ab7f092ba5df (0xdf09ab7f092ba5df)
[379432.732244] 0000000068431cc4: 1d3551549445ee24 (0x1d3551549445ee24)
[379432.732248] 00000000e3301ee8: 48f7b5014bdc9c52 (0x48f7b5014bdc9c52)
[379432.732252] 00000000f424f020: 3b453a7cb90d0203 (0x3b453a7cb90d0203)
[379432.732255] 0000000037e228a0: 8b0b392d1c480a14 (0x8b0b392d1c480a14)
[379432.732258] 0000000035a7528e: 300413ca068dc723 (0x300413ca068dc723)
[379432.732262] 00000000c6ea461f: 261f6f5c0bb75290 (0x261f6f5c0bb75290)
[379432.732265] 00000000adbcde70: fd3b657cfa326021 (0xfd3b657cfa326021)
[379432.732268] 00000000ee9c73b5: 7364c70e09d2278f (0x7364c70e09d2278f)
[379432.732272] 00000000deb68ab7: 5d64efbeb6f4e7b2 (0x5d64efbeb6f4e7b2)
[379432.732276] 000000009faab794: a6e32b15c8c7c2bb (0xa6e32b15c8c7c2bb)
[379432.732279] 0000000034a1dd7c: f72f0bdaa9158a76 (0xf72f0bdaa9158a76)
[379432.732282] 000000005c716c73: 7372d3db9805c655 (0x7372d3db9805c655)
[379432.732285] 00000000c15246d9: ad42b4518a5282f3 (0xad42b4518a5282f3)
[379432.732289] 00000000b6a9885f: e2b9442da68e4a4f (0xe2b9442da68e4a4f)
[379432.732292] 000000006f449e17: e5874f45974c0b91 (0xe5874f45974c0b91)
[379432.732296] 00000000dbd852aa: 123d8d6ec5966824 (0x123d8d6ec5966824)
[379432.732300] 00000000dd94fb98: ed6b4a109d61d4ae (0xed6b4a109d61d4ae)
[379432.732304] 000000001abb2478: c4027da9a2846e90 (0xc4027da9a2846e90)
[379432.732308] 000000003d6cc4ad: f00c0897d354d1e4 (0xf00c0897d354d1e4)
[379432.732312] 000000000b1c0c71: de3945d1f6609bb2 (0xde3945d1f6609bb2)
[379432.732316] 0000000052c60cea: 5454a6fc84df0705 (0x5454a6fc84df0705)
[379432.732333] 000000006dcbe357: 870e1055b72e0a30 (0x870e1055b72e0a30)
[379432.732336] 0000000021d86afb: 6bf7b386da926793 (0x6bf7b386da926793)
[379432.732339] 00000000b9571f8e: c23630e49990f353 (0xc23630e49990f353)
[379432.732343] 00000000be232cd3: f6e2a026df69a597 (0xf6e2a026df69a597)
[379432.732346] 000000003f85868f: 55463088b4f27d3f (0x55463088b4f27d3f)
[379432.732349] 000000005b8d3bfe: 5adfa14974071df7 (0x5adfa14974071df7)
[379432.732352] 000000005f222e1a: 6bb6ef4841f5bdf2 (0x6bb6ef4841f5bdf2)
[379432.732355] 00000000df6ceb8c: 6f3054acb5ffb325 (0x6f3054acb5ffb325)
[379432.732359] 0000000043e7e075: d3fc0f7912ea9623 (0xd3fc0f7912ea9623)
[379432.732362] 000000006d3fc676: 01250077e6cad80b (0x1250077e6cad80b)
[379432.732365] 00000000e4fa557b: 68befaf81eeb21f7 (0x68befaf81eeb21f7)
[379432.732368] 000000000dba7d0a: 029e2f1f6df79957 (0x29e2f1f6df79957)
[379432.732372] 00000000e56f0b84: 716f9aa4beb9e4d2 (0x716f9aa4beb9e4d2)
[379432.732375] 00000000e50d002f: 61d84cc5abe9339f (0x61d84cc5abe9339f)
[379432.732379] 000000007bab1fae: 522a57c9234c1b22 (0x522a57c9234c1b22)
[379432.732382] 00000000b2b11287: 16085f143c8db058 (0x16085f143c8db058)
[379432.732386] 000000000e7479d4: 9be6637eb41ce686 (0x9be6637eb41ce686)
[379432.732389] 00000000be92b555: daed31adc50eed68 (0xdaed31adc50eed68)
[379432.732392] 000000009a9debf4: 5030fb8504a5b9db (0x5030fb8504a5b9db)
[379432.732395] 00000000d334440d: e5af4298bc70db58 (0xe5af4298bc70db58)
[379432.732399] 000000000b1bbdbd: f4e5c63347b61e6f (0xf4e5c63347b61e6f)
[379432.732402] 0000000088b50381: 5cf28b7fe38cfc0d (0x5cf28b7fe38cfc0d)
[379432.732405] 00000000f9449901: 12839614d807ebcd (0x12839614d807ebcd)
[379432.732409] 000000009b7aa357: 570caf1d2431a0d4 (0x570caf1d2431a0d4)
[379432.732411] 000000005b6acf7c: 12838711d80888f6 (0x12838711d80888f6)
[379432.732415] 0000000068ad5ec0: 550c91ab24326ab4 (0x550c91ab24326ab4)
[379432.732418] 00000000173ce311: 80df902372bf44c2 (0x80df902372bf44c2)
[379432.732421] 00000000b4d13bfa: c29c13779bdc18ea (0xc29c13779bdc18ea)
[379432.732425] 000000001d2dee60: 80debf0c72bf26b8 (0x80debf0c72bf26b8)
[379432.732428] 000000006695dd3a: c19ce4e19cdc8164 (0xc19ce4e19cdc8164)
[379432.732431] 0000000085235d0e: 713749aa428a8539 (0x713749aa428a8539)
[379432.732435] 00000000aba61af5: e9b65486b5c17878 (0xe9b65486b5c17878)
[379432.732438] 000000001dccf7f2: 7137ce70438a4f67 (0x7137ce70438a4f67)
[379432.732442] 0000000094b9db1a: e9b6c9b1b5c15cfd (0xe9b6c9b1b5c15cfd)
[379432.732444] 00000000775e8c68: 59f1909b3957817f (0x59f1909b3957817f)
[379432.732448] 0000000006c07985: ab1c911a933fed47 (0xab1c911a933fed47)
[379432.732452] 000000007bc4f67f: 59f1c10139573335 (0x59f1c10139573335)
[379432.732455] 00000000ae3053c1: ad1cce18943f96cf (0xad1cce18943f96cf)
[379432.732459] 000000004facf59f: ffffb8605191faf0 (0xffffb8605191faf0)
[379432.732462] 00000000173f95ef: ffffb8625f2bd000 (0xffffb8625f2bd000)
[379432.732465] 00000000d9d67ba2: ffffb8625f2dd000 (0xffffb8625f2dd000)
[379432.732469] 000000000a856604: ffffb8605191f988 (0xffffb8605191f988)
[379432.732472] 00000000b3edd4e6: ffffb8605191f630 (0xffffb8605191f630)
[379432.732475] 000000004d842204: ffffffffc13a1749 (__raw_spin_unlock+0x9/0x20 [zfs])
[379432.732971] 000000001eadfe6c: ffffb8605191f678 (0xffffb8605191f678)
[379432.732986] 00000000f64745d8: ffffffffc13a594e (dbuf_rele_and_unlock+0x1ae/0x3c0 [zfs])
[379432.733542] 00000000f9034ba6: ffffb8605191f688 (0xffffb8605191f688)
[379432.733551] 0000000073cdc897: ffffffffc138f863 (arc_buf_alloc_impl+0x1b3/0x220 [zfs])
[379432.734042] 00000000193eb086: ffff9bf834344f50 (0xffff9bf834344f50)
[379432.734053] 000000004290414f: ffff9b486f9114e0 (0xffff9b486f9114e0)
[379432.734057] 000000007d4d078a: ffff9bf834344ff8 (0xffff9bf834344ff8)
[379432.734060] 00000000b20ed5e8: ffffffffc15ffa90 (buf_hash_table+0x1990/0xfffffffffffb0f00 [zfs])
[379432.734648] 00000000826ebe3e: ffffb8605191f7e8 (0xffffb8605191f7e8)
[379432.734659] 00000000a96d4b34: ffffffffc15ffab0 (buf_hash_table+0x19b0/0xfffffffffffb0f00 [zfs])
[379432.735178] 00000000fb1160fc: 0000000000000000 ...
[379432.735181] 00000000bace395d: ffffffffc15ffa90 (buf_hash_table+0x1990/0xfffffffffffb0f00 [zfs])
[379432.735699] 0000000035e7af30: ffffb8605191f7e8 (0xffffb8605191f7e8)
[379432.735709] 0000000091b55081: ffffb8605191f780 (0xffffb8605191f780)
[379432.735712] 00000000b128b8b7: ffffffffc13906c9 (arc_read+0x819/0x1710 [zfs])
[379432.736219] 00000000ed33ac8b: 0000000000000012 (0x12)
[379432.736229] 00000000d60aaa66: 0000000000000000 ...
[379432.736230] 0000000055e2480f: ffff9bf834344f50 (0xffff9bf834344f50)
[379432.736233] 00000000f45f9d51: 0000000000080000 (0x80000)
[379432.736237] 0000000065379c4d: ffff9fc1f3222f80 (0xffff9fc1f3222f80)
[379432.736240] 00000000d6d8e91d: ffffffffc13a5b70 (__pfx_dbuf_read_done+0x10/0x10 [zfs])
[379432.736677] 000000002685bd29: 0000000000000000 ...
[379432.736679] 00000000c289a9cd: ffffffff835997d2 (osq_lock+0x92/0x160)
[379432.736687] 00000000bed97964: ffffb8605191f7c8 (0xffffb8605191f7c8)
[379432.736696] 000000001ad632ed: 0000008001290029 (0x8001290029)
[379432.736699] 00000000a3409501: ffff9a03c3a083b8 (0xffff9a03c3a083b8)
[379432.736703] 0000000096f9213b: ffff9a03c3a083c4 (0xffff9a03c3a083c4)
[379432.736707] 000000009ee859eb: ffffb8605191f790 (0xffffb8605191f790)
[379432.736710] 00000000c332e454: ffffffffc130aad4 (cityhash4+0x94/0xb0 [zfs])
[379432.737119] 00000000fc4c6bd8: 00000000001e83c5 (0x1e83c5)
[379432.737128] 00000000e6e316d2: 0000000000000202 (0x202)
[379432.737132] 0000000056a4db78: ffffffffc130aad4 (cityhash4+0x94/0xb0 [zfs])
[379432.737541] 000000009b8e01d3: 0000000000000000 ...
[379432.737542] 000000001a02e0d2: ffffffffc16164c0 (__key.0+0x30/0xfffffffffff98b70 [zfs])
[379432.738024] 00000000848489cd: ffffffffc142c4cd (__list_del_entry+0x1d/0x30 [zfs])
[379432.738474] 00000000729185d7: ffff95c68a4a6f48 (0xffff95c68a4a6f48)
[379432.738487] 0000000064aabd05: ffffffffc130aad4 (cityhash4+0x94/0xb0 [zfs])
[379432.738905] 000000005e155806: 000000000021a778 (0x21a778)
[379432.738913] 00000000ee276f6e: 0000000000000212 (0x212)
[379432.738917] 00000000449afdb5: ffffffffc130aad4 (cityhash4+0x94/0xb0 [zfs])
[379432.739341] 000000000243f0a4: 0000000000000000 ...
[379432.739342] 000000000af7e786: ffffffffc16164c0 (__key.0+0x30/0xfffffffffff98b70 [zfs])
[379432.739811] 000000004b7faabb: ffffffffc142c4cd (__list_del_entry+0x1d/0x30 [zfs])
[379432.740280] 000000007789ed02: ffff9bf8343450a8 (0xffff9bf8343450a8)
[379432.740290] 000000008ded60e2: ffffb8605191f7b0 (0xffffb8605191f7b0)
[379432.740294] 00000000cf60fde1: ffffffffc142c4fd (list_del+0xd/0x30 [zfs])
[379432.740762] 000000002a2f96d1: ffff9b42ebd53b80 (0xffff9b42ebd53b80)
[379432.740772] 00000000712e774d: ffffb8605191f7c0 (0xffffb8605191f7c0)
[379432.740775] 00000000e79785b5: ffffffffc142c599 (do_raw_spin_unlock+0x9/0x20 [zfs])
[379432.741221] 00000000567e0ef5: 0000000000000293 (0x293)
[379432.741230] 00000000f069fa7f: 0000000000000000 ...
[379432.741232] 000000005ecdf1ff: fffffffffffff000 (0xfffffffffffff000)
[379432.741237] 0000000064d6452b: ffffb8605191f7e8 (0xffffb8605191f7e8)
[379432.741240] 000000008cca6e5c: ffffffffc13a1719 (do_raw_spin_unlock+0x9/0x20 [zfs])
[379432.741661] 000000006b321621: ffffb8605191f7f8 (0xffffb8605191f7f8)
[379432.741670] 00000000ea459600: ffffffffc13a1749 (__raw_spin_unlock+0x9/0x20 [zfs])
[379432.742140] 00000000f11e6649: ffffb8605191f878 (0xffffb8605191f878)
[379432.742151] 00000000d196240b: ffffffffc13a8b0e (dbuf_hold_impl+0x10e/0x7b0 [zfs])
[379432.742594] 00000000eb42ce7b: ffffffffc142c43c (list_add+0xc/0x20 [zfs])
[379432.742979] 000000004c3eb041: ffffb8605191f820 (0xffffb8605191f820)
[379432.742986] 00000000945e7e67: ffffffffc142c599 (do_raw_spin_unlock+0x9/0x20 [zfs])
[379432.743359] 00000000ea14e682: 0000000000000000 ...
[379432.743360] 00000000dc3561b6: 0000000000000246 (0x246)
[379432.743365] 000000005f2ba759: 000000000000000a (0xa)
[379432.743367] 000000003a76cb9d: ffff9bf834344ff8 (0xffff9bf834344ff8)
[379432.743371] 000000007ad61f3a: ffff9bf834345018 (0xffff9bf834345018)
[379432.743374] 00000000ed258245: ffffffff84611dba (__cond_resched+0x1a/0x60)
[379432.743381] 00000000043485ab: 0000000000042c00 (0x42c00)
[379432.743383] 00000000b996d05d: ffffb8605191f8c0 (0xffffb8605191f8c0)
[379432.743386] 0000000039d20206: ffffffff838502e0 (__kmalloc_node+0x1c0/0x4c0)
[379432.743395] 000000001928a5e9: 0000000000000000 ...
[379432.743396] 00000000836157c7: ffffffffc139e6b7 (bmov+0x17/0x30 [zfs])
[379432.743735] 0000000017b627ab: ffffb8605191f890 (0xffffb8605191f890)
[379432.743740] 00000000ff2c8aed: ffffffffc139e71f (bt_shift_leaf+0x3f/0x70 [zfs])
[379432.744106] 000000005fe3966d: ffffb8605191f8d8 (0xffffb8605191f8d8)
[379432.744112] 0000000097c6d6cd: ffffffffc139e866 (bt_grow_leaf+0x106/0x110 [zfs])
[379432.744463] 00000000eecbe595: ffff9bf834344f50 (0xffff9bf834344f50)
[379432.744467] 000000001a04813c: ffffffffc142c3f7 (__list_add+0x17/0x40 [zfs])
[379432.744828] 00000000b85bad2a: 00000000000001cb (0x1cb)
[379432.744833] 00000000838386cf: ffff96c75ffa3000 (0xffff96c75ffa3000)
[379432.744836] 0000000082f3cbee: ffffb8605191fa98 (0xffffb8605191fa98)
[379432.744839] 0000000001851db2: 0000000000000008 (0x8)
[379432.744842] 000000004656f5c0: ffffffffc139ea67 (bcpy+0x17/0x30 [zfs])
[379432.745217] 0000000099369b69: ffffb8605191f908 (0xffffb8605191f908)
[379432.745222] 00000000428a903f: ffffffffc139eb2f (zfs_btree_insert_leaf_impl+0x3f/0x60 [zfs])
[379432.745584] 000000006ca4c755: ffff9fbe889584f8 (0xffff9fbe889584f8)
[379432.745590] 000000001e38d0eb: 00000000000001fe (0x1fe)
[379432.745592] 000000009b54116b: ffffb8605191fa98 (0xffffb8605191fa98)
[379432.745597] 0000000069142c1a: ffff9fbe88963800 (0xffff9fbe88963800)
[379432.745600] 000000009fa20888: ffffb8605191f968 (0xffffb8605191f968)
[379432.745603] 0000000063e46a9a: ffffffffc139f7c1 (zfs_btree_insert_into_leaf+0x231/0x2c0 [zfs])
[379432.745970] 00000000c44e04e6: ffff983e4d322328 (0xffff983e4d322328)
[379432.745976] 00000000c2f341a0: ffffb8605191f98c (0xffffb8605191f98c)
[379432.745979] 00000000923d58a1: ffffb86000000000 (0xffffb86000000000)
[379432.745982] 0000000039d1d007: ffffb8605191fa98 (0xffffb8605191fa98)
[379432.745985] 00000000e1281e42: 0000000000000008 (0x8)
[379432.745987] 00000000eaf00be8: ffff9fbe889584f8 (0xffff9fbe889584f8)
[379432.745990] 00000000ffee5bfe: ffffb8605191f9e8 (0xffffb8605191f9e8)
[379432.745993] 000000003d854bac: ffffb8605191fa98 (0xffffb8605191fa98)
[379432.745995] 00000000d8735fcb: 0000000000000000 ...
[379432.745997] 000000008a20479e: ffffb8625f2bd000 (0xffffb8625f2bd000)
[379432.746000] 000000007a2c235f: 0000000000000800 (0x800)
[379432.746002] 00000000df443331: ffffb8625f2bd000 (0xffffb8625f2bd000)
[379432.746005] 00000000cd29b8b2: ffffb8605191f9a8 (0xffffb8605191f9a8)
[379432.746007] 00000000046a48d8: ffffb8605191faf0 (0xffffb8605191faf0)
[379432.746010] 00000000a1200b1c: ffffffffc12d0995 (tf_sha256_avx2+0x25/0x40 [zfs])
[379432.746314] 00000000cbb0fbdb: 0000000000020000 (0x20000)
[379432.746319] 000000005970e9dc: ffffb8605191faf0 (0xffffb8605191faf0)
[379432.746322] 00000000e3b6bdb9: 0000000000000000 ...
[379432.746324] 0000000048749891: ffffb8605191fa10 (0xffffb8605191fa10)
[379432.746326] 00000000ddf79611: ffffffffc12cfac4 (sha256_update+0x164/0x230 [zfs])
[379432.746637] 000000000dd49e3a: 0000000000000286 (0x286)
[379432.746643] 0000000002b27877: 0000000000000000 ...
[379432.746644] 00000000961626a6: 0000000000000040 (0x40)
[379432.746647] 00000000104cd05e: fffff1dd4b09db01 (0xfffff1dd4b09db01)
[379432.746650] 00000000816bf598: 0000000000000800 (0x800)
[379432.746652] 00000000c974803d: ffffb8605191fb20 (0xffffb8605191fb20)
[379432.746655] 00000000087de167: 0000000000020000 (0x20000)
[379432.746658] 00000000389e5308: ffffb8605191fa60 (0xffffb8605191fa60)
[379432.746661] 00000000505af354: 0000000000000000 ...
[379432.746664] 000000005afef1ce: 0000000000020000 (0x20000)
[379432.746666] 000000003ff11fd6: 0000000000000000 ...
```

ProblemType: Bug
DistroRelease: Ubuntu 24.04
Package: linux-image-6.8.0-1009-aws 6.8.0-1009.9
ProcVersionSignature: Ubuntu 6.8.0-1009.9-aws 6.8.4
Uname: Linux 6.8.0-1009-aws x86_64
NonfreeKernelModules: zfs
ApportVersion: 2.28.1-0ubuntu3
Architecture: amd64
CasperMD5CheckResult: unknown
CloudArchitecture: x86_64
CloudBuildName: server
CloudID: aws
CloudName: aws
CloudPlatform: ec2
CloudRegion: us-east-1
CloudSerial: 20220912
CloudSubPlatform: metadata (http://169.254.169.254)
Date: Tue Jun 11 10:21:31 2024
Ec2Architecture: x86_64
Ec2Imageid: ami-08c40ec9ead489470
Ec2Instancetype: u-12tb1.112xlarge
Ec2Region: us-east-1
ProcEnviron:
 LANG=C.UTF-8
 LC_CTYPE=C.UTF-8
 PATH=(custom, no user)
 SHELL=/bin/bash
 TERM=xterm-256color
SourcePackage: linux-signed-aws
UpgradeStatus: Upgraded to noble on 2024-06-06 (4 days ago)

[Matthew Ruffell (mruffell)]

Hi Ariel,

Are you using zfs? I see you have the module listed.

Your oops looks very similar to this discussion here:

https://github.com/openzfs/zfs/issues/15140

It doesn't seem anyone has come to any conclusions yet. I'll do some more research.

Thanks,
Matthew