OS: Ubuntu 5.15.0-73.80-generic 5.15.98 VERSION="22.04.2 LTS (Jammy Jellyfish)" Ubuntu Cloud
Background Disk: rbd KVM: Proxmox VE
[ 30.444138] loop4: detected capacity change from 0 to 8 [143428.917901] INFO: task kworker/u8:1:2954 blocked for more than 120 seconds. [143428.919516] Not tainted 5.15.0-73-generic #80-Ubuntu [143428.920692] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [143428.922329] task:kworker/u8:1 state:D stack: 0 pid: 2954 ppid: 2 flags:0x00004000 [143428.922342] Workqueue: writeback wb_workfn (flush-8:0) [143428.922381] Call Trace: [143428.922386] <TASK> [143428.922412] __schedule+0x24e/0x590 [143428.922439] schedule+0x69/0x110 [143428.922443] io_schedule+0x46/0x80 [143428.922446] ? wbt_cleanup_cb+0x20/0x20 [143428.922464] rq_qos_wait+0xd0/0x170 [143428.922473] ? wbt_rqw_done+0x110/0x110 [143428.922476] ? sysv68_partition+0x280/0x280 [143428.922480] ? wbt_cleanup_cb+0x20/0x20 [143428.922482] wbt_wait+0x9f/0xf0 [143428.922485] __rq_qos_throttle+0x28/0x40 [143428.922489] blk_mq_submit_bio+0x127/0x610 [143428.922496] __submit_bio+0x1ee/0x220 [143428.922503] ? mpage_release_unused_pages+0x219/0x240 [143428.922541] submit_bio_noacct+0xc0/0x120 [143428.922545] submit_bio+0x4a/0x130 [143428.922548] ext4_io_submit+0x4c/0x60 [143428.922553] ext4_writepages+0x231/0x880 [143428.922557] ? kvm_sched_clock_read+0x11/0x20 [143428.922573] ? raw_spin_rq_lock_nested+0x17/0x80 [143428.922587] ? newidle_balance+0x31d/0x470 [143428.922595] do_writepages+0xda/0x200 [143428.922605] ? mpage_map_and_submit_extent+0x4f0/0x4f0 [143428.922609] ? do_writepages+0xda/0x200 [143428.922611] ? psi_task_switch+0xc6/0x220 [143428.922617] ? raw_spin_rq_unlock+0x10/0x30 [143428.922619] ? finish_task_switch.isra.0+0x7e/0x280 [143428.922623] __writeback_single_inode+0x44/0x290 [143428.922630] writeback_sb_inodes+0x22a/0x4e0 [143428.922635] __writeback_inodes_wb+0x56/0xf0 [143428.922639] wb_writeback+0x1cc/0x290 [143428.922643] wb_do_writeback+0x1a0/0x280 [143428.922647] wb_workfn+0x77/0x260 [143428.922649] ? psi_task_switch+0xc6/0x220 [143428.922651] ? raw_spin_rq_unlock+0x10/0x30 [143428.922654] ? finish_task_switch.isra.0+0x7e/0x280 [143428.922657] process_one_work+0x22b/0x3d0 [143428.922662] worker_thread+0x53/0x420 [143428.922664] ? process_one_work+0x3d0/0x3d0 [143428.922666] kthread+0x12a/0x150 [143428.922681] ? set_kthread_struct+0x50/0x50 [143428.922685] ret_from_fork+0x22/0x30 [143428.922697] </TASK> [1162819.008697] loop4: detected capacity change from 0 to 129936 [1274712.829337] loop5: detected capacity change from 0 to 109072 [1274713.891842] kauditd_printk_skb: 21 callbacks suppressed
OS: 73.80-generic 5.15.98
Ubuntu 5.15.0-
VERSION="22.04.2 LTS (Jammy Jellyfish)"
Ubuntu Cloud
Background Disk: rbd
KVM: Proxmox VE
[ 30.444138] loop4: detected capacity change from 0 to 8 kernel/ hung_task_ timeout_ secs" disables this message. 0x24e/0x590 0x46/0x80 cb+0x20/ 0x20 wait+0xd0/ 0x170 done+0x110/ 0x110 partition+ 0x280/0x280 cb+0x20/ 0x20 throttle+ 0x28/0x40 submit_ bio+0x127/ 0x610 bio+0x1ee/ 0x220 unused_ pages+0x219/ 0x240 bio_noacct+ 0xc0/0x120 bio+0x4a/ 0x130 submit+ 0x4c/0x60 +0x231/ 0x880 clock_read+ 0x11/0x20 rq_lock_ nested+ 0x17/0x80 balance+ 0x31d/0x470 0xda/0x200 and_submit_ extent+ 0x4f0/0x4f0 0xda/0x200 switch+ 0xc6/0x220 rq_unlock+ 0x10/0x30 task_switch. isra.0+ 0x7e/0x280 single_ inode+0x44/ 0x290 sb_inodes+ 0x22a/0x4e0 inodes_ wb+0x56/ 0xf0 0x1cc/0x290 +0x1a0/ 0x280 0x77/0x260 switch+ 0xc6/0x220 rq_unlock+ 0x10/0x30 task_switch. isra.0+ 0x7e/0x280 one_work+ 0x22b/0x3d0 thread+ 0x53/0x420 one_work+ 0x3d0/0x3d0 struct+ 0x50/0x50 fork+0x22/ 0x30
[143428.917901] INFO: task kworker/u8:1:2954 blocked for more than 120 seconds.
[143428.919516] Not tainted 5.15.0-73-generic #80-Ubuntu
[143428.920692] "echo 0 > /proc/sys/
[143428.922329] task:kworker/u8:1 state:D stack: 0 pid: 2954 ppid: 2 flags:0x00004000
[143428.922342] Workqueue: writeback wb_workfn (flush-8:0)
[143428.922381] Call Trace:
[143428.922386] <TASK>
[143428.922412] __schedule+
[143428.922439] schedule+0x69/0x110
[143428.922443] io_schedule+
[143428.922446] ? wbt_cleanup_
[143428.922464] rq_qos_
[143428.922473] ? wbt_rqw_
[143428.922476] ? sysv68_
[143428.922480] ? wbt_cleanup_
[143428.922482] wbt_wait+0x9f/0xf0
[143428.922485] __rq_qos_
[143428.922489] blk_mq_
[143428.922496] __submit_
[143428.922503] ? mpage_release_
[143428.922541] submit_
[143428.922545] submit_
[143428.922548] ext4_io_
[143428.922553] ext4_writepages
[143428.922557] ? kvm_sched_
[143428.922573] ? raw_spin_
[143428.922587] ? newidle_
[143428.922595] do_writepages+
[143428.922605] ? mpage_map_
[143428.922609] ? do_writepages+
[143428.922611] ? psi_task_
[143428.922617] ? raw_spin_
[143428.922619] ? finish_
[143428.922623] __writeback_
[143428.922630] writeback_
[143428.922635] __writeback_
[143428.922639] wb_writeback+
[143428.922643] wb_do_writeback
[143428.922647] wb_workfn+
[143428.922649] ? psi_task_
[143428.922651] ? raw_spin_
[143428.922654] ? finish_
[143428.922657] process_
[143428.922662] worker_
[143428.922664] ? process_
[143428.922666] kthread+0x12a/0x150
[143428.922681] ? set_kthread_
[143428.922685] ret_from_
[143428.922697] </TASK>
[1162819.008697] loop4: detected capacity change from 0 to 129936
[1274712.829337] loop5: detected capacity change from 0 to 109072
[1274713.891842] kauditd_printk_skb: 21 callbacks suppressed