dpkg stalls and fails to complete update kernel times out

Bug #628047 reported by kylea on 2010-09-01
44
This bug affects 9 people
Affects Status Importance Assigned to Milestone
dpkg (Ubuntu)
Undecided
Unassigned

Bug Description

Binary package hint: dpkg

Description: Ubuntu 10.04.1 LTS - Server
Ubuntu 64bit 10.04 Server
Linux 2.6.32-24-generic #41-Ubuntu SMP Thu Aug 19 01:38:40 UTC 2010 x86_64 GNU/Linux

root partition is a LVM volume

Here are the fstab entry

/dev/mapper/itvss1-root / ext4 errors=remount-ro 0 1

# /boot was on /dev/sda1 during installation
UUID=b252807f-d51e-4c70-a9e8-5cfad5e52a18 /boot ext2 defaults 0 2

#/dev/mapper/itvss1-swap_1 none swap sw 0 0
/dev/mapper/cryptswap1 none swap sw 0 0

Try to apply an Update via Synaptic
Files are downloaded
Update starts and then stalls

Updates applied via apt-get or Synaptic fail - there is a Kernel timeout error in syslog with a Stack Trace

Aug 31 23:22:45 itvss1 kernel: [ 2281.420086] dpkg D 0000000000000000 0 24196 24133 0x00000000
Aug 31 23:22:45 itvss1 kernel: [ 2281.420090] ffff880168c87db8 0000000000000082 0000000000015bc0 0000000000015bc0
Aug 31 23:22:45 itvss1 kernel: [ 2281.420094] ffff88021a7931a0 ffff880168c87fd8 0000000000015bc0 ffff88021a792de0
Aug 31 23:22:45 itvss1 kernel: [ 2281.420097] 0000000000015bc0 ffff880168c87fd8 0000000000015bc0 ffff88021a7931a0
Aug 31 23:22:45 itvss1 kernel: [ 2281.420100] Call Trace:
Aug 31 23:22:45 itvss1 kernel: [ 2281.420109] [<ffffffff81166d80>] ? bdi_sched_wait+0x0/0x20
Aug 31 23:22:45 itvss1 kernel: [ 2281.420112] [<ffffffff81166d8e>] bdi_sched_wait+0xe/0x20
Aug 31 23:22:45 itvss1 kernel: [ 2281.420117] [<ffffffff815591df>] __wait_on_bit+0x5f/0x90
Aug 31 23:22:45 itvss1 kernel: [ 2281.420119] [<ffffffff81166d80>] ? bdi_sched_wait+0x0/0x20
Aug 31 23:22:45 itvss1 kernel: [ 2281.420122] [<ffffffff81559288>] out_of_line_wait_on_bit+0x78/0x90
Aug 31 23:22:45 itvss1 kernel: [ 2281.420126] [<ffffffff810850d0>] ? wake_bit_function+0x0/0x40
Aug 31 23:22:45 itvss1 kernel: [ 2281.420129] [<ffffffff81166d44>] ? bdi_queue_work+0xa4/0xe0
Aug 31 23:22:45 itvss1 kernel: [ 2281.420131] [<ffffffff811680ef>] bdi_sync_writeback+0x6f/0x80
Aug 31 23:22:45 itvss1 kernel: [ 2281.420134] [<ffffffff81168120>] sync_inodes_sb+0x20/0x30
Aug 31 23:22:45 itvss1 kernel: [ 2281.420137] [<ffffffff8116bc92>] __sync_filesystem+0x82/0x90
Aug 31 23:22:45 itvss1 kernel: [ 2281.420140] [<ffffffff8116bd79>] sync_filesystems+0xd9/0x130
Aug 31 23:22:45 itvss1 kernel: [ 2281.420142] [<ffffffff8116be31>] sys_sync+0x21/0x40
Aug 31 23:22:45 itvss1 kernel: [ 2281.420146] [<ffffffff810131b2>] system_call_fastpath+0x16/0x1b
Aug 31 23:24:45 itvss1 kernel: [ 2401.422564] INFO: task dpkg:24196 blocked for more than 120 seconds.
Aug 31 23:24:45 itvss1 kernel: [ 2401.422568] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Aug 31 23:24:45 itvss1 kernel: [ 2401.422570] dpkg D 0000000000000000 0 24196 24133 0x00000000
Aug 31 23:24:45 itvss1 kernel: [ 2401.422574] ffff880168c87db8 0000000000000082 0000000000015bc0 0000000000015bc0
Aug 31 23:24:45 itvss1 kernel: [ 2401.422578] ffff88021a7931a0 ffff880168c87fd8 0000000000015bc0 ffff88021a792de0
Aug 31 23:24:45 itvss1 kernel: [ 2401.422581] 0000000000015bc0 ffff880168c87fd8 0000000000015bc0 ffff88021a7931a0
Aug 31 23:24:45 itvss1 kernel: [ 2401.422584] Call Trace:
Aug 31 23:24:45 itvss1 kernel: [ 2401.422593] [<ffffffff81166d80>] ? bdi_sched_wait+0x0/0x20
Aug 31 23:24:45 itvss1 kernel: [ 2401.422596] [<ffffffff81166d8e>] bdi_sched_wait+0xe/0x20
Aug 31 23:24:45 itvss1 kernel: [ 2401.422601] [<ffffffff815591df>] __wait_on_bit+0x5f/0x90
Aug 31 23:24:45 itvss1 kernel: [ 2401.422603] [<ffffffff81166d80>] ? bdi_sched_wait+0x0/0x20
Aug 31 23:24:45 itvss1 kernel: [ 2401.422606] [<ffffffff81559288>] out_of_line_wait_on_bit+0x78/0x90
Aug 31 23:24:45 itvss1 kernel: [ 2401.422610] [<ffffffff810850d0>] ? wake_bit_function+0x0/0x40
Aug 31 23:24:45 itvss1 kernel: [ 2401.422613] [<ffffffff81166d44>] ? bdi_queue_work+0xa4/0xe0
Aug 31 23:24:45 itvss1 kernel: [ 2401.422616] [<ffffffff811680ef>] bdi_sync_writeback+0x6f/0x80
Aug 31 23:24:45 itvss1 kernel: [ 2401.422618] [<ffffffff81168120>] sync_inodes_sb+0x20/0x30
Aug 31 23:24:45 itvss1 kernel: [ 2401.422621] [<ffffffff8116bc92>] __sync_filesystem+0x82/0x90
Aug 31 23:24:45 itvss1 kernel: [ 2401.422624] [<ffffffff8116bd79>] sync_filesystems+0xd9/0x130
Aug 31 23:24:45 itvss1 kernel: [ 2401.422626] [<ffffffff8116be31>] sys_sync+0x21/0x40
Aug 31 23:24:45 itvss1 kernel: [ 2401.422631] [<ffffffff810131b2>] system_call_fastpath+0x16/0x1b

"bdi_sync_writeback()" is the key.

Search for "writeback" in
https://edge.launchpad.net/ubuntu/+source/linux/2.6.32-25.43

Also look for "writeback" in

Bug #543617
Bug #585092
Bug #601361
Bug #620242
Bug #628047

Try the proposed kernel version 2.6.32-25.43, see
https://wiki.ubuntu.com/Testing/EnableProposed

kylea (kylea) wrote :

Thanks nutznboltz - i have created a new server instance as I could not get past the download step.

I will have a fiddle with this and see if I can get the alternative kernel installed. The repositories are in a confused state trying to fix a failed update - there is a partial update hanging around that i cannot clean up for the 2.6.32-24 kernel.

Steve Conklin (sconklin) wrote :

Please test this on the proposed kernel and report on whether it is resolved.

We need to confirm the fixes in this proposed kernel before we can release it.

Thanks!

Ray Speth (speth) wrote :

I was experiencing the same problem as the OP with kernel 2.6.32-24. I installed the updated kernel out of lucid-proposed (Linux 2.6.32-25-server #44-Ubuntu SMP x86_64 GNU/Linux), and I still see the same symptom, but the call trace is now different:

Sep 24 20:32:03 pharos kernel: [ 4201.442565] INFO: task dpkg:17615 blocked for more than 120 seconds.
Sep 24 20:32:03 pharos kernel: [ 4201.442862] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 24 20:32:03 pharos kernel: [ 4201.443177] dpkg D 0000000000000000 0 17615 16766 0x00000000
Sep 24 20:32:03 pharos kernel: [ 4201.443182] ffff880425eb3d38 0000000000000086 0000000000015bc0 0000000000015bc0
Sep 24 20:32:03 pharos kernel: [ 4201.443186] ffff88042a641ab0 ffff880425eb3fd8 0000000000015bc0 ffff88042a6416f0
Sep 24 20:32:03 pharos kernel: [ 4201.443190] 0000000000015bc0 ffff880425eb3fd8 0000000000015bc0 ffff88042a641ab0
Sep 24 20:32:03 pharos kernel: [ 4201.443193] Call Trace:
Sep 24 20:32:03 pharos kernel: [ 4201.443204] [<ffffffff815583ad>] schedule_timeout+0x22d/0x300
Sep 24 20:32:03 pharos kernel: [ 4201.443209] [<ffffffff8105df52>] ? enqueue_entity+0x122/0x1a0
Sep 24 20:32:03 pharos kernel: [ 4201.443212] [<ffffffff8105e015>] ? enqueue_task_fair+0x45/0x90
Sep 24 20:32:03 pharos kernel: [ 4201.443215] [<ffffffff81557656>] wait_for_common+0xd6/0x180
Sep 24 20:32:03 pharos kernel: [ 4201.443219] [<ffffffff8105a254>] ? try_to_wake_up+0x284/0x380
Sep 24 20:32:03 pharos kernel: [ 4201.443222] [<ffffffff8105a350>] ? default_wake_function+0x0/0x20
Sep 24 20:32:03 pharos kernel: [ 4201.443225] [<ffffffff815577bd>] wait_for_completion+0x1d/0x20
Sep 24 20:32:03 pharos kernel: [ 4201.443229] [<ffffffff811666d7>] sync_inodes_sb+0x87/0xb0
Sep 24 20:32:03 pharos kernel: [ 4201.443233] [<ffffffff8116afb2>] __sync_filesystem+0x82/0x90
Sep 24 20:32:03 pharos kernel: [ 4201.443236] [<ffffffff8116b099>] sync_filesystems+0xd9/0x130
Sep 24 20:32:03 pharos kernel: [ 4201.443238] [<ffffffff8116b151>] sys_sync+0x21/0x40
Sep 24 20:32:03 pharos kernel: [ 4201.443243] [<ffffffff810121b2>] system_call_fastpath+0x16/0x1b

To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers