omap4 kernel oops

[Derek Schuff]

linux-image-omap4_3.2.0.1413.13_armel

I have Precise running on a Pandaboard ES. On every Precise kernel so far, the board crashes after running for several hours (usually less than 12). The system is basically idle during this time.

[50379.397308] Internal error: Oops - undefined instruction: 0 [#1] PREEMPT SMP
[50379.404968] Modules linked in: cpufreq_ondemand dm_crypt wl12xx_sdio wl12xx mac80211 cfg80211 twl6040_vibra ff_memless leds_gpio
[50379.417572] CPU: 0 Tainted: G W (3.2.0-1413-omap4 #17-Ubuntu)
[50379.425109] PC is at __do_div64+0xcc/0xe8
[50379.427764] LR is at omap2_get_dpll_rate+0xc0/0xc8
[50379.427764] pc : [<c02b3fa8>] lr : [<c002c9c0>] psr: 60070093
[50379.427764] sp : ee2dbcf0 ip : 0000001d fp : ee2dbd0c
[50379.427764] r10: c07612bc r9 : 00124f80 r8 : 00000000
[50379.427764] r7 : 00000007 r6 : 00000000 r5 : c092cf18 r4 : 00000008
[50379.427764] r3 : 00000000 r2 : 23c34600 r1 : 00000001 r0 : 1e1a3000
[50379.427764] Flags: nZCv IRQs off FIQs on Mode SVC_32 ISA ARM Segment kernel
[50379.466796] Control: 10c5387d Table: ac61804a DAC: 00000015
[50379.480987] Process kworker/0:1 (pid: 45, stack limit = 0xee2da2f8)
[50379.480987] Stack: (0xee2dbcf0 to 0xee2dc000)
[50379.480987] bce0: c092cf18 c0928cc0 29b92700 c092cf18
[50379.501312] bd00: ee2dbd1c ee2dbd10 c002d44c c002c90c ee2dbd3c ee2dbd20 c002d800 c002d440
[50379.501312] bd20: 29b92700 c0928d1c 47868c00 c092cf18 ee2dbd5c ee2dbd40 c002df34 c002d7c8
[50379.501312] bd40: c0972158 c0928d1c 60070013 29b92700 ee2dbd8c ee2dbd60 c002c1f8 c002deb4
[50379.501312] bd60: c002c120 c0972158 c0928d1c 60070013 29b92700 29b92700 00124f80 ee005c08
[50379.536682] bd80: ee2dbdac ee2dbd90 c00311e4 c002c12c c0924a4c ee239e20 ee2064c0 00000000
[50379.536682] bda0: ee2dbdfc ee2dbdb0 c00287d0 c003118c c05d14a8 c05d1398 ee005c08 ee2064dc
[50379.536682] bdc0: c0971e54 00000000 ee2dbdfc ee2dbdd8 c00284a8 ee005c08 ee2064c0 ee005c08
[50379.563201] bde0: 00000000 00124f80 c0918760 ee5ce9c0 ee2dbe3c ee2dbe00 c0028a48 c00285f4
[50379.572052] be00: ee2dbe3c ee2dbe10 c0443814 c007a3f8 00000002 29b92700 c091d1e4 ee2dbe48
[50379.572052] be20: c091d1e4 c091c994 00000000 00000002 ee2dbe84 ee2dbe40 c0024b70 c00288c4
[50379.580902] be40: ee2dbe64 ee2dbe50 00000002 00124f80 000aae60 c0024d01 00000000 c0971de0
[50379.598571] be60: ee5ce9c0 00000000 00000000 00000002 c0918760 ee5ce9c0 ee2dbeb4 ee2dbe88
[50379.598571] be80: c0024d90 c0024aa0 ee2dbe94 c124a760 00000000 00000001 ee2dbeb4 00000000
[50379.598571] bea0: 00051381 ee5ce9c0 ee2dbecc ee2dbeb8 c0442ccc c0024d10 00000001 bf23a284
[50379.598571] bec0: ee2dbf1c ee2dbed0 bf239a94 c0442c78 00932000 c09162c0 c1242760 02130180
[50379.633941] bee0: b6a82a59 0000000a bad86935 0000000b c0048954 c1242784 c12427e4 00000000
[50379.642791] bf00: bf23a284 c1242760 bf239ab0 c12403c0 ee2dbf44 ee2dbf20 bf239b14 bf23975c
[50379.642791] bf20: 00000000 ee2a0280 c12403c0 c1245400 c1242784 00000000 ee2dbf84 ee2dbf48
[50379.660461] bf40: c006f010 bf239abc c05cee14 c05d14c4 c1245405 00000000 ee2dbf74 ee2a0280
[50379.669311] bf60: c12403c0 ee2da000 c09953a0 ee2a0290 00000009 c12403c0 ee2dbfb4 ee2dbf88
[50379.669311] bf80: c006f510 c006ed88 00000000 ee0adeb8 ee2a0280 c006f3cc 00000013 00000000
[50379.678161] bfa0: 00000000 00000000 ee2dbff4 ee2dbfb8 c007420c c006f3d8 00000000 00000000
[50379.695831] bfc0: ee2a0280 00000000 00000000 00000000 ee2dbfd0 ee2dbfd0 00000000 ee0adeb8
[50379.695831] bfe0: c0074174 c000ee84 00000000 ee2dbff8 c000ee84 c0074180 aab2aaaa aaaaaaaa
[50379.695831] [<c02b3fa8>] (__do_div64+0xcc/0xe8) from [<c002c9c0>] (omap2_get_dpll_rate+0xc0/0xc8)
[50379.695831] [<c002c9c0>] (omap2_get_dpll_rate+0xc0/0xc8) from [<c002d44c>] (omap3_dpll_recalc+0x18/0x1c)
[50379.695831] [<c002d44c>] (omap3_dpll_recalc+0x18/0x1c) from [<c002d800>] (omap3_noncore_dpll_set_rate+0x44/0x2a4)
[50379.744476] [<c002d800>] (omap3_noncore_dpll_set_rate+0x44/0x2a4) from [<c002df34>] (omap4460_mpu_dpll_set_rate+0x8c/0x130)
[50379.744476] [<c002df34>] (omap4460_mpu_dpll_set_rate+0x8c/0x130) from [<c002c1f8>] (omap2_clk_set_rate+0xd8/0xe8)
[50379.767608] [<c002c1f8>] (omap2_clk_set_rate+0xd8/0xe8) from [<c00311e4>] (clk_set_rate+0x64/0x98)
[50379.771820] [<c00311e4>] (clk_set_rate+0x64/0x98) from [<c00287d0>] (_dvfs_scale.isra.0+0x1e8/0x2d0)
[50379.771820] [<c00287d0>] (_dvfs_scale.isra.0+0x1e8/0x2d0) from [<c0028a48>] (omap_device_scale+0x190/0x264)
[50379.771820] [<c0028a48>] (omap_device_scale+0x190/0x264) from [<c0024b70>] (omap_cpufreq_scale+0xdc/0x270)
[50379.771820] [<c0024b70>] (omap_cpufreq_scale+0xdc/0x270) from [<c0024d90>] (omap_target+0x8c/0xb4)
[50379.817871] [<c0024d90>] (omap_target+0x8c/0xb4) from [<c0442ccc>] (__cpufreq_driver_target+0x60/0x74)
[50379.817871] [<c0442ccc>] (__cpufreq_driver_target+0x60/0x74) from [<bf239a94>] (dbs_check_cpu+0x344/0x360 [cpufreq_ondemand])
[50379.817871] [<bf239a94>] (dbs_check_cpu+0x344/0x360 [cpufreq_ondemand]) from [<bf239b14>] (do_dbs_timer+0x64/0x104 [cpufreq_ondemand])
[50379.853271] [<bf239b14>] (do_dbs_timer+0x64/0x104 [cpufreq_ondemand]) from [<c006f010>] (process_one_work+0x294/0x48c)
[50379.853271] [<c006f010>] (process_one_work+0x294/0x48c) from [<c006f510>] (worker_thread+0x144/0x240)
[50379.874816] [<c006f510>] (worker_thread+0x144/0x240) from [<c007420c>] (kthread+0x98/0xa0)
[50379.874816] [<c007420c>] (kthread+0x98/0xa0) from [<c000ee84>] (kernel_thread_exit+0x0/0x8)
[50379.892791] Code: e1a03c31 e1a02c30 e26cc020 e1822c11 (e1a01c10)
[50379.917236] ---[ end trace da227214a82491ba ]---
[50379.922332] note: kworker/0:1[45] exited with preempt_count 1
[50379.928619] Unable to handle kernel paging request at virtual address fffffffc
[50379.936614] pgd = c0004000
[50379.939544] [fffffffc] *pgd=afffe821, *pte=00000000, *ppte=00000000
[50379.946319] Internal error: Oops: 17 [#2] PREEMPT SMP
[50379.951812] Modules linked in: cpufreq_ondemand dm_crypt wl12xx_sdio wl12xx mac80211 cfg80211 twl6040_vibra ff_memless leds_gpio
[50379.964385] CPU: 0 Tainted: G D W (3.2.0-1413-omap4 #17-Ubuntu)
[50379.971954] PC is at kthread_data+0x18/0x20
[50379.974700] LR is at wq_worker_sleeping+0x1c/0xc4
[50379.974700] pc : [<c0074538>] lr : [<c006ffc0>] psr: 20070093
[50379.974700] sp : ee2dba90 ip : ee2dbaa0 fp : ee2dba9c
[50379.994018] r10: c07612bc r9 : c05cf568 r8 : ee2da000
[50379.994018] r7 : 00000000 r6 : ee1c78e0 r5 : 00000000 r4 : ee1c7640
[50380.006134] r3 : 00000000 r2 : ee000160 r1 : 00000000 r0 : ee1c7640
[50380.013031] Flags: nzCv IRQs off FIQs on Mode SVC_32 ISA ARM Segment user
[50380.020965] Control: 10c5387d Table: ac61804a DAC: 00000015
[50380.020965] Process kworker/0:1 (pid: 45, stack limit = 0xee2da2f8)
[50380.028778] Stack: (0xee2dba90 to 0xee2dc000)
[50380.037658] ba80: ee2dbabc ee2dbaa0 c006ffc0 c007452c
[50380.048126] baa0: 8420806c ee1c7640 c12420c0 ee1c78e0 ee2dbb54 ee2dbac0 c05cc1d4 c006ffb0
[50380.055511] bac0: ee1f3844 ee1f3340 00000000 00000000 ee2dbaf4 c05cc7e8 c091628c c09180c0
[50380.059539] bae0: c0916788 c093b5c0 ee2dbb1c ee2dbaf8 c00b637c c02c598c 00000002 ee1c7640
[50380.074645] bb00: ee1c7640 00000000 00000020 e1000000 ee2dbb2c ee2dbb20 c00b6498 c00b634c
[50380.083496] bb20: ee2dbb4c ee2dbb30 c0055d28 ee1c7640 0000000b 00000001 00000000 e1000000
[50380.083496] bb40: c05cf568 c07612bc ee2dbb64 ee2dbb58 c05cc7e8 c05cc09c ee2dbb8c ee2dbb68
[50380.083496] bb60: c0057380 c05cc774 00008001 ee2dbc68 ee2da000 00000001 00000000 e1000000
[50380.110015] bb80: ee2dbbac ee2dbb90 c0012240 c0057004 ee2dbc68 c02b3fa8 e1a01c10 00000000
[50380.118865] bba0: ee2dbbbc ee2dbbb0 c00122b0 c001213c ee2dbc64 ee2dbbc0 c00084ac c0012260
[50380.121978] bbc0: 00000006 c05d1448 00000004 00000000 00030001 c02b3fa8 ee2dbbf0 00000001
[50380.134094] bbe0: ee2dbc04 ee2dbbf0 c05d141c c004894c c092eabc c092ea70 ee2dbc14 ee2dbc08
[50380.141082] bc00: c05d14a8 c05d1398 ee2dbc24 ee2dbc18 c05ce8f0 c05d1448 ee2dbc44 ee2dbc28
[50380.154235] bc20: c0023234 c05ce8c8 ee633b40 00000001 ee633b20 c00345e8 ee633b20 c0034610
[50380.163085] bc40: ee633b20 ee633b60 c02b3fac 60070093 c05cf814 00000000 ee2dbd0c ee2dbc68
[50380.163085] bc60: c05cf568 c000834c 1e1a3000 00000001 23c34600 00000000 00000008 c092cf18
[50380.176422] bc80: 00000000 00000007 00000000 00124f80 c07612bc ee2dbd0c 0000001d ee2dbcf0
[50380.189605] bca0: c002c9c0 c02b3fa8 60070093 ffffffff ee2dbccc ee2dbcc0 c05ce8f0 c05d1448
[50380.197875] bcc0: ee2dbcfc ee2dbcd0 c003dd30 c05ce8c8 00000000 c05ced44 ee2dbcfc c002c934
[50380.202819] bce0: ee2dbd0c ee2dbcf0 c002c934 c001e614 c092cf18 c0928cc0 29b92700 c092cf18
[50380.215820] bd00: ee2dbd1c ee2dbd10 c002d44c c002c90c ee2dbd3c ee2dbd20 c002d800 c002d440
[50380.224975] bd20: 29b92700 c0928d1c 47868c00 c092cf18 ee2dbd5c ee2dbd40 c002df34 c002d7c8
[50380.233825] bd40: c0972158 c0928d1c 60070013 29b92700 ee2dbd8c ee2dbd60 c002c1f8 c002deb4
[50380.242675] bd60: c002c120 c0972158 c0928d1c 60070013 29b92700 29b92700 00124f80 ee005c08
[50380.249572] bd80: ee2dbdac ee2dbd90 c00311e4 c002c12c c0924a4c ee239e20 ee2064c0 00000000
[50380.255004] bda0: ee2dbdfc ee2dbdb0 c00287d0 c003118c c05d14a8 c05d1398 ee005c08 ee2064dc
[50380.269195] bdc0: c0971e54 00000000 ee2dbdfc ee2dbdd8 c00284a8 ee005c08 ee2064c0 ee005c08
[50380.278045] bde0: 00000000 00124f80 c0918760 ee5ce9c0 ee2dbe3c ee2dbe00 c0028a48 c00285f4
[50380.278045] be00: ee2dbe3c ee2dbe10 c0443814 c007a3f8 00000002 29b92700 c091d1e4 ee2dbe48
[50380.294281] be20: c091d1e4 c091c994 00000000 00000002 ee2dbe84 ee2dbe40 c0024b70 c00288c4
[50380.304565] be40: ee2dbe64 ee2dbe50 00000002 00124f80 000aae60 c0024d01 00000000 c0971de0
[50380.313415] be60: ee5ce9c0 00000000 00000000 00000002 c0918760 ee5ce9c0 ee2dbeb4 ee2dbe88
[50380.318969] be80: c0024d90 c0024aa0 ee2dbe94 c124a760 00000000 00000001 ee2dbeb4 00000000
[50380.330902] bea0: 00051381 ee5ce9c0 ee2dbecc ee2dbeb8 c0442ccc c0024d10 00000001 bf23a284
[50380.339935] bec0: ee2dbf1c ee2dbed0 bf239a94 c0442c78 00932000 c09162c0 c1242760 02130180
[50380.341369] bee0: b6a82a59 0000000a bad86935 0000000b c0048954 c1242784 c12427e4 00000000
[50380.357635] bf00: bf23a284 c1242760 bf239ab0 c12403c0 ee2dbf44 ee2dbf20 bf239b14 bf23975c
[50380.364715] bf20: 00000000 ee2a0280 c12403c0 c1245400 c1242784 00000000 ee2dbf84 ee2dbf48
[50380.371643] bf40: c006f010 bf239abc c05cee14 c05d14c4 c1245405 00000000 ee2dbf74 ee2a0280
[50380.384155] bf60: c12403c0 ee2da000 c09953a0 ee2a0290 00000009 c12403c0 ee2dbfb4 ee2dbf88
[50380.393005] bf80: c006f510 c006ed88 00000000 ee0adeb8 ee2a0280 c006f3cc 00000013 00000000
[50380.397674] bfa0: 00000000 00000000 ee2dbff4 ee2dbfb8 c007420c c006f3d8 00000000 00000000
[50380.403503] bfc0: ee2a0280 00000001 00000000 00000000 ee2dbfd0 ee2dbfd0 00000000 ee0adeb8
[50380.419525] bfe0: c0074174 c000ee84 00000000 ee2dbff8 c000ee84 c0074180 aab2aaaa aaaaaaaa
[50380.427124] [<c0074538>] (kthread_data+0x18/0x20) from [<c006ffc0>] (wq_worker_sleeping+0x1c/0xc4)
[50380.438079] [<c006ffc0>] (wq_worker_sleeping+0x1c/0xc4) from [<c05cc1d4>] (__schedule+0x144/0x5c8)
[50380.447784] [<c05cc1d4>] (__schedule+0x144/0x5c8) from [<c05cc7e8>] (schedule+0x80/0x84)
[50380.456542] [<c05cc7e8>] (schedule+0x80/0x84) from [<c0057380>] (do_exit+0x388/0x3a4)
[50380.460510] [<c0057380>] (do_exit+0x388/0x3a4) from [<c0012240>] (die+0x110/0x124)
[50380.465942] [<c0012240>] (die+0x110/0x124) from [<c00122b0>] (arm_notify_die+0x5c/0x60)
[50380.465942] [<c00122b0>] (arm_notify_die+0x5c/0x60) from [<c00084ac>] (do_undefinstr+0x16c/0x190)
[50380.491455] [<c00084ac>] (do_undefinstr+0x16c/0x190) from [<c05cf568>] (__und_svc+0x48/0x60)
[50380.497497] Exception stack(0xee2dbc68 to 0xee2dbcb0)
[50380.505706] bc60: 1e1a3000 00000001 23c34600 00000000 00000008 c092cf18
[50380.514892] bc80: 00000000 00000007 00000000 00124f80 c07612bc ee2dbd0c 0000001d ee2dbcf0
[50380.520385] bca0: c002c9c0 c02b3fa8 60070093 ffffffff
[50380.528808] [<c05cf568>] (__und_svc+0x48/0x60) from [<c02b3fa8>] (__do_div64+0xcc/0xe8)
[50380.537231] [<c02b3fa8>] (__do_div64+0xcc/0xe8) from [<c002c9c0>] (omap2_get_dpll_rate+0xc0/0xc8)
[50380.544952] [<c002c9c0>] (omap2_get_dpll_rate+0xc0/0xc8) from [<c002d44c>] (omap3_dpll_recalc+0x18/0x1c)
[50380.551971] [<c002d44c>] (omap3_dpll_recalc+0x18/0x1c) from [<c002d800>] (omap3_noncore_dpll_set_rate+0x44/0x2a4)
[50380.568817] [<c002d800>] (omap3_noncore_dpll_set_rate+0x44/0x2a4) from [<c002df34>] (omap4460_mpu_dpll_set_rate+0x8c/0x130)
[50380.575592] [<c002df34>] (omap4460_mpu_dpll_set_rate+0x8c/0x130) from [<c002c1f8>] (omap2_clk_set_rate+0xd8/0xe8)
[50380.591003] [<c002c1f8>] (omap2_clk_set_rate+0xd8/0xe8) from [<c00311e4>] (clk_set_rate+0x64/0x98)
[50380.601654] [<c00311e4>] (clk_set_rate+0x64/0x98) from [<c00287d0>] (_dvfs_scale.isra.0+0x1e8/0x2d0)
[50380.611541] [<c00287d0>] (_dvfs_scale.isra.0+0x1e8/0x2d0) from [<c0028a48>] (omap_device_scale+0x190/0x264)
[50380.611694] [<c0028a48>] (omap_device_scale+0x190/0x264) from [<c0024b70>] (omap_cpufreq_scale+0xdc/0x270)
[50380.630218] [<c0024b70>] (omap_cpufreq_scale+0xdc/0x270) from [<c0024d90>] (omap_target+0x8c/0xb4)
[50380.642211] [<c0024d90>] (omap_target+0x8c/0xb4) from [<c0442ccc>] (__cpufreq_driver_target+0x60/0x74)
[50380.645904] [<c0442ccc>] (__cpufreq_driver_target+0x60/0x74) from [<bf239a94>] (dbs_check_cpu+0x344/0x360 [cpufreq_ondemand])
[50380.664550] [<bf239a94>] (dbs_check_cpu+0x344/0x360 [cpufreq_ondemand]) from [<bf239b14>] (do_dbs_timer+0x64/0x104 [cpufreq_ondemand])
[50380.676513] [<bf239b14>] (do_dbs_timer+0x64/0x104 [cpufreq_ondemand]) from [<c006f010>] (process_one_work+0x294/0x48c)
[50380.678924] [<c006f010>] (process_one_work+0x294/0x48c) from [<c006f510>] (worker_thread+0x144/0x240)
[50380.694976] [<c006f510>] (worker_thread+0x144/0x240) from [<c007420c>] (kthread+0x98/0xa0)
[50380.708129] [<c007420c>] (kthread+0x98/0xa0) from [<c000ee84>] (kernel_thread_exit+0x0/0x8)
[50380.717163] Code: e24cb004 e92d4000 e8bd4000 e5903274 (e5130004)

[Launchpad Janitor (janitor)]

Status changed to 'Confirmed' because the bug affects multiple users.

[Stefan (mad-kow)]

Same here, makes the PandaBoard ES unusable for me

[Stefan (mad-kow)]

Workaround for this bug:

root@localhost:/proc# echo performance > /sys/devices/system/cpu/cpu0/cpufreq/scaling_governor
root@localhost:/proc# echo performance > /sys/devices/system/cpu/cpu1/cpufreq/scaling_governor

The stacktrace shows that the bug is related to frequency scaling. Above commands will set the policy for frequency scaling to "performance", which will cause the PandaBoard to always run at the highest frequency and just not do any frequency scaling.

This is clearly not a nice workaround, but it seems to be working just fine for me. My PandaBoard ES didn't crash in 3 days.

Note: The above commands are probably not permanent, so you will have to execute them after every reboot.