[public] mmc0: unhandled interrupt status=0x8810 en=0x0000 pio=0 - sporadic under load

[mahmoh]

Build Version/Date: Linux armadaxp1 3.2.0-1600-armadaxp #3-Ubuntu SMP Fri Mar 16 19:14:51 UTC 2012 armv7l armv7l armv7l GNU/Linux
Release: 12.04
Environment used for testing: armadaxp1

Summary: mmc0: unhandled interrupt status=0x8810 en=0x0000 pio=0 - sporadic under load

Steps to Reproduce: run IO/MEM/CPU load tests on the system (or possibly not)

Expected result: no unhandled interrupts

Actual result: unhandled interrupt messages on the console floods with bad scheduling message

[ 39.083584] mmc0: mvsdio driver initialized, lacking card detect (fall back to polling)
...
[63464.245837] mmc0: unhandled interrupt status=0x8810 en=0x0000 pio=0
[66866.825839] mmc0: unhandled interrupt status=0x8810 en=0x0000 pio=0

[Li Li (lli5)]

From drivers/mmc/host/mvsdio.c:492, this interrupt is an unexpected one, which cannot be recognized and processed correctly by all branches of code within this handler. So either this handler is not well designed to miss this interrupt, or it meets an unexpected hw error.

For the former case, we can do nothing but to push the SOC vendor to test and solve it;
For the latter case, we can change another known-well SD card, as well as another armadaxp board to see if this is related to the specific SD card (or board).

I'll let Marvell guys know this bug; and at the same time, could anybody test another SD card and board? Thanks!

[mahmoh (mahmoh)]

The problem happens without an SD card on all three boards that we have, more often when under IO load.

[Li Li (lli5)]

Then, we could do little but wait for updates from Marvell.

[Seif Mazareeb (seif-l)]

Li Li, All,

I did running a load test on network and mem ( CPU running 100%) .... and I can't get this error / log / meesage.
can you guys provide more info about the exact test you have done to reprodice this issue ? after how long did you guys expect this error, or was it random ? if you have a bin to run I'd love to get it too......

thanks
Seif

[mahmoh (mahmoh)]

@Seif, I think it's related to disk IO but try this just to be safe, "sudo apt-get install -y stress ; stress -d 1 -m 1 -c 1" and let that run for 12-24 hours, you should see at least one interrupt message on the console by that time.

[Li Li (lli5)]

@Seif, have you reproduced this at your side?

[Seif Mazareeb (seif-l)]

I ran the test overnight and didn't see this error, please allow more time here for a long run.
If anyone could help me find a better ( and faster way ) to recreate this I would love it, it will make debugging much more effective.

Seif

-----Original Message-----
From: <email address hidden> [mailto:<email address hidden>] On Behalf Of Li Li
Sent: Tuesday, April 24, 2012 4:52 AM
To: Seif Mazareeb
Subject: [Bug 960383] Re: [public] mmc0: unhandled interrupt status=0x8810 en=0x0000 pio=0 - sporadic under load

@Seif, have you reproduced this at your side?

--
You received this bug notification because you are a member of The Eilt team, which is subscribed to the bug report.
https://bugs.launchpad.net/bugs/960383

Title:
  [public] mmc0: unhandled interrupt status=0x8810 en=0x0000 pio=0 -
  sporadic under load

Status in The Eilt project:
  Confirmed
Status in “linux-armadaxp” package in Ubuntu:
  Confirmed

Bug description:
  Build Version/Date: Linux armadaxp1 3.2.0-1600-armadaxp #3-Ubuntu SMP Fri Mar 16 19:14:51 UTC 2012 armv7l armv7l armv7l GNU/Linux
  Release: 12.04
  Environment used for testing: armadaxp1

  Summary: mmc0: unhandled interrupt status=0x8810 en=0x0000 pio=0 -
  sporadic under load

  Steps to Reproduce: run IO/MEM/CPU load tests on the system (or
  possibly not)

  Expected result: no unhandled interrupts

  Actual result: unhandled interrupt messages on the console floods with
  bad scheduling message

  [ 39.083584] mmc0: mvsdio driver initialized, lacking card detect (fall back to polling)
  ...
  [63464.245837] mmc0: unhandled interrupt status=0x8810 en=0x0000 pio=0
  [66866.825839] mmc0: unhandled interrupt status=0x8810 en=0x0000 pio=0

To manage notifications about this bug go to:
https://bugs.launchpad.net/eilt/+bug/960383/+subscriptions

[mahmoh (mahmoh)]

@Seif:

root@n4:/home/ubuntu# stress -d 1 -m 1 -c 1 -i 1 &
[1] 807
stress: info: [807] dispatching hogs: 1 cpu, 1 io, 1 vm, 1 hdd
root@n4:/home/ubuntu#
root@n4:/home/ubuntu#
root@n4:/home/ubuntu# [ 1531.913881] mmc0: unhandled interrupt status=0x8810 en=0x0000 pio=0
[ 2213.323881] mmc0: unhandled interrupt status=0x8810 en=0x0000 pio=0
[ 2248.323891] mmc0: unhandled interrupt status=0x8810 en=0x0000 pio=0
[ 2349.243884] mmc0: unhandled interrupt status=0x8810 en=0x0000 pio=0
[ 2503.293882] mmc0: unhandled interrupt status=0x8810 en=0x0000 pio=0
[ 3907.333885] mmc0: unhandled interrupt status=0x8810 en=0x0000 pio=0
[ 4510.243885] mmc0: unhandled interrupt status=0x8810 en=0x0000 pio=0