Auto skipped SD/SDHC mediacard test cases before suspend.

[candicehuang]

Title: Auto skipped SD/SDHC mediacard test cases before suspend.

Summary: Auto skipped SD/SDHC mediacard test cases before suspend.

Steps:
Install testing PPA of Checkbox as below version:
- checkbox-support 0.35.0rc3
- plainbox 0.36.0rc3
- checkbox-ng 0.34.0rc1
- plainbox-provider-resource 0.33.0rc5
- plainbox-provider-checkbox 0.37.0rc3
- plainbox-provider-tpm2 1.5.0rc1
- plainbox-provider-certification-client 0.31.0rc2

Auto skipped SD/SDHC mediacard test cases before suspend.
Manually to insert SD/SDHC mediacard, it can detect normally.

Expected results: Can run SD/SDHC mediacard test cases before suspend by checkbox tool.

Actual results:
Auto skipped SD/SDHC mediacard test cases before suspend by checkbox tool.

F/R: 2 out of 2 times

Additional information:
Sku: SKR5-DVT2-C2

BIOS: 1.0.0

Manifest: dell-bto-xenial-starlord-kblr-A00-iso-20170621-0

Image: somerville-xenial-amd64-20160624-2

CPU: Intel(R) Core(TM) i5-8250U CPU @ 1.60GHz (8x)

GPU:
00:02.0 VGA compatible controller: Intel Corporation Device 5917 (rev 07)
00:13.0 Non-VGA unclassified device: Intel Corporation Device 9d35 (rev 21)

Manufacturer: n/a

ProductName: n/a

BiosVersion: n/a

[candicehuang (candice)]

Automatically attached

[candicehuang (candice)]

attached failed picture

[candicehuang (candice)]

Install the older Checkbox tool version, SD/SDHC mediacard test cases did not be skipped, it was passed.

Test information:

Sku: SKR5-DVT2-C2

BIOS: 1.0.0

Manifest: dell-bto-xenial-starlord-kblr-A00-iso-20170621-0

[candicehuang (candice)]

I have verified this bug on New Checkbox version 0.37.0; test result was failed.

Auto skipped SD/SDHC mediacard test cases before/after suspend.

[Sylvain Pineau (sylvain-pineau)]

The fix I landed was to skip the tests also after suspend as I understood the bug as being an inconsistency between before and after where it's skipped in one case and not the other.

We might be facing an issue with the cardreader detection here.
The way this auto detection works relies on the udevadm output.

Could you please attach to the bug the output of 'udevadm info -e' with and without a sd card plugged in?

the cardreader could be on a bus that we cannot properly handle (e.g. sdio), just a guess.

[candicehuang (candice)]

with sdcard plugged in

[candicehuang (candice)]

without sdcard plugged in

[candicehuang (candice)]

with sdcard plugged

[candicehuang (candice)]

without sdcard plugged

[candicehuang (candice)]

I have verified this bug in the testing ppa: plainbox-provider-checkbox - 0.38.0~rc1, test result is passed.

Before and after suspend did not skip the media card tests.