sleep_time_check.py failed to parse suspend/resume time

[jeremyszu]

[Description]
sleep_time_check.py failed to parse

    # find our times
    for line in lines:
        try:
            if "Average time to sleep" in line:
                sleep_time = float(line.split(':')[1].strip())
                sleep_times.append(sleep_time)
            elif "Average time to resume" in line:
                resume_time = float(line.split(':')[1].strip())
                resume_times.append(resume_time)
        except ValueError as e:
            print("ERROR: One or more times was not reported correctly:")
            print(e)
            return 1

I guess the "Average time to sleep/resume" likely missing or showing unexpected output.
In the failure case, the checkbox submission doesn't include "pm_test.reboot.3.log".
Thus, we won't know what's going on.

[Summary]
power-management/suspend-30-cycles-time-check-with-reboots test failed

[Steps to reproduce]
Run checkbox-cli stress test

[Checkbox job `com.canonical.certification::power-management/suspend-30-cycles-time-check-with-reboots` output]

stdout
------
ERROR: One or more times was not reported correctly:
could not convert string to float: 'N/A'

[Pierre Equoy (pieq)]

I suspect the logs generated by fwts_test.py spit out "N/A", and it makes checking the time impossible:

https://github.com/canonical/checkbox/blob/main/checkbox-support/checkbox_support/scripts/fwts_test.py#L128-L130

I will need to run this on an actual device and capture the logs to see what's the content of the file before being processed.

We see this error more and more, so I think this is important to get fixed.

[Pierre Equoy (pieq)]

Discussed with QA:

- Investigate why FWTS/pm_test is spitting much more "N/A" than in the past. Could be an issue with FWTS
- Modify Checkbox script to:
    - report how many correct cycle times (and their average)
    - report how many "N/A"
    - fail the test and provide above info so that QA engineer can take a look and take action

[Maksim Beliaev (beliaev-maksim)]

Bug was migrated to GitHub: https://github.com/canonical/checkbox/issues/99.
Bug is no more monitored here.