audio/{index}_playback_[interface]_{product_slug} test failed after re-order tests

[Ray Chen]

Summary:
I tried to reorder Video tests and audio tests to let VIDEO interfaces test more efficiency like

from

 monitor/1_displayport_.* certification-status=blocker
 monitor/1_type-c_displayport_.* certification-status=blocker
 audio/1_playback_displayport_.* certification-status=blocker
 audio/1_playback_hdmi_.* certification-status=blocker

to
 monitor/1_displayport_.* certification-status=blocker
 audio/1_playback_displayport_.* certification-status=blocker
 monitor/1_hdmi_.* certification-status=blocker
 audio/1_playback_hdmi_.* certification-status=blocker

when I modified /units/monitor/test-plan.pxu and test it,
I found the all audio/{index}_playback_[interfaces]_{product_slug} failed with python error traceback as below

==============================
-------------[ Running job 15 / 144. Estimated time left: unknown ]-------------
--------------------[ audio/2_playback_hdmi_PCI_ID_0x2191 ]---------------------
ID: com.canonical.certification::audio/2_playback_hdmi_PCI_ID_0x2191
Category: com.canonical.plainbox::audio
Purpose:

HDMI audio interface verification

Steps:

1. Plug an external HDMI device with sound (Use only one HDMI/DisplayPort/Thunderbolt interface at a time for this test)
   2. Commence the test

Pick an action
    => press ENTER to continue
  c => add a comment
  s => skip this job
  q => save the session and quit
[csq]:

... 8< -------------------------------------------------------------------------
INFO:===========================[ Saving audio settings ]============================
Traceback (most recent call last):
  File "/tmp/nest-2dlvirnh.dca474bdb2d56182dbdffe88633d813d78f19774ae80079df50795227dbf7a39/audio_settings", line 9, in <module>
    sys.exit(main())
  File "/usr/lib/python3/dist-packages/checkbox_support/scripts/audio_settings.py", line 378, in main
    set_profile_hdmi()
  File "/usr/lib/python3/dist-packages/checkbox_support/scripts/audio_settings.py", line 133, in set_profile_hdmi
    card, profile = _guess_hdmi_profile(pactl_list)
  File "/usr/lib/python3/dist-packages/checkbox_support/scripts/audio_settings.py", line 71, in _guess_hdmi_profile
    for record in parse_pactl_output(pactl_list).record_list:
  File "/usr/lib/python3/dist-packages/checkbox_support/parsers/pactl.py", line 573, in parse_pactl_output
    return Document.Syntax.parseString(output, parseAll=True)[0]
  File "/usr/lib/python3/dist-packages/pyparsing.py", line 1632, in parseString
    raise exc
  File "/usr/lib/python3/dist-packages/pyparsing.py", line 1626, in parseString
    se._parse( instring, loc )
  File "/usr/lib/python3/dist-packages/pyparsing.py", line 1529, in _parseCache
    value = self._parseNoCache(instring, loc, doActions, callPreParse)
  File "/usr/lib/python3/dist-packages/pyparsing.py", line 1379, in _parseNoCache
    loc,tokens = self.parseImpl( instring, preloc, doActions )
  File "/usr/lib/python3/dist-packages/pyparsing.py", line 3395, in parseImpl
    loc, exprtokens = e._parse( instring, loc, doActions )
  File "/usr/lib/python3/dist-packages/pyparsing.py", line 1529, in _parseCache
    value = self._parseNoCache(instring, loc, doActions, callPreParse)
  File "/usr/lib/python3/dist-packages/pyparsing.py", line 1383, in _parseNoCache
    loc,tokens = self.parseImpl( instring, preloc, doActions )
  File "/usr/lib/python3/dist-packages/pyparsing.py", line 3183, in parseImpl
    raise ParseException(instring, loc, self.errmsg, self)
pyparsing.ParseException: Expected end of text (at char 23431), (line:731, col:1)
No PulseAudio daemon running, or not running as session daemon.
Traceback (most recent call last):
  File "/tmp/nest-2dlvirnh.dca474bdb2d56182dbdffe88633d813d78f19774ae80079df50795227dbf7a39/gst_pipeline_test", line 81, in <module>
    sys.exit(main())
  File "/tmp/nest-2dlvirnh.dca474bdb2d56182dbdffe88633d813d78f19774ae80079df50795227dbf7a39/gst_pipeline_test", line 55, in main
    if not check_state(args.device):
  File "/tmp/nest-2dlvirnh.dca474bdb2d56182dbdffe88633d813d78f19774ae80079df50795227dbf7a39/gst_pipeline_test", line 21, in check_state
    universal_newlines=True)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['pacmd', 'list-sinks']' returned non-zero exit status 1.
INFO:==========================[ Restoring audio settings ]==========================
------------------------------------------------------------------------- >8 ---
Outcome: job needs verification
Verification:

Did you hear the sound from the HDMI device?

Please decide what to do next:
  outcome: job needs verification
  comments: none
Pick an action
  c => add a comment
  p => set outcome to pass
  f => set outcome to fail
  s => set outcome to skip
  r => re-run this job
    => set suggested outcome [job failed]
[cpfsr]:

========================================================================================================================

+++-======================================-========================-============-==========================================
ii checkbox-ng 1.3.0~ppa~ubuntu18.04.1 all CheckBoxNG test runner
ii plainbox-provider-certification-client 0.36.0~ppa~ubuntu18.04.1 all Client Certification provider for Plainbox
ii plainbox-provider-checkbox 0.47.0~ppa~ubuntu18.04.1 amd64 CheckBox provider for PlainBox
ii plainbox-provider-oem 0.62 all plainbox oem provider
ii plainbox-provider-oem-somerville 0.62 all plainbox oem provider for somerville
ii plainbox-provider-resource-generic 0.39.0~ppa~ubuntu18.04.1 amd64 CheckBox generic resource jobs provider

+++-========================-========================-============-=======================================================
ii python3-checkbox-ng 1.3.0~ppa~ubuntu18.04.1 all CheckBoxNG test runner (Python 3 library)
ii python3-checkbox-support 0.40.0~ppa~ubuntu18.04.1 all collection of Python modules used by PlainBox providers

-----

GPU: 00:02.0 VGA compatible controller: Intel Corporation Device 3e9b
01:00.0 VGA compatible controller: NVIDIA Corporation Device 2191 (rev a1)
Image: somerville-bionic-amd64-iso-hybrid-20180608-47

system-product-name: G5 5590
system-manufacturer: Dell Inc.
CPU: Intel(R) Core(TM) i7-9750H CPU @ 2.60GHz (12x)
bios-version: 1.3.1

[Ray Chen (ray.chen)]

Automatically attached

[Ray Chen (ray.chen)]

Automatically attached

[Ray Chen (ray.chen)]

Automatically attached

[Ray Chen (ray.chen)]

Automatically attached

[Ray Chen (ray.chen)]

Attached
monitor-test-plan.pxu.modified/original
graphics-test-plan.pxu.modified/original
listbootstrapped After/original
session.tar

[Ray Chen (ray.chen)]

I was tested this reorder on
- checkbox-ng 1.4.0
- checkbox-support 0.41.0
- plainbox-provider-resource 0.40.0
- plainbox-provider-checkbox 0.48.0

test plan: somerville-graphic

This issue no longer exists.
Based on this bug #1829827
I would suggest to set it as fix committed.