[Remote] Failed to Submit result after enter submission description

[Ray Chen]

[Summary]
Failed to Submit result after enter submission description

[Steps to reproduce]
1. Install checkbox-snappy --devmode on both master and slave
$ snap install checkbox-snappy --devmode

2. Start checkbox-sanppy master from x86 desktop (ubuntu 18.04)
$ checkbox-snappy.checkbox-cli master <ip_address>

3. Start checkbox snappy on slave without enable it as daemon and service
$ checkbox-snappy.checkbox-cli slave

4. select testplan id: snappy-cert-whitelist

5. Start testing

[Expected result]
Checkbox able to submit result after testing completed

[Actual result]
Failed to Submit result after enter submission description, got trace back
============
job skipped : Verify that modem can scan for available networks after suspend (S3)
file:///home/u/snap/checkbox-snappy/2012/.local/share/checkbox-ng/submission_2019-12-06T10.10.06.943131.html
file:///home/u/snap/checkbox-snappy/2012/.local/share/checkbox-ng/submission_2019-12-06T10.10.06.943131.junit.xml
file:///home/u/snap/checkbox-snappy/2012/.local/share/checkbox-ng/submission_2019-12-06T10.10.06.943131.tar.xz
file:///home/u/snap/checkbox-snappy/2012/.local/share/checkbox-ng/submission_2019-12-06T10.10.06.943131.xlsx
Do you want to submit 'upload to certification' report?
  y => yes
  n => no
[yn]: yes
Enter submission description (press Enter to skip): Checkbox-Remote
Traceback (most recent call last):
  File "/snap/checkbox-snappy/2012/checkbox-runtime/bin/checkbox-cli", line 11, in <module>
    load_entry_point('checkbox-ng==1.7.0.dev0', 'console_scripts', 'checkbox-cli')()
  File "/snap/checkbox-snappy/2012/checkbox-runtime/lib/python3.6/site-packages/checkbox_ng/launcher/checkbox_cli.py", line 118, in main
    subcmd.invoked(ctx)
  File "/snap/checkbox-snappy/2012/checkbox-runtime/lib/python3.6/site-packages/checkbox_ng/launcher/master.py", line 150, in invoked
    self.connect_and_run(ctx.args.host, port)
  File "/snap/checkbox-snappy/2012/checkbox-runtime/lib/python3.6/site-packages/checkbox_ng/launcher/master.py", line 208, in connect_and_run
    }[state]()
  File "/snap/checkbox-snappy/2012/checkbox-runtime/lib/python3.6/site-packages/checkbox_ng/launcher/master.py", line 391, in run_jobs
    self.finish_session()
  File "/snap/checkbox-snappy/2012/checkbox-runtime/lib/python3.6/site-packages/checkbox_ng/launcher/master.py", line 339, in finish_session
    self._export_results()
  File "/snap/checkbox-snappy/2012/checkbox-runtime/lib/python3.6/site-packages/checkbox_ng/launcher/stages.py", line 465, in _export_results
    self._create_transport(params['transport'])
  File "/snap/checkbox-snappy/2012/checkbox-runtime/lib/python3.6/site-packages/checkbox_ng/launcher/stages.py", line 402, in _create_transport
    self.ctx.sa.update_app_blob(json.dumps(
AttributeError: 'RemoteMaster' object has no attribute 'ctx'

[Failure rate]

[Additional information]
SKU:
system-manufacturer: Intel Corporation
system-product-name: NUC7PJYH
bios-version: JYGLKCPX.86A.0037.2018.0423.1539
CPU: Intel(R) Pentium(R) Silver J5005 CPU @ 1.50GHz (4x)
GPU: 00:02.0 VGA compatible controller [0300]: Intel Corporation Device [8086:3184] (rev 03)
kernel-version: 4.15.0-72-generic

[Ray Chen (ray.chen)]

Automatically attached

[Ray Chen (ray.chen)]

Automatically attached

[Ray Chen (ray.chen)]

Automatically attached

[Ray Chen (ray.chen)]

Automatically attached

[Ray Chen (ray.chen)]

Tried to submit from master also failed but the file exist

u@u-Inspiron-5590:~/snap/checkbox-snappy/2012/.local/share/checkbox-ng$ ll
total 2024
drwxr-xr-x 2 u u 4096 十二 6 18:10 ./
drwxr-xr-x 3 u u 4096 十二 9 09:24 ../
-rw-r--r-- 1 u u 1359726 十二 6 18:10 submission_2019-12-06T10.10.06.943131.html
-rw-r--r-- 1 u u 50811 十二 6 18:10 submission_2019-12-06T10.10.06.943131.junit.xml
-rw-r--r-- 1 u u 437784 十二 6 18:10 submission_2019-12-06T10.10.06.943131.tar.xz
-rw-r--r-- 1 u u 210870 十二 6 18:10 submission_2019-12-06T10.10.06.943131.xlsx
u@u-Inspiron-5590:~/snap/checkbox-snappy/2012/.local/share/checkbox-ng$ checkbox-snappy.checkbox-cli submit ywgWrkgcPRbtopY5WFFzdK submission_2019-12-06T10.10.06.943131.
submission_2019-12-06T10.10.06.943131.html
submission_2019-12-06T10.10.06.943131.junit.xml
submission_2019-12-06T10.10.06.943131.tar.xz
submission_2019-12-06T10.10.06.943131.xlsx
u@u-Inspiron-5590:~/snap/checkbox-snappy/2012/.local/share/checkbox-ng$ checkbox-snappy.checkbox-cli submit ywgWrkgcPRbtopY5WFFzdK submission_2019-12-06T10.10.06.943131.tar.xz
[Errno 2] No such file or directory: 'submission_2019-12-06T10.10.06.943131.tar.xz'
u@u-Inspiron-5590:~/snap/checkbox-snappy/2012/.local/share/checkbox-ng$

[Ray Chen (ray.chen)]

Snap Version info:
MASTER:
g$ snap list
Name Version Rev Tracking Publisher Notes
checkbox-snappy 18.14 2012 stable ce-certification-qa devmode
checkbox18 1.11 624 stable ce-certification-qa -
core 16-2.42.4 8213 stable canonical✓ core
core18 20191126 1279 stable canonical✓ base
gnome-3-28-1804 3.28.0-16-g27c9498.27c9498 110 stable/… canonical✓ -
gnome-calculator 3.34.1+git1.d34dc842 544 stable/… canonical✓ -
gnome-characters v3.32.1+git2.3367201 367 stable/… canonical✓ -
gnome-logs 3.34.0 81 stable/… canonical✓ -
gnome-system-monitor 3.32.1-3-g0ea89b4922 111 stable/… canonical✓ -
gtk-common-themes 0.1-25-gcc83164 1353 stable/… canonical✓ -
qabro 0.11.1 99 stable pieq devmode

SLAVE:
~$ snap list
Name Version Rev Tracking Publisher Notes
alsa-utils 1.1.2-5 68 stable canonical✓ -
bluez 5.47-3 166 stable canonical✓ -
checkbox-snappy 18.14 2012 stable ce-certification-qa devmode
checkbox18 1.11 624 stable ce-certification-qa -
core 16-2.42.4 8213 stable canonical✓ core
core18 20191126 1279 stable canonical✓ base
nano 3.2+pkg-24de 27 stable snapcrafters -
pc 18-2 36 18 canonical✓ gadget
pc-kernel 4.15.0-72.81 346 18 canonical✓ kernel
pulseaudio 8.0-3 9 stable canonical✓ -
qabro 0.11.1 99 stable pieq devmode
snapd 2.42.4 5643 stable canonical✓ snapd
sysconfs-nuc7 1 x1 - - -

[Jonathan Cave (jocave)]

I decided to see if I could reproduce this problem with newer versions of checkbox-ng.

I found that the current stable release produces a different stack trace after the submssion description is entered (see attachment).

With latest master versions the exception is caught and error message printed:

file:///home/joc/.local/share/checkbox-ng/submission_2020-05-01T16.49.25.912461.tar.xz
96.0kB [00:00, 1.09MB/s, file=/home/joc/.local/share/checkbox-ng/submission_2020-05-01T16.49.25.912461.xlsx]
file:///home/joc/.local/share/checkbox-ng/submission_2020-05-01T16.49.25.912461.xlsx
Do you want to submit 'upload to certification' report?
  y => yes
  n => no
[yn]: y
Enter submission description (press Enter to skip): Remote testing
Problem with a 'upload to certification' report using 'com.canonical.plainbox::tar' exporter sent to '/home/joc/.local/share/checkbox-ng/submission_2020-05-01T16.49.25.912461.xlsx' transport.

However, it's fair to say the problem persists.

[Pierre Equoy (pieq)]

Followed the procedure described by Ray to test using

checkbox-snappy 20.15 rev2035 from latest/beta channel

The submission worked (see: https://certification.canonical.com/hardware/201903-26881/submission/170959/)