stackviz failing on py3 causing tempest-full-py3 POST_FAILURES

Bug #1758054 reported by Dr. Jens Harbott on 2018-03-22
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack-Gate
Critical
Clark Boylan
StackViz
Undecided
Tim Buckley
tempest
Undecided
Unassigned

Bug Description

Jobs are failing in POST with a backtrace:

2018-03-22 11:13:28.428260 | TASK [process-stackviz : Run stackviz with dstat]
2018-03-22 11:13:29.099433 | controller | Exporting DStat log
2018-03-22 11:13:29.100296 | controller | Traceback (most recent call last):
2018-03-22 11:13:29.100452 | controller | File "/tmp/stackviz/bin/stackviz-export", line 11, in <module>
2018-03-22 11:13:29.100517 | controller | sys.exit(main())
2018-03-22 11:13:29.100684 | controller | File "/tmp/stackviz/lib/python3.5/site-packages/stackviz/export.py", line 272, in main
2018-03-22 11:13:29.100758 | controller | args.stdin)
2018-03-22 11:13:29.100953 | controller | File "/tmp/stackviz/lib/python3.5/site-packages/stackviz/parser/tempest_subunit.py", line 200, in get_providers
2018-03-22 11:13:29.101035 | controller | p = StandardInputProvider()
2018-03-22 11:13:29.101222 | controller | File "/tmp/stackviz/lib/python3.5/site-packages/stackviz/parser/tempest_subunit.py", line 143, in __init__
2018-03-22 11:13:29.101317 | controller | shutil.copyfileobj(sys.stdin, self.buffer)
2018-03-22 11:13:29.101446 | controller | File "/tmp/stackviz/lib/python3.5/shutil.py", line 73, in copyfileobj
2018-03-22 11:13:29.101510 | controller | buf = fsrc.read(length)
2018-03-22 11:13:29.101644 | controller | File "/tmp/stackviz/lib/python3.5/codecs.py", line 321, in decode
2018-03-22 11:13:29.101776 | controller | (result, consumed) = self._buffer_decode(data, self.errors, final)
2018-03-22 11:13:29.101938 | controller | UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb3 in position 0: invalid start byte
2018-03-22 11:13:29.124170 | controller | cat: write error: Broken pipe
2018-03-22 11:13:29.544320 | controller | ERROR
2018-03-22 11:13:29.544765 | controller | {
2018-03-22 11:13:29.544902 | controller | "delta": "0:00:00.289667",
2018-03-22 11:13:29.545030 | controller | "end": "2018-03-22 11:13:29.124700",
2018-03-22 11:13:29.545138 | controller | "failed": true,
2018-03-22 11:13:29.545261 | controller | "rc": 1,
2018-03-22 11:13:29.545367 | controller | "start": "2018-03-22 11:13:28.835033"
2018-03-22 11:13:29.545487 | controller | }

Failures started today at about 07:00.

Dr. Jens Harbott (j-harbott) wrote :

Seems related to new Xenial images that no longer have python2 installed, causing stackviz now being run with python3.

summary: - stackviz failing on tempest-full-py3
+ stackviz failing on py3 causing tempest-full-py3 POST_FAILURES

Fix proposed to branch: master
Review: https://review.openstack.org/555388

Changed in stackviz:
assignee: nobody → Tim Buckley (timothy-jas-buckley)
status: New → In Progress

Reviewed: https://review.openstack.org/555314
Committed: https://git.openstack.org/cgit/openstack/tempest/commit/?id=aacf6e89acd4f871ed7e5ee834a5bee4c1e8b909
Submitter: Zuul
Branch: master

commit aacf6e89acd4f871ed7e5ee834a5bee4c1e8b909
Author: Jens Harbott <email address hidden>
Date: Thu Mar 22 14:09:46 2018 +0000

    Do not fail on stackviz issues

    The process-stackviz role only helps with analyzing runs, when it fails
    it should not cause the whole job to suffer a POST_FAILURE.

    Change-Id: Icfd6b2fc7adb42afb7900ea4458fa60cefc76fdb
    Related-Bug: 1758054

chandan kumar (chkumar246) wrote :

Is it still affecting Tempest? if not can we remove it from tempest?

Change abandoned by Tim Buckley (<email address hidden>) on branch: master
Review: https://review.openstack.org/555388
Reason: superseded by #606184

Clark Boylan (cboylan) wrote :

https://review.openstack.org/#/c/606184/ ended up fixing this. Then we had to update the nodepool image build url for stackviz,https://review.openstack.org/#/c/608044/. These two changes together have fixed this bug in the gate.

Changed in tempest:
status: New → Invalid
Changed in openstack-gate:
status: New → Fix Released
Changed in stackviz:
status: In Progress → Fix Released
Changed in openstack-gate:
assignee: nobody → Clark Boylan (cboylan)
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers