stackviz failing on py3 causing tempest-full-py3 POST_FAILURES

Bug #1758054 reported by Dr. Jens Harbott
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack-Gate
Fix Released
Critical
Clark Boylan
StackViz
Fix Released
Undecided
Tim Buckley
tempest
Invalid
Undecided
Unassigned

Bug Description

Jobs are failing in POST with a backtrace:

2018-03-22 11:13:28.428260 | TASK [process-stackviz : Run stackviz with dstat]
2018-03-22 11:13:29.099433 | controller | Exporting DStat log
2018-03-22 11:13:29.100296 | controller | Traceback (most recent call last):
2018-03-22 11:13:29.100452 | controller | File "/tmp/stackviz/bin/stackviz-export", line 11, in <module>
2018-03-22 11:13:29.100517 | controller | sys.exit(main())
2018-03-22 11:13:29.100684 | controller | File "/tmp/stackviz/lib/python3.5/site-packages/stackviz/export.py", line 272, in main
2018-03-22 11:13:29.100758 | controller | args.stdin)
2018-03-22 11:13:29.100953 | controller | File "/tmp/stackviz/lib/python3.5/site-packages/stackviz/parser/tempest_subunit.py", line 200, in get_providers
2018-03-22 11:13:29.101035 | controller | p = StandardInputProvider()
2018-03-22 11:13:29.101222 | controller | File "/tmp/stackviz/lib/python3.5/site-packages/stackviz/parser/tempest_subunit.py", line 143, in __init__
2018-03-22 11:13:29.101317 | controller | shutil.copyfileobj(sys.stdin, self.buffer)
2018-03-22 11:13:29.101446 | controller | File "/tmp/stackviz/lib/python3.5/shutil.py", line 73, in copyfileobj
2018-03-22 11:13:29.101510 | controller | buf = fsrc.read(length)
2018-03-22 11:13:29.101644 | controller | File "/tmp/stackviz/lib/python3.5/codecs.py", line 321, in decode
2018-03-22 11:13:29.101776 | controller | (result, consumed) = self._buffer_decode(data, self.errors, final)
2018-03-22 11:13:29.101938 | controller | UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb3 in position 0: invalid start byte
2018-03-22 11:13:29.124170 | controller | cat: write error: Broken pipe
2018-03-22 11:13:29.544320 | controller | ERROR
2018-03-22 11:13:29.544765 | controller | {
2018-03-22 11:13:29.544902 | controller | "delta": "0:00:00.289667",
2018-03-22 11:13:29.545030 | controller | "end": "2018-03-22 11:13:29.124700",
2018-03-22 11:13:29.545138 | controller | "failed": true,
2018-03-22 11:13:29.545261 | controller | "rc": 1,
2018-03-22 11:13:29.545367 | controller | "start": "2018-03-22 11:13:28.835033"
2018-03-22 11:13:29.545487 | controller | }

Failures started today at about 07:00.

Revision history for this message
Dr. Jens Harbott (j-harbott) wrote :
Revision history for this message
Dr. Jens Harbott (j-harbott) wrote :

Seems related to new Xenial images that no longer have python2 installed, causing stackviz now being run with python3.

summary: - stackviz failing on tempest-full-py3
+ stackviz failing on py3 causing tempest-full-py3 POST_FAILURES
Revision history for this message
Matt Riedemann (mriedem) wrote :
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to stackviz (master)

Fix proposed to branch: master
Review: https://review.openstack.org/555388

Changed in stackviz:
assignee: nobody → Tim Buckley (timothy-jas-buckley)
status: New → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tempest (master)

Reviewed: https://review.openstack.org/555314
Committed: https://git.openstack.org/cgit/openstack/tempest/commit/?id=aacf6e89acd4f871ed7e5ee834a5bee4c1e8b909
Submitter: Zuul
Branch: master

commit aacf6e89acd4f871ed7e5ee834a5bee4c1e8b909
Author: Jens Harbott <email address hidden>
Date: Thu Mar 22 14:09:46 2018 +0000

    Do not fail on stackviz issues

    The process-stackviz role only helps with analyzing runs, when it fails
    it should not cause the whole job to suffer a POST_FAILURE.

    Change-Id: Icfd6b2fc7adb42afb7900ea4458fa60cefc76fdb
    Related-Bug: 1758054

Revision history for this message
chandan kumar (chkumar246) wrote :

Is it still affecting Tempest? if not can we remove it from tempest?

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on stackviz (master)

Change abandoned by Tim Buckley (<email address hidden>) on branch: master
Review: https://review.openstack.org/555388
Reason: superseded by #606184

Revision history for this message
Clark Boylan (cboylan) wrote :

https://review.openstack.org/#/c/606184/ ended up fixing this. Then we had to update the nodepool image build url for stackviz,https://review.openstack.org/#/c/608044/. These two changes together have fixed this bug in the gate.

Changed in tempest:
status: New → Invalid
Changed in openstack-gate:
status: New → Fix Released
Changed in stackviz:
status: In Progress → Fix Released
Changed in openstack-gate:
assignee: nobody → Clark Boylan (cboylan)
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.