Interactive html report shows success when sla failed

Bug #1801972 reported by Oded Le'Sage
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
shaker
Fix Released
Undecided
Unassigned

Bug Description

Issue: When a test fails due to SLA the interactive html report still shows a 'success', it would be better if the interactive report shows 'sla fail'

To replicate:
Run scenarios/spot/ping.yaml with an SLA that will fail e.g. stats.ping_icmp.avg < 3

The console output will show:
2018-11-06 09:39:41.482 18462 INFO shaker.engine.report [-] ********************************************************************************
2018-11-06 09:39:41.483 18462 INFO shaker.engine.report [-] Ping.Ping.1.135.16.226.207:stats.ping_icmp.avg < 3 [FAIL]
2018-11-06 09:39:41.483 18462 INFO shaker.engine.report [-] ********************************************************************************

However the html report will show 'success'

Revision history for this message
Oded Le'Sage (ol7435) wrote :
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to shaker (master)

Reviewed: https://review.openstack.org/615943
Committed: https://git.openstack.org/cgit/openstack/shaker/commit/?id=5f84721040fc9327acdc2897990ba2881ec615a6
Submitter: Zuul
Branch: master

commit 5f84721040fc9327acdc2897990ba2881ec615a6
Author: Oded Le'Sage <email address hidden>
Date: Tue Nov 6 10:41:56 2018 -0600

    Fix bug with interactive report and SLA failures

    This commit is to fix a bug where a test will fail due to the SLA not
    being met but the interactive html report shows 'success'. This fixes
    interactive html report to show 'sla fail'.

    Change-Id: Ief30bf5125013805e3aef75f74a892e71c41ea6e
    Closes-Bug: 1801972

Changed in shaker:
status: New → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.