AutoScalingTest has issues with timing and memory reporting values

Bug #1257575 reported by Steve Baker
16
This bug affects 3 people
Affects Status Importance Assigned to Milestone
tempest
Invalid
Wishlist
Steve Baker

Bug Description

AutoScalingTest has issues which will require rethinking how this test is implemented, including:
- the optimal ConsumeStopSeconds will depend on the overhead of boot time, which varies greatly between bare metal and virt-on-virt
- every combination of distro/release/flavor will result in a different baseline memory usage, making it difficult to determine the ScaleDownThreshold to set

I recommend that this test be skipped until other tests in heat-slow are passing in gate during check experimental, then it can be implemented as a more robust scenario.

Changed in tempest:
assignee: nobody → Steve Baker (steve-stevebaker)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tempest (master)

Fix proposed to branch: master
Review: https://review.openstack.org/59887

Changed in tempest:
status: New → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tempest (master)

Reviewed: https://review.openstack.org/59887
Committed: https://git.openstack.org/cgit/openstack/tempest/commit/?id=ace4e6d3b0b1d29cdf21a7ad73e0780ef1066e7d
Submitter: Jenkins
Branch: master

commit ace4e6d3b0b1d29cdf21a7ad73e0780ef1066e7d
Author: Steve Baker <email address hidden>
Date: Wed Dec 4 15:56:45 2013 +1300

    Skip autoscaling test until more reliable

    AutoScalingTest has issues which will require rethinking how
    this test is implemented, including:
    - the optimal ConsumeStopSeconds will depend on the overhead
      of boot time, which varies greatly between bare metal and
      virt-on-virt
    - every combination of distro/release/flavor will result in a
      different baseline memory usage, making it difficult to
      determine the ScaleDownThreshold to set

    This change skips this test and tracks against the bug:
    Partial-Bug: #1257575

    Change-Id: I0695a7efacdbeab39c895a97cb45496fcaf97e35

Sean Dague (sdague)
Changed in tempest:
importance: Undecided → Wishlist
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on tempest (master)

Change abandoned by Steve Baker (<email address hidden>) on branch: master
Review: https://review.openstack.org/44967
Reason: moving to heat functional test

Revision history for this message
Yaroslav Lobankov (ylobankov) wrote :

This test was moved from Tempest to Heat functional tests. Moreover, Tempest doesn't have any Heat scenario tests now. Marking this bug as "Invalid".

Changed in tempest:
status: In Progress → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.