Tempest test scenarios are insufficient

[Hiroaki Kobayashi]

There is only one scenario for the tempest test. Following scenarios are needed for the host reservation:

* Lease expiration test: Check if all resources related to the lease are correctly released with the expiration of the lease.

* Lease termination test: Check if all resources related to the lease are correctly released at the time a user terminates the lease by delete_lease or update_lease request.

* Lease update test (time): Check if an update lease request is correctly processed.

* Lease update test (capacity (this feature is addressed by https://blueprints.launchpad.net/blazar/+spec/update-reserved-capacity)): Check if an update lease request is correctly processed.

* before_end actions test: Check if before_end actions are successfully executed at the before_end_date.

* Request failure test: Check if the Blazar returns errors where a request is invalid.

[Masahito Muroi (muroi-masahito)]

Could you describe or list what scenarios are missing? I want to add this the milestone for 0.3.0 when the scenarios are clear. It's better for this kind of bug reports to be actionable.

[Hiroaki Kobayashi (hiro-kobayashi)]

I've added test scenarios. Please check if they are sufficient.

[Masahito Muroi (muroi-masahito)]

All the scenarios are targeted to Queens release.

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/482532
Committed: https://git.openstack.org/cgit/openstack/blazar/commit/?id=adeb401abcd967bd8a1d602c1b74067a15d9d901
Submitter: Zuul
Branch: master

commit adeb401abcd967bd8a1d602c1b74067a15d9d901
Author: Maho Koshiya <email address hidden>
Date: Sat Jul 1 08:11:28 2017 +0900

    Add scenario test of lease expiration

    The reserved host for blazar users are released when the lease expires,
    and host aggregate that created for Blazar is deleted.
    Check the instance created during the expiration has been removed
    by release of host.

    Change-Id: Ied3c766a1d7d839eb4301b494e4b35c75151f242
    Partial-bug: #1694181

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/490351
Committed: https://git.openstack.org/cgit/openstack/blazar/commit/?id=5cd53f330879187fc43899db406bf30c65d95915
Submitter: Zuul
Branch: master

commit 5cd53f330879187fc43899db406bf30c65d95915
Author: Maho Koshiya <email address hidden>
Date: Wed Jul 5 07:41:29 2017 +0900

    Add a termination scenario test

    When the user specifies end_time and executes update API,
    check that resources are correctly released at lease end time.
    It confirm that the instance created during the lease period
    have been removed by lease end.

    Change-Id: Ic1076905ad5f2fc894036b045743eacb5c2db9bd
    Partial-bug: #1694181