Tacker dsvm functional gate test failed with VM quota reached error

[Sridhar Ramaswamy]

In recent runs of Tacker dsvm functional gate, the test intermittently fails with following error as seen in [1],

Resource CREATE failed: Forbidden: resources.VDU2: Quota exceeded for instances: Requested 1, but already used 10 of 10 instances (HTTP 403)

The root cause is tacker functional tests run and parallel which, in tacker's case, ends up spawning lots of VMs (particularly when monitoring respawn scenarios kick in).

We need a solution to either increase the quota for tacker dsvm test (preferred) or make the tests serial so that the quota limit is not hit.

[1] http://logs.openstack.org/37/299737/4/check/gate-tacker-dsvm-functional/bfe4f87/logs/screen-tacker.txt.gz

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/308854

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/308854
Committed: https://git.openstack.org/cgit/openstack/tacker/commit/?id=d9a9892c87f3c246b4f851b3a696129bf82feab4
Submitter: Jenkins
Branch: master

commit d9a9892c87f3c246b4f851b3a696129bf82feab4
Author: Sridhar Ramaswamy <email address hidden>
Date: Thu Apr 21 09:00:36 2016 +0000

    Disable nova quota for dsvm functional test

    Parallel execution of tacker functional test ends up
    creating lots of VMs and eventually fails hitting the
    default max instance of 10. This fix disables quota for
    tacker functional test suite. However gate VMs still has
    upper constraint on resources like 8GB max limit. To avoid
    tripping the actual gate VM resource limit reduce concurrency
    to a lower number (2).

    Change-Id: I3fe8c012b85554fa21b5b4b64378d68e3d979cc2
    Closes-Bug: #1572420

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/313977

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/313977
Committed: https://git.openstack.org/cgit/openstack/tacker/commit/?id=0d1354f85fbe8c3b3fb097af430a4e4859428880
Submitter: Jenkins
Branch: stable/mitaka

commit 0d1354f85fbe8c3b3fb097af430a4e4859428880
Author: Sridhar Ramaswamy <email address hidden>
Date: Thu Apr 21 09:00:36 2016 +0000

    Disable nova quota for dsvm functional test

    Parallel execution of tacker functional test ends up
    creating lots of VMs and eventually fails hitting the
    default max instance of 10. This fix disables quota for
    tacker functional test suite. However gate VMs still has
    upper constraint on resources like 8GB max limit. To avoid
    tripping the actual gate VM resource limit reduce concurrency
    to a lower number (2).

    Change-Id: I3fe8c012b85554fa21b5b4b64378d68e3d979cc2
    Closes-Bug: #1572420
    (cherry picked from commit d9a9892c87f3c246b4f851b3a696129bf82feab4)

[Doug Hellmann (doug-hellmann)]

This issue was fixed in the openstack/tacker 0.3.1 release.

[Doug Hellmann (doug-hellmann)]

This issue was fixed in the openstack/tacker 0.4.0 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/tacker 0.3.1 release.