[Vanilla2]Cluster failed to terminate in 300 seconds

Bug #1414981 reported by Evgeny Sikachev
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Sahara
Fix Released
Medium
Evgeny Sikachev

Bug Description

Run integration tests for Vanilla2 plugin

Expected result: Tests pass
Actual result: Cluster failed to terminate in 300 seconds

TRACE:
integration runtests: PYTHONHASHSEED='2998335380'
integration runtests: commands[0] | bash tools/pretty_tox.sh vanilla2 --concurrency=1
{0} tests.gating.test_vanilla_two_gating.VanillaTwoGatingTest.test_vanilla_two_plugin_gating [1552.119391s] ... FAILED

Captured stdout:
~~~~~~~~~~~~~~~~

    =======================================================
    INFO: Test for Map Reduce was skipped.
    =======================================================

    =======================================================
    INFO: Test for check of Swift availability was skipped.
    =======================================================

    =======================================================
    INFO: Test for Map Reduce was skipped.
    =======================================================

    =======================================================
    INFO: Test for check of Swift availability was skipped.
    =======================================================

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):
      File "sahara/tests/integration/tests/base.py", line 632, in delete_objects
        '%s' % cluster_id)
      File "/home/jenkins/workspace/gate-sahara-neutron-heat-vanilla_2.4/.tox/integration/local/lib/python2.7/site-packages/unittest2/case.py", line 666, in fail
        raise self.failureException(msg)
    AssertionError: Cluster failed to terminate in 300 seconds: e9bda067-3026-476c-8e93-c05ad540209e
    Traceback (most recent call last):
    _StringException: Empty attachments:
      stderr

    stdout: {{{
    =======================================================
    INFO: Test for Map Reduce was skipped.
    =======================================================

    =======================================================
    INFO: Test for check of Swift availability was skipped.
    =======================================================

    =======================================================
    INFO: Test for Map Reduce was skipped.
    =======================================================

    =======================================================
    INFO: Test for check of Swift availability was skipped.
    =======================================================
    }}}

    traceback-1: {{{
    Traceback (most recent call last):
      File "sahara/tests/integration/tests/base.py", line 635, in delete_objects
        self.sahara.cluster_templates.delete(cluster_template_id)
      File "/home/jenkins/workspace/gate-sahara-neutron-heat-vanilla_2.4/.tox/integration/local/lib/python2.7/site-packages/saharaclient/api/cluster_templates.py", line 72, in delete
        self._delete('/cluster-templates/%s' % cluster_template_id)
      File "/home/jenkins/workspace/gate-sahara-neutron-heat-vanilla_2.4/.tox/integration/local/lib/python2.7/site-packages/saharaclient/api/base.py", line 130, in _delete
        self._raise_api_exception(resp)
      File "/home/jenkins/workspace/gate-sahara-neutron-heat-vanilla_2.4/.tox/integration/local/lib/python2.7/site-packages/saharaclient/api/base.py", line 146, in _raise_api_exception
        error_message=error_data.get("error_message"))
    APIException: Cluster template 00f08fbd-fbf6-492c-8b66-50f6b84ed20c in use by c1-2-4-741-143950-11-vanilla-v2
    Error ID: ed1350c7-0f0a-48ec-b110-f9a8e53509ca
    }}}

    traceback-2: {{{
    Traceback (most recent call last):
      File "sahara/tests/integration/tests/base.py", line 639, in delete_objects
        node_group_template_id
      File "/home/jenkins/workspace/gate-sahara-neutron-heat-vanilla_2.4/.tox/integration/local/lib/python2.7/site-packages/saharaclient/api/node_group_templates.py", line 106, in delete
        self._delete('/node-group-templates/%s' % ng_template_id)
      File "/home/jenkins/workspace/gate-sahara-neutron-heat-vanilla_2.4/.tox/integration/local/lib/python2.7/site-packages/saharaclient/api/base.py", line 130, in _delete
        self._raise_api_exception(resp)
      File "/home/jenkins/workspace/gate-sahara-neutron-heat-vanilla_2.4/.tox/integration/local/lib/python2.7/site-packages/saharaclient/api/base.py", line 146, in _raise_api_exception
        error_message=error_data.get("error_message"))
    APIException: Node group template 5c51b5a5-eb8f-4e05-a546-787367eaaa0e is in use by cluster templates: test-cluster-template-vanilla; and clusters: c1-2-4-741-143950-11-vanilla-v2
    Error ID: 501abe3c-ba00-4d04-9b1a-c5c11be2f1de
    }}}

    traceback-3: {{{
    Traceback (most recent call last):
      File "sahara/tests/integration/tests/base.py", line 639, in delete_objects
        node_group_template_id
      File "/home/jenkins/workspace/gate-sahara-neutron-heat-vanilla_2.4/.tox/integration/local/lib/python2.7/site-packages/saharaclient/api/node_group_templates.py", line 106, in delete
        self._delete('/node-group-templates/%s' % ng_template_id)
      File "/home/jenkins/workspace/gate-sahara-neutron-heat-vanilla_2.4/.tox/integration/local/lib/python2.7/site-packages/saharaclient/api/base.py", line 130, in _delete
        self._raise_api_exception(resp)
      File "/home/jenkins/workspace/gate-sahara-neutron-heat-vanilla_2.4/.tox/integration/local/lib/python2.7/site-packages/saharaclient/api/base.py", line 146, in _raise_api_exception
        error_message=error_data.get("error_message"))
    APIException: Node group template 344e07ce-9336-48cf-9529-bbf4f628abab is in use by cluster templates: test-cluster-template-vanilla; and clusters: c1-2-4-741-143950-11-vanilla-v2
    Error ID: da758d12-dcdf-4873-9fc2-f133399985c5
    }}}

    traceback-4: {{{
    Traceback (most recent call last):
      File "sahara/tests/integration/tests/base.py", line 639, in delete_objects
        node_group_template_id
      File "/home/jenkins/workspace/gate-sahara-neutron-heat-vanilla_2.4/.tox/integration/local/lib/python2.7/site-packages/saharaclient/api/node_group_templates.py", line 106, in delete
        self._delete('/node-group-templates/%s' % ng_template_id)
      File "/home/jenkins/workspace/gate-sahara-neutron-heat-vanilla_2.4/.tox/integration/local/lib/python2.7/site-packages/saharaclient/api/base.py", line 130, in _delete
        self._raise_api_exception(resp)
      File "/home/jenkins/workspace/gate-sahara-neutron-heat-vanilla_2.4/.tox/integration/local/lib/python2.7/site-packages/saharaclient/api/base.py", line 146, in _raise_api_exception
        error_message=error_data.get("error_message"))
    APIException: Node group template bf038b62-e08a-4016-8823-44b5c1e643ca is in use by cluster templates: test-cluster-template-vanilla; and clusters: c1-2-4-741-143950-11-vanilla-v2
    Error ID: 7e77e74a-b34d-4d0d-8663-fc436944f49e
    }}}

    Traceback (most recent call last):
      File "sahara/tests/integration/tests/base.py", line 632, in delete_objects
        '%s' % cluster_id)
      File "/home/jenkins/workspace/gate-sahara-neutron-heat-vanilla_2.4/.tox/integration/local/lib/python2.7/site-packages/unittest2/case.py", line 666, in fail
        raise self.failureException(msg)
    AssertionError: Cluster failed to terminate in 300 seconds: e9bda067-3026-476c-8e93-c05ad540209e

    Traceback (most recent call last):
    _StringException: Empty attachments:
      stderr

    stdout: {{{

Changed in sahara:
assignee: nobody → Evgeny Sikachev (esikachev)
description: updated
Changed in sahara:
status: New → Triaged
importance: Undecided → Medium
milestone: none → kilo-2
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to sahara (master)

Fix proposed to branch: master
Review: https://review.openstack.org/150778

Changed in sahara:
status: Triaged → In Progress
Changed in sahara:
milestone: kilo-2 → kilo-3
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to sahara (master)

Reviewed: https://review.openstack.org/150778
Committed: https://git.openstack.org/cgit/openstack/sahara/commit/?id=7ecfb9958e6ec55978095d169aed468d66eabef4
Submitter: Jenkins
Branch: master

commit 7ecfb9958e6ec55978095d169aed468d66eabef4
Author: Evgeny Sikachev <email address hidden>
Date: Wed Jan 28 16:35:24 2015 +0300

    Refactoring methods for terminating

    Modified method for terminate clusters, cluster templates, node group template

    Closes-bug: #1414981

    Change-Id: Ia691d36c70ad7d4b97ed2a7476d447dd8b817f21

Changed in sahara:
status: In Progress → Fix Committed
Thierry Carrez (ttx)
Changed in sahara:
status: Fix Committed → Fix Released
Thierry Carrez (ttx)
Changed in sahara:
milestone: kilo-3 → 2015.1.0
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.