OSTF test "Update stack actions: inplace, replace and update whole template" has failed without any errors

[Anastasia Palkina]

"build_id": "2015-06-08_06-13-27",
"build_number": "521",
"release_versions": {"2014.2.2-6.1": {"VERSION": {"build_id": "2015-06-08_06-13-27", "build_number": "521", "api": "1.0", "fuel-library_sha": "f43c2ae1af3b493ee0e7810eab7bb7b50c986c7d", "nailgun_sha": "4340d55c19029394cd5610b0e0f56d6cb8cb661b", "feature_groups": ["mirantis"], "openstack_version": "2014.2.2-6.1", "production": "docker", "python-fuelclient_sha": "4fc55db0265bbf39c369df398b9dc7d6469ba13b", "astute_sha": "7766818f079881e2dbeedb34e1f67e517ed7d479", "fuel-ostf_sha": "7c938648a246e0311d05e2372ff43ef1eb2e2761", "release": "6.1", "fuelmain_sha": "bcc909ffc5dd5156ba54cae348b6a07c1b607b24"}}},
"auth_required": true,
"api": "1.0",
"fuel-library_sha": "f43c2ae1af3b493ee0e7810eab7bb7b50c986c7d",
"nailgun_sha": "4340d55c19029394cd5610b0e0f56d6cb8cb661b",
"feature_groups": ["mirantis"],
"openstack_version": "2014.2.2-6.1",
"production": "docker",
"python-fuelclient_sha": "4fc55db0265bbf39c369df398b9dc7d6469ba13b",
"astute_sha": "7766818f079881e2dbeedb34e1f67e517ed7d479",
"fuel-ostf_sha": "7c938648a246e0311d05e2372ff43ef1eb2e2761",
"release": "6.1",
"fuelmain_sha": "bcc909ffc5dd5156ba54cae348b6a07c1b607b24"

1. Create new environment (CentOS)
2. Choose nova-network, VLAN Manager
3. Choose Ceph for volumes and Ceph for images
4. Choose Ceilometer
5. Add 3 controller+mongo, 1 compute, 3 ceph
5. Change disk configuration for all Ceph nodes. Change 'Ceph' volume for vdc
6. Deploy the environment. It was successful
7. Run OSTF tests. OSTF test "Update stack actions: inplace, replace and update whole template" has failed without any errors (see screen)

In /var/log/docker-ostf.log

{"explanation": "The server has either erred or is incapable of performing the requested operation.", "code": 500, "error": {"message": "Failed to stop stack (ost1_test-445308955) on other engine (d4866b10-f11e-4907-abfb-1858a8e099fe)", "traceback": "Traceback (most recent call last):\n\n File \"/usr/lib/python2.6/site-packages/heat/engine/service.py\", line 69, in wrapped\n return func(self, ctx, *args, **kwargs)\n\n File \"/usr/lib/python2.6/site-packages/heat/engine/service.py\", line 894, in delete_stack\n engine_id=acquire_result)\n\nStopActionFailed: Failed to stop stack (ost1_test-445308955) on other engine (d4866b10-f11e-4907-abfb-1858a8e099fe)\n", "type": "StopActionFailed"}, "title": "Internal Server Error"}

Logs are here: https://drive.google.com/a/mirantis.com/file/d/0B6SjzarTGFxadXhVc25QYzMxTkk/view?usp=sharing

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/189672

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/6.1
Review: https://review.openstack.org/189677

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/189672
Committed: https://git.openstack.org/cgit/stackforge/fuel-ostf/commit/?id=7d0cc3920a4961827c2acd4fb85b661e167e5ab7
Submitter: Jenkins
Branch: master

commit 7d0cc3920a4961827c2acd4fb85b661e167e5ab7
Author: Anastasia Kuznetsova <email address hidden>
Date: Tue Jun 9 14:56:26 2015 +0300

    Add error catching to the cleanup method for Heat tests

    If the test fails on some step it calls cleanup method that tries
    to delete the created stack, but in case if there is some problem
    in it user won't see errors in FUEL web, that's why error catching
    was added.

    Closes-Bug: #1463339

    Change-Id: I93b72d24e54dde31c9dd608c98be857aa9a65657

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/189677
Committed: https://git.openstack.org/cgit/stackforge/fuel-ostf/commit/?id=ecb6c182cde8a5d8ab97f1d9c75c6c33f562123f
Submitter: Jenkins
Branch: stable/6.1

commit ecb6c182cde8a5d8ab97f1d9c75c6c33f562123f
Author: Anastasia Kuznetsova <email address hidden>
Date: Tue Jun 9 14:56:26 2015 +0300

    Add error catching to the cleanup method for Heat tests

    If the test fails on some step it calls cleanup method that tries
    to delete the created stack, but in case if there is some problem
    in it user won't see errors in FUEL web, that's why error catching
    was added.

    Closes-Bug: #1463339

    Change-Id: I93b72d24e54dde31c9dd608c98be857aa9a65657

[Maksym Strukov (unbelll)]

Verified as fixed in 7.0-22

{"build_id": "2015-07-02_07-14-17", "build_number": "22", "release_versions": {"2014.2.2-7.0": {"VERSION": {"build_id": "2015-07-02_07-14-17", "build_number": "22", "api": "1.0", "fuel-library_sha": "f25d5da0a95b000fe654e03e08eb09dbfdd2caaa", "nailgun_sha": "f7a87bf0039727678bffe160991d643433d2031c", "feature_groups": ["mirantis"], "openstack_version": "2014.2.2-7.0", "production": "docker", "python-fuelclient_sha": "315d8bf991fbe7e2ab91abfc1f59b2f24fd92f45", "astute_sha": "4669156830daa3bb39573ad4a821bb1a0e2702eb", "fuel-ostf_sha": "a752c857deafd2629baf646b1b3188f02ff38084", "release": "7.0", "fuelmain_sha": "4f2dff3bdc327858fa45bcc2853cfbceae68a40c"}}}, "auth_required": true, "api": "1.0", "fuel-library_sha": "f25d5da0a95b000fe654e03e08eb09dbfdd2caaa", "nailgun_sha": "f7a87bf0039727678bffe160991d643433d2031c", "feature_groups": ["mirantis"], "openstack_version": "2014.2.2-7.0", "production": "docker", "python-fuelclient_sha": "315d8bf991fbe7e2ab91abfc1f59b2f24fd92f45", "astute_sha": "4669156830daa3bb39573ad4a821bb1a0e2702eb", "fuel-ostf_sha": "a752c857deafd2629baf646b1b3188f02ff38084", "release": "7.0", "fuelmain_sha": "4f2dff3bdc327858fa45bcc2853cfbceae68a40c"}

[Maksym Strukov (unbelll)]

Verified as fixed in 6.1-525

{"build_id": "2015-06-19_13-02-31", "build_number": "525", "release_versions": {"2014.2.2-6.1": {"VERSION": {"build_id": "2015-06-19_13-02-31", "build_number": "525", "api": "1.0", "fuel-library_sha": "2e7a08ad9792c700ebf08ce87f4867df36aa9fab", "nailgun_sha": "dbd54158812033dd8cfd7e60c3f6650f18013a37", "feature_groups": ["mirantis"], "openstack_version": "2014.2.2-6.1", "production": "docker", "python-fuelclient_sha": "4fc55db0265bbf39c369df398b9dc7d6469ba13b", "astute_sha": "1ea8017fe8889413706d543a5b9f557f5414beae", "fuel-ostf_sha": "8fefcf7c4649370f00847cc309c24f0b62de718d", "release": "6.1", "fuelmain_sha": "a3998372183468f56019c8ce21aa8bb81fee0c2f"}}}, "auth_required": true, "api": "1.0", "fuel-library_sha": "2e7a08ad9792c700ebf08ce87f4867df36aa9fab", "nailgun_sha": "dbd54158812033dd8cfd7e60c3f6650f18013a37", "feature_groups": ["mirantis"], "openstack_version": "2014.2.2-6.1", "production": "docker", "python-fuelclient_sha": "4fc55db0265bbf39c369df398b9dc7d6469ba13b", "astute_sha": "1ea8017fe8889413706d543a5b9f557f5414beae", "fuel-ostf_sha": "8fefcf7c4649370f00847cc309c24f0b62de718d", "release": "6.1", "fuelmain_sha": "a3998372183468f56019c8ce21aa8bb81fee0c2f"}