OSTF test "Sahara tests to create, list, start, checks and delete cluster" failed without any messages

[Anastasia Palkina]

master ISO #506

"build_id": "2014-09-10_00-01-12", "ostf_sha": "1de6ed1c0b72f6687ffb4bebc2c939b135a88e34", "build_number": "506", "auth_required": true, "api": "1.0", "nailgun_sha": "82091e0d61f252619a0842d0f8debb6b602a61fe", "production": "docker", "fuelmain_sha": "ca1b4839a70a10041f8eaf8b9ac995c8b0d4521a", "astute_sha": "b622d9b36dbdd1e03b282b9ee5b7435ba649e711", "feature_groups": ["mirantis"], "release": "5.1", "release_versions": {"2014.1.1-5.1": {"VERSION": {"build_id": "2014-09-10_00-01-12", "ostf_sha": "1de6ed1c0b72f6687ffb4bebc2c939b135a88e34", "build_number": "506", "api": "1.0", "nailgun_sha": "82091e0d61f252619a0842d0f8debb6b602a61fe", "production": "docker", "fuelmain_sha": "ca1b4839a70a10041f8eaf8b9ac995c8b0d4521a", "astute_sha": "b622d9b36dbdd1e03b282b9ee5b7435ba649e711", "feature_groups": ["mirantis"], "release": "5.1", "fuellib_sha": "e3f947cc4142210499a282bc5f183c333552fa23"}}}, "fuellib_sha": "e3f947cc4142210499a282bc5f183c333552fa23"

1. Create new environment (CentOS, simple mode)
2. Choose Sahara for installing
3. Add controller, compute, cinder
4. Start deployment. It was successful
5. Start OSTF tests
6. Test "Sahara tests to create, list, start, checks and delete cluster" failed without any messages (see screen)

[Yaroslav Lobankov (ylobankov)]

I have deployed the environment described in the bug description, but I couldn't reproduce this bug. As far as I understood, when Anastasia ran the test, she was expecting to see expected exception like this:

Sahara image with tags wasn't imported into Glance, please check http://docs.mirantis.com/openstack/fuel/fuel-5.0/user-guide.html#platform-tests-description

As we can see, there is no exception on Anastasia's screenshot. When I ran the test on my environment, I could see the exception (see attached screenshot).

[Anastasia Palkina (apalkina)]

Reproduced on ISO #3 for 5.1

"build_id": "2014-09-11_01-04-40", "ostf_sha": "1de6ed1c0b72f6687ffb4bebc2c939b135a88e34", "build_number": "3", "auth_required": true, "api": "1.0", "nailgun_sha": "720e83bca37561fbc0452ad4e99f1f8cfe8e40cf", "production": "docker", "fuelmain_sha": "d899675a5a393625f8166b29099d26f45d527035", "astute_sha": "b622d9b36dbdd1e03b282b9ee5b7435ba649e711", "feature_groups": ["experimental"], "release": "5.1", "release_versions": {"2014.1.1-5.1": {"VERSION": {"build_id": "2014-09-11_01-04-40", "ostf_sha": "1de6ed1c0b72f6687ffb4bebc2c939b135a88e34", "build_number": "3", "api": "1.0", "nailgun_sha": "720e83bca37561fbc0452ad4e99f1f8cfe8e40cf", "production": "docker", "fuelmain_sha": "d899675a5a393625f8166b29099d26f45d527035", "astute_sha": "b622d9b36dbdd1e03b282b9ee5b7435ba649e711", "feature_groups": ["experimental"], "release": "5.1", "fuellib_sha": "6fc7ac9041894aa76b2e18d385149166e34f7b23"}}}, "fuellib_sha": "6fc7ac9041894aa76b2e18d385149166e34f7b23"

Test case was the same.
Test "Sahara tests to create, list, start, checks and delete cluster" failed without any messages

[Yaroslav Lobankov (ylobankov)]

This bug occurs when we run Heat and Sahara Platform tests together. If we run the Sahara test only, everything will be OK. I have investigated this issue and figured out the problem is in wrong inheritance for class HeatBaseTest in heatmanager.py. The fix will be soon.

[Dennis Dmitriev (ddmitriev)]

Sahara test failed on another cluster configuration:

- Ubuntu/simple
- Nova/Flat without tagging
- 1 Controller
- 1 Compute

AssertionError:
===================================================
(nose_storage_plugin) <nose.suite.ContextSuite context=PlatformSaharaTests>:setup
Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/nose/suite.py", line 208, in run
    self.setUp()
  File "/usr/lib/python2.6/site-packages/nose/suite.py", line 291, in setUp
    self.setupContext(ancestor)
  File "/usr/lib/python2.6/site-packages/nose/suite.py", line 314, in setupContext
    try_run(context, names)
  File "/usr/lib/python2.6/site-packages/nose/util.py", line 469, in try_run
    return func()
  File "/usr/lib/python2.6/site-packages/fuel_health/sahara.py", line 36, in setUpClass
    super(SaharaTest, cls).setUpClass()
  File "/usr/lib/python2.6/site-packages/fuel_health/nmanager.py", line 392, in setUpClass
    super(NovaNetworkScenarioTest, cls).setUpClass()
  File "/usr/lib/python2.6/site-packages/fuel_health/test.py", line 87, in setUpClass
    assert not hasattr(cls, attr_name)
===========================================

{"build_id": "2014-09-11_01-04-40", "ostf_sha": "1de6ed1c0b72f6687ffb4bebc2c939b135a88e34", "build_number": "3", "auth_required": true, "api": "1.0", "nailgun_sha": "720e83bca37561fbc0452ad4e99f1f8cfe8e40cf", "production": "docker", "fuelmain_sha": "d899675a5a393625f8166b29099d26f45d527035", "astute_sha": "b622d9b36dbdd1e03b282b9ee5b7435ba649e711", "feature_groups": ["experimental"], "release": "5.1", "release_versions": {"2014.1.1-5.1": {"VERSION": {"build_id": "2014-09-11_01-04-40", "ostf_sha": "1de6ed1c0b72f6687ffb4bebc2c939b135a88e34", "build_number": "3", "api": "1.0", "nailgun_sha": "720e83bca37561fbc0452ad4e99f1f8cfe8e40cf", "production": "docker", "fuelmain_sha": "d899675a5a393625f8166b29099d26f45d527035", "astute_sha": "b622d9b36dbdd1e03b282b9ee5b7435ba649e711", "feature_groups": ["experimental"], "release": "5.1", "fuellib_sha": "6fc7ac9041894aa76b2e18d385149166e34f7b23"}}}, "fuellib_sha": "6fc7ac9041894aa76b2e18d385149166e34f7b23"}

[Dennis Dmitriev (ddmitriev)]

Upd: sahara-icehouse-vanilla-1.2.1-ubuntu-13.10.qcow2 was uploaded before the test; security group 'default' was configured to allow all incoming icmp/udp/tcp traffic.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/121781

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/121781
Committed: https://git.openstack.org/cgit/stackforge/fuel-ostf/commit/?id=27b9a71385934a81bfd30d3556e61bdab3f93933
Submitter: Jenkins
Branch: master

commit 27b9a71385934a81bfd30d3556e61bdab3f93933
Author: Yaroslav Lobankov <email address hidden>
Date: Tue Sep 16 12:50:20 2014 +0400

    Fix wrong inheritance for class HeatBaseTest

    Sometimes the Sahara Platform test fails without any messages.
    This bug occurs when we run Heat and Sahara Platform tests together.
    If we run the Sahara test only, everything will be OK. The problem is
    in wrong inheritance for class HeatBaseTest in heatmanager.py.

    Change-Id: I88c4100d3603cffc4f353386490802fc6f6953b7
    Closes-Bug: #1367743

[Anastasia Palkina (apalkina)]

Verified on ISO #527

"build_id": "2014-09-25_00-01-46", "ostf_sha": "32cf2541ab8c8aa82f1e7b1d83a74e570ca2b7c9", "build_number": "527", "auth_required": true, "api": "1.0", "nailgun_sha": "47275134ee3a97442937c4862037dfba04b8cc69", "production": "docker", "fuelmain_sha": "df29118860ab7c2d8f0f5f7ca805032c87716645", "astute_sha": "a3e5da62af91b99f958ab958161d3dcec09c657b", "feature_groups": ["mirantis"], "release": "6.0", "release_versions": {"2014.1.1-5.1": {"VERSION": {"build_id": "2014-09-25_00-01-46", "ostf_sha": "32cf2541ab8c8aa82f1e7b1d83a74e570ca2b7c9", "build_number": "527", "api": "1.0", "nailgun_sha": "47275134ee3a97442937c4862037dfba04b8cc69", "production": "docker", "fuelmain_sha": "df29118860ab7c2d8f0f5f7ca805032c87716645", "astute_sha": "a3e5da62af91b99f958ab958161d3dcec09c657b", "feature_groups": ["mirantis"], "release": "6.0", "fuellib_sha": "ae297a55b7ee2958fa2cd5bab3ce0175f0818ea6"}}}, "fuellib_sha": "ae297a55b7ee2958fa2cd5bab3ce0175f0818ea6"