ISO 6.1 staging jobs failure due to ostf problem

[Vasyl Saienko]

http://jenkins-product.srt.mirantis.net:8080/view/All/job/6.1.test_staging_mirror/158/
http://jenkins-product.srt.mirantis.net:8080/job/6.1.staging.ubuntu.bvt_2/141/

015-03-19 18:19:41,888 - INFO decorators.py:152 -- <<<<<****************************************************************************************************>>>>>
FAIL

======================================================================
FAIL: Deploy ceph HA with RadosGW for objects
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
    compatability.capture_type_error(s_func)
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
    func()
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
    func(test_case.state.get_state())
  File "/home/jenkins/workspace/6.1.staging.ubuntu.bvt_2/fuelweb_test/helpers/decorators.py", line 66, in wrapper
    return func(*args, **kwargs)
  File "/home/jenkins/workspace/6.1.staging.ubuntu.bvt_2/fuelweb_test/tests/test_ceph.py", line 291, in ceph_rados_gw
    self.fuel_web.run_ostf(cluster_id=cluster_id)
  File "/home/jenkins/workspace/6.1.staging.ubuntu.bvt_2/fuelweb_test/__init__.py", line 48, in wrapped
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/6.1.staging.ubuntu.bvt_2/fuelweb_test/models/fuel_web_client.py", line 592, in run_ostf
    failed_test_name=failed_test_name)
  File "/home/jenkins/workspace/6.1.staging.ubuntu.bvt_2/fuelweb_test/__init__.py", line 48, in wrapped
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/6.1.staging.ubuntu.bvt_2/fuelweb_test/models/fuel_web_client.py", line 198, in assert_ostf_run
    failed_tests_res))
AssertionError: Failed tests, fails: 1 should fail: 0 failed tests name: [{u'Create volume and boot instance from it (failure)': u'Failed to get to expected status. In error state. Please refer to OpenStack logs for more details.'}]

----------------------------------------------------------------------
Ran 3 tests in 4358.574s

[Stanislav Makar (smakar)]

We got such error
OSTF log:
2015-03-19 18:13:16 DEBUG (connectionpool) "GET http://10.109.33.2:8776/v1/28e2206b79204d989c6bb5c5aba16ab7/volumes/38f7d4b1-f941-406a-af86-31b
819a7f7e1 HTTP/1.1" 200 656
2015-03-19 18:13:16 DEBUG (test_mixins) Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/fuel_health/common/test_mixins.py", line 179, in verify

Ceph became ready to use :
Ceph log:
2015-03-19T18:12:36.732854+00:00 emerg: 2015-03-19 18:12:36.740839 7f790728b700 0 log [INF] : pgmap v44: 4288 pgs: 817 creating, 84 peering,
3387 active+clean; 5504 kB data, 12571 MB used, 283 GB / 296 GB avail; 32077 B/s rd, 838 kB/s wr, 55 op/s
...
2015-03-19T18:12:54.729970+00:00 emerg: 2015-03-19 18:12:54.737884 7f790728b700 0 log [INF] : pgmap v46: 4288 pgs: 4288 active+clean; 13696 k
B data, 12584 MB used, 283 GB / 296 GB avail; 5547 B/s rd, 452 kB/s wr, 9 op/s

This means that ceph was not ready to use during testing.
We have merged the patch(https://review.openstack.org/#/c/153338/) which fixes such problems.

[Stanislav Makar (smakar)]

related to https://bugs.launchpad.net/fuel/+bug/1415954