[OSTF]Ceilometer test to check alarm state and get Nova metrics with Time Limit

Bug #1520664 reported by Artem Hrechanychenko
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Released
High
Vitaly Gusev
8.0.x
Fix Released
High
Vitaly Gusev
Mitaka
Fix Released
High
Vitaly Gusev

Bug Description

Reproduced on CI and 212 ISO

Traceback (most recent call last):
  File "/usr/lib/python2.7/unittest/case.py", line 331, in run
    testMethod()
  File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
    self._testFunc()
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
    compatability.capture_type_error(s_func)
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
    func()
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
    func(test_case.state.get_state())
  File "/home/jenkins/workspace/8.0.system_test.ubuntu.huge_ha_neutron/fuelweb_test/helpers/decorators.py", line 80, in wrapper
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/8.0.system_test.ubuntu.huge_ha_neutron/fuelweb_test/tests/tests_strength/test_huge_environments.py", line 326, in huge_ha_neutron_vlan_ceph_ceilometer_rados
    test_name=test_name, timeout=60 * 20)
  File "/home/jenkins/workspace/8.0.system_test.ubuntu.huge_ha_neutron/fuelweb_test/__init__.py", line 57, in wrapped
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/8.0.system_test.ubuntu.huge_ha_neutron/fuelweb_test/models/fuel_web_client.py", line 1038, in run_single_ostf_test
    timeout=timeout)
  File "/home/jenkins/workspace/8.0.system_test.ubuntu.huge_ha_neutron/fuelweb_test/__init__.py", line 57, in wrapped
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/8.0.system_test.ubuntu.huge_ha_neutron/fuelweb_test/models/fuel_web_client.py", line 210, in assert_ostf_run_certain
    indent=1)))
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/asserts.py", line 163, in assert_true
    raise ASSERTION_ERROR(message)
AssertionError: The following tests have not succeeded, while they must have passed:
  - Ceilometer test to check alarm state and get Nova metrics (fuel_health.tests.tests_platform.test_ceilometer.CeilometerApiPlatformTests.test_check_alarm_state). Test status: failure, message: Time limit exceeded while waiting for getting instance pollsters to finish. Please refer to OpenStack logs for more details.

Scenario:
1. Create cluster
2. Add 3 nodes with controller and ceph role
3. Add 3 nodes with compute and ceph roles
4. Add 3 nodes with mongo roles
5. Deploy the cluster
6. Verify smiles count
7. Run OSTF

Actual result:

OSTF "Ceilometer test to check alarm state and get Nova metrics" test failed with next error:

fuel_health.common.test_mixins: INFO: Timeout 600s exceeded for getting instance pollsters fuel_health.common.test_mixins: DEBUG: Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/fuel_health/common/test_mixins.py", line 177, in verify result = func(*args, **kwargs) File "/usr/lib/python2.6/site-packages/fuel_health/common/test_mixins.py", line 223, in __exit__ raise AssertionError(msg) AssertionError: Time limit exceeded while waiting for getting instance pollsters to finish.

Revision history for this message
Artem Hrechanychenko (agrechanichenko) wrote :
Dmitry Klenov (dklenov)
Changed in fuel:
assignee: nobody → MOS Ceilometer (mos-ceilometer)
Changed in fuel:
status: New → Confirmed
Dmitry Pyzhov (dpyzhov)
tags: added: area-mos
tags: added: swarm-blocker
Revision history for this message
Vitaly Gusev (vgusev) wrote :
tags: added: blocker-for-qa
Changed in fuel:
assignee: MOS Ceilometer (mos-ceilometer) → Vitaly Gusev (vgusev)
status: Confirmed → In Progress
tags: added: swarm-fail-driver
removed: swarm-blocker
tags: removed: swarm-fail-driver
Revision history for this message
Tatyanka (tatyana-leontovich) wrote :

set priority to high according to it fails in several tests

Changed in fuel:
importance: Medium → High
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-ostf (master)

Reviewed: https://review.openstack.org/243554
Committed: https://git.openstack.org/cgit/openstack/fuel-ostf/commit/?id=e10d968cae4e74984bfc312e076065c331cd8e8e
Submitter: Jenkins
Branch: master

commit e10d968cae4e74984bfc312e076065c331cd8e8e
Author: vgusev <email address hidden>
Date: Tue Nov 10 14:55:55 2015 +0300

    [Ceilometer] Fixes for Ceilometer tests

    - Lists of pollsters and notifications were actualized
    according to pipeline changes
    - Polling interval in MOS 8.0 was increased to 10 minutes,
    so steps with nova pollsters were removed
    - A lot of Glance notifications were deprecated in MOS 8.0,
    so method was rewrited using Glance events
    - In MOS 8.0 feature with mandatory limits was added,
    so method for samples was rewrited using statistic requests
    - Statistics requests only for the last hour were added
    in all OSTF where these queries used

    Closes-Bug: #1515172
    Closes-Bug: #1520664

    Change-Id: I66254f362b0daa44b9e03dc57c6ec6c1af46750e

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-ostf (stable/8.0)

Fix proposed to branch: stable/8.0
Review: https://review.openstack.org/268977

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-ostf (stable/8.0)

Reviewed: https://review.openstack.org/268977
Committed: https://git.openstack.org/cgit/openstack/fuel-ostf/commit/?id=6b54c459aa852fdd8480b24b8a0ac2b5db74de3b
Submitter: Jenkins
Branch: stable/8.0

commit 6b54c459aa852fdd8480b24b8a0ac2b5db74de3b
Author: vgusev <email address hidden>
Date: Tue Nov 10 14:55:55 2015 +0300

    [Ceilometer] Fixes for Ceilometer tests

    - Lists of pollsters and notifications were actualized
    according to pipeline changes
    - Polling interval in MOS 8.0 was increased to 10 minutes,
    so steps with nova pollsters were removed
    - A lot of Glance notifications were deprecated in MOS 8.0,
    so method was rewrited using Glance events
    - In MOS 8.0 feature with mandatory limits was added,
    so method for samples was rewrited using statistic requests
    - Statistics requests only for the last hour were added
    in all OSTF where these queries used

    Closes-Bug: #1515172
    Closes-Bug: #1520664

    Change-Id: I66254f362b0daa44b9e03dc57c6ec6c1af46750e
    (cherry picked from commit e10d968cae4e74984bfc312e076065c331cd8e8e)

Revision history for this message
Roman Podoliaka (rpodolyaka) wrote :

^ for some reason the bot didn't close the bug upon merging this

Revision history for this message
Tatyanka (tatyana-leontovich) wrote :

verified on 8.0-446 iso for 8.0 - so move to fix released

tags: added: area-ostf
removed: ostf
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.