OSTF cannot pass when the environment has been tested with Rally

Bug #1573717 reported by Andrey Grebennikov on 2016-04-22
This bug affects 2 people
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Artem Minasyan
Artem Minasyan
Artem Minasyan
Artem Minasyan

Bug Description

MOS8, Ceilometer included.

The environment has been created and Rally tests were executed (Ceilometer has lots of data stored in the backend).
OSTF has been started and "Ceilometer test to check events and traits" fails.

fuel_health.common.test_mixins: INFO: STEP:8, verify action: 'getting list of all traits for "compute.instance.update" event type and "instance_id" trait name'
fuel_health.common.test_mixins: INFO: Timeout 60s exceeded for getting list of all traits for "compute.instance.update" event type and "instance_id" trait name

The reason is - OSTF tries to execute the command "ceilometer trait-list -e compute.instance.update -t instance_id", which is supposed to return thousands of traits. Ceilometer API cannot work out that huge amount of data and times out.
Consequently in order to pass the test there is only one way - destroy all the data in Mongo.

I'd suggest to remove this test from the test plan or replace it with some other test including the filtering.

Hi Artem, we need to review the OSTF test and fix the way how we check it, because it looks like our method doesn't work for a cluster with the real workload or cluster after performance testing.

tags: added: area-ceilometer

Fix proposed to branch: master
Review: https://review.openstack.org/309978

Changed in fuel:
status: Confirmed → In Progress

Reviewed: https://review.openstack.org/309978
Committed: https://git.openstack.org/cgit/openstack/fuel-ostf/commit/?id=7cec6fbf6ad648cee32b25785e0c864f12552a23
Submitter: Jenkins
Branch: master

commit 7cec6fbf6ad648cee32b25785e0c864f12552a23
Author: Artem <email address hidden>
Date: Mon Apr 25 16:21:21 2016 +0300

    Remove 'trait list' from the method of 'test_check_events_and_traits'

    Option 'ceilometer trait-list' hasn't query and list. When we create
    a lot of VM we get a huge data and trait list cannot retrieve data from MongoDB.

    Change-Id: Ic29450f3875a94b91f90b5b47e6291f70e17e86d

Changed in fuel:
status: In Progress → Fix Committed
Alex Ermolov (aermolov) on 2016-05-23
tags: added: non-release
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers