Remove mistral tempest tests jenkins-periodic-master-rdo_trunk-virtbasic-1ctlr_1comp_64gb

Bug #1736252 reported by Matt Young on 2017-12-04
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Critical
Matthew Young

Bug Description

tempest failures observed on current master hash:

- https://trunk.rdoproject.org/centos7/ac/82/ac82ea9271a4ae3860528eaf8a813da7209e62a6_28eeb6c7

- https://thirdparty.logs.rdoproject.org/jenkins-periodic-master-rdo_trunk-virtbasic-1ctlr_1comp_64gb-56/tempest.html
- https://thirdparty.logs.rdoproject.org/jenkins-periodic-master-rdo_trunk-virtbasic-1ctlr_1comp_64gb-56/stackviz/#/stdin
- https://thirdparty.logs.rdoproject.org/jenkins-periodic-master-rdo_trunk-virtbasic-1ctlr_1comp_64gb-56/undercloud/home/stack/tempest_output.log.txt.gz

Failed Tests

```
mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions[id-2e1a578a-1c27-409a-96be-84b5c41498cd,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_equal_to_filter[id-9a53af71-8f1e-4ad5-b572-2c4c621715c0,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_greater_than_equal_to_filter[id-7f598dba-f169-47ec-a487-f0ed31484aff,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_greater_than_filter[id-20b3d527-447d-492b-8cb7-ac5e3757d7d5,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_in_list_filter[id-84823a84-5caa-427d-8a2c-622a1d1893b1,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_less_than_equal_to_filter[id-1fda6c31-b0c3-4b78-9f67-b920e1f6c973,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_less_than_filter[id-874fb57d-a762-4dc3-841d-396657510d23,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_multiple_filter[id-cbb716f1-7fc7-4884-8fa9-6ff2bc35ee29,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_not_equal_to_filter[id-3c3d28ce-9490-41ae-a918-c28f843841e1,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_not_in_list_filter[id-4b05dfcf-ef39-4032-9528-c8422c7329dd,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_with_pagination[id-786ee85c-c32d-4ac9-8f45-79ab6bc47ef1,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_workbooks.WorkbookTestsV2.test_get_list_workbooks[id-4d8752b9-8d69-4d81-8710-5dd8ef699b95,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_cron_triggers.CronTriggerTestsV2.test_get_list_cron_triggers[id-c53b44dd-59b3-4a4b-b22a-21abb4cecea0,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_executions.ExecutionTestsV2.test_get_list_executions[id-c0b4b658-6f01-4680-b402-2f683b3d78b6,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_executions.ExecutionTestsV2.test_get_list_executions_with_pagination[id-0bfcb4b0-b1e4-4499-b81b-0e86c8a2a841,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_tasks.TasksTestsV2.test_get_tasks_list[id-81159dce-3802-44ee-a8d4-5ddca106fd91,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_workflows.WorkflowTestsV2.test_get_list_other_project_private_workflows[id-b8dc1b02-8509-45e2-9df7-4630cdcfa1ab,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_workflows.WorkflowTestsV2.test_get_list_workflows[id-e9cd6817-e8d1-4604-ba76-b0e17219f4c5,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_workflows.WorkflowTestsV2.test_get_list_workflows_by_admin[id-be8a4a44-eeb3-48e3-b11d-b83ba14dbf2c,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_workflows.WorkflowTestsV2.test_get_list_workflows_with_fields[id-2063143b-ced8-4037-9383-e2504be581e6,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_workflows.WorkflowTestsV2.test_get_list_workflows_with_pagination[id-81f28735-e74e-4dc1-8b94-b548f8a80556,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_workflows.WorkflowTestsV2.test_get_list_workflows_with_project_by_admin[id-c9e2ebbc-02aa-4c33-b244-e471c8266aa7,smoke] (subunit.RemotedTestCase)
```

Matt Young (halcyondude) on 2017-12-04
Changed in tripleo:
importance: Undecided → Critical
status: New → Triaged
tags: added: quickstart
tags: added: promotion-blocker
Changed in tripleo:
milestone: none → queens-3
Emilien Macchi (emilienm) wrote :

This bug is invalid, jenkins-periodic-master-rdo_trunk-virtbasic-1ctlr_1comp_64gb-56 doesn't run Mistral. https://thirdparty.logs.rdoproject.org/jenkins-periodic-master-rdo_trunk-virtbasic-1ctlr_1comp_64gb-56/overcloud-controller-0/var/log/

Changed in tripleo:
status: Triaged → Invalid
wes hayutin (weshayutin) wrote :

Matt, please update the tempest configuration to exclude mistral

Changed in tripleo:
status: Invalid → Triaged
assignee: nobody → Matthew Young (myoung)
summary: - tempest failures: mistral
+ Remove mistral tempest tests jenkins-periodic-master-rdo_trunk-
+ virtbasic-1ctlr_1comp_64gb
Matt Young (halcyondude) wrote :

The current configuration in TQE is:

A prior change / issue happened back in August where we set what is running in RDO phase 2.

- https://trello.com/c/WS7Ef3S1/580-update-tempest-to-match-what-qe-is-expecting
- https://review.openstack.org/#/c/491794

The linked review was an attempt to put upstream what we need for OSP, which was the import criteria for OSP. We did this so when rdophase2 promotes, we are sure that osp phase 1 criteria for tempest tests is met. That regex/criteria is:

test_regex: smoke|test_minimum_basic|test_network_basic_ops|test_snapshot_pattern|test_volume_boot_pattern

vs the upstream TQE role default:

test_regex: smoke

-

What's the "source of truth" here for what this regex should be for rdophase2?

Matt Young (halcyondude) wrote :

The fix here isn't to disable (explicitly) mistral tests from the job definition, but to stop installing tempest test plugins (like https://github.com/openstack/mistral/tree/master/mistral_tempest_tests)

add nova and neutron tempest plugins to default config
https://review.openstack.org/#/c/525657

stop installing plugins in convert image
https://review.openstack.org/#/c/525659/

Matt Young (halcyondude) wrote :

https://review.openstack.org/#/c/525659 is still in the gates. blacklisting mistral for these tests in the meantime.

Matt Young (halcyondude) wrote :

These patches have landed, afaik this bug is resolved...

Changed in tripleo:
status: Triaged → Fix Released
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers