20 failed Tempest tests on the Scale lab

Bug #1391204 reported by Yaroslav Lobankov
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Mirantis OpenStack
Invalid
Medium
Yaroslav Lobankov
6.0.x
Won't Fix
Medium
Yaroslav Lobankov
6.1.x
Invalid
Medium
Yaroslav Lobankov

Bug Description

For now there is about 20 Tempest tests that fail on the Scale lab:

1. setUpClass (tempest.api.network.test_metering_extensions.MeteringXML)
2. setUpClass (tempest.api.network.test_metering_extensions.MeteringJSON)
3. setUpClass (tempest.api.orchestration.stacks.test_templates.TemplateAWSTestJSON)
4. setUpClass (tempest.api.orchestration.stacks.test_templates.TemplateYAMLTestJSON)
5. tempest.api.compute.servers.test_create_server.ServersTestJSON.test_create_server_with_scheduler_hint_group[gate]
6. tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_create_server_with_scheduler_hint_group[gate]
7. tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service[gate,smoke]
8. tempest.api.identity.admin.v3.test_services.ServicesTestXML.test_create_update_get_service[gate,smoke]
9. tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_trust_expire[gate,smoke]
10. tempest.api.network.admin.test_l3_agent_scheduler.L3AgentSchedulerTestJSON.test_add_list_remove_router_on_l3_agent[gate,smoke]
11. tempest.api.object_storage.test_account_bulk.BulkTest.test_bulk_delete_by_POST[gate]
12. tempest.api.object_storage.test_object_services.ObjectTest.test_object_upload_in_segments[gate]
13. tempest.api.object_storage.test_object_services.ObjectTest.test_update_object_metadata_with_create_and_remove_metadata[gate,smoke]
14. tempest.cli.simple_read_only.network.test_neutron.SimpleReadOnlyNeutronClientTest.test_neutron_meter_label_list[gate,smoke]
15. tempest.cli.simple_read_only.network.test_neutron.SimpleReadOnlyNeutronClientTest.test_neutron_meter_label_rule_list[gate,smoke]
16. tempest.scenario.test_swift_basic_ops.TestSwiftBasicOps.test_swift_acl_anonymous_download[object_storage]
17. tempest.thirdparty.boto.test_ec2_network.EC2NetworkTest.test_disassociate_not_associated_floating_ip

Some of these tests will pass if corresponding bugs are fixed and corresponding patches are merged.
1-2, 14-15 will pass if https://review.openstack.org/#/c/133024/ is merged.
5-6 will pass if https://review.openstack.org/#/c/133428/ is merged.
9 has unexpected success. So this test need to be removed from shouldfail.yaml.
10 has unexpected success. So this test need to be removed from shouldfail.yaml.

So all these failures (except 9-10) need to be added to shouldfail.yaml until we figure out reasons of these failures.

Tags: tempest scale
Sergey Galkin (sgalkin)
tags: added: scale
Changed in mos:
milestone: 6.0 → 6.0.1
Changed in mos:
status: Confirmed → Won't Fix
Revision history for this message
Yaroslav Lobankov (ylobankov) wrote :

For now, all of these tests were fixed and they have success.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.