[FUll Tempest job][master][periodic]3 Tempest tests related to DNS failing

Bug #1832166 reported by yatin on 2019-06-10
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Critical
Ronelle Landy

Bug Description

Below 3 Tempest tests related to DNS are failing in Full tempest jobs[2] since dns-integration extension is enabled in OVN in [1], before OVN patch these tests used to be skip(check SUCCESS jobs in [2]):-

- neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_dns_domain_bumps_revision
Fails with:- AssertionError: 1 not greater than 1 while matching revision_number

- neutron_tempest_plugin.scenario.test_internal_dns.InternalDNSTest.test_dns_domain_and_name
Fails with:- testtools.matchers._impl.MismatchError: 'starwars' not in u'nameserver 1.1.1.1\nnameserver 1.0.0.1\nnameserver 38.145.33.91\n'

- neutron_tempest_plugin.scenario.test_dns_integration.DNSIntegrationTests (this running only in fs020 master job as desinate-tempest-plugin is installed in standalone full tempest this is skipped as designate-tempest-plugin is not installed)
Fails with:- Details: No matching service found in the catalog.

Example logs:-
- https://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020-master/dd92512/logs/tempest.html.gz
- https://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-standalone-full-tempest-master/d71a1ea/logs/stestr_results.html

neutron_tempest_plugin.scenario.test_dns_integration.DNSIntegrationTests is skipped in OVN gate [1] as well with below comment so makes sense to skip in Tripleo tempest tests as well:-
# TODO(mjozefcz): Remove this blacklist when OVS 2.12 will be released and
# https://patchwork.ozlabs.org/patch/1102717/ merged.

For other two tests and the above one can someone from ovn check and confirm the issue and plan for these tests as this is currently blocking master promotion.

[1] https://review.opendev.org/#/c/562527
[2] https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-standalone-full-tempest-master&job_name=periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020-master

yatin (yatinkarel) on 2019-06-10
Changed in tripleo:
milestone: none → train-2
importance: Undecided → Critical
status: New → Triaged
tags: added: alert ci promotion-blocker
Kamil Sambor (ksambor) on 2019-06-10
Changed in tripleo:
assignee: nobody → Kamil Sambor (ksambor)

Fix proposed to branch: master
Review: https://review.opendev.org/664233

Changed in tripleo:
status: Triaged → In Progress
tags: added: tempest
Changed in tripleo:
assignee: Kamil Sambor (ksambor) → yatin (yatinkarel)
Changed in tripleo:
assignee: yatin (yatinkarel) → Kamil Sambor (ksambor)
wes hayutin (weshayutin) on 2019-06-11
tags: removed: alert
Changed in tripleo:
assignee: Kamil Sambor (ksambor) → Ronelle Landy (rlandy)

Reviewed: https://review.opendev.org/664233
Committed: https://git.openstack.org/cgit/openstack/tripleo-quickstart-extras/commit/?id=26f3127b2e6c710750a70048074126cfaca7ddd1
Submitter: Zuul
Branch: master

commit 26f3127b2e6c710750a70048074126cfaca7ddd1
Author: Kamil Sambor <email address hidden>
Date: Mon Jun 10 11:24:31 2019 +0200

    Skip dns related tests

    In ovn recently dns dependent tests were enabled.
    For some of them we need to add additional configuration
    and for another one we are waiting for OVS 2.12 to be
    released.

    Change-Id: I8c5a316145dda6497971be46f75370511a8f2103
    Partial-Bug: #1832166

Kamil Sambor (ksambor) wrote :

We can close this bug, because all mentioned tests are skipped in ovn too

Changed in tripleo:
status: In Progress → Fix Committed
wes hayutin (weshayutin) wrote :

/me notes that the skip does not fix the problem.. leave the bug open even if the skip is merged please

Changed in tripleo:
status: Fix Committed → Triaged
Changed in tripleo:
milestone: train-2 → train-3
Changed in tripleo:
milestone: train-3 → train-rc1
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers