tempest plugin runs tests for new API endpoints against stable releases

Bug #1655888 reported by Pavlo Shchelokovskyy
10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
Ironic
Fix Released
High
Unassigned

Bug Description

Due to branch-less nature of tempest, it always installs its plugins from master branch - example [0]

Because of that recently merged API tests for new vif attach/detach endpoints are being run on stable branches as well, and naturally fail - example from the same job [1].

We need a proper way for our tempest plugin tests to discover the current ironic API microversion, compare it with version required by the test and skip the test if the required microiversion is not supported with proper message.

[0] http://logs.openstack.org/41/400941/5/check/gate-tempest-dsvm-ironic-ipa-wholedisk-agent_ipmitool-tinyipa-ubuntu-xenial/9b98543/logs/devstacklog.txt.gz#_2017-01-12_08_08_53_927
[1] http://logs.openstack.org/41/400941/5/check/gate-tempest-dsvm-ironic-ipa-wholedisk-agent_ipmitool-tinyipa-ubuntu-xenial/9b98543/console.html#_2017-01-12_08_15_22_314529

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to ironic (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/419428

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to ironic (stable/newton)

Related fix proposed to branch: stable/newton
Review: https://review.openstack.org/419430

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to ironic (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/419510

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to ironic (stable/mitaka)

Related fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/419516

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to ironic (master)

Reviewed: https://review.openstack.org/419428
Committed: https://git.openstack.org/cgit/openstack/ironic/commit/?id=6d489ef03d2838e9d1ec4fa1fac35565762328d0
Submitter: Jenkins
Branch: master

commit 6d489ef03d2838e9d1ec4fa1fac35565762328d0
Author: Vasyl Saienko <email address hidden>
Date: Thu Jan 12 13:37:23 2017 +0200

    Skip VIF api tests for old api versions

    This patch ensures that VIF api tests are not launched on installations
    with unsupported Ironic API version < 1.28.

    Change-Id: I6f562aed6307915fb5ff158b91bdb595d62f1f6f
    Related-Bug: #1655888

Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Reviewed: https://review.openstack.org/419510
Committed: https://git.openstack.org/cgit/openstack/ironic/commit/?id=76b91709ae24490721f0d60f19eea5ea5ec71434
Submitter: Jenkins
Branch: master

commit 76b91709ae24490721f0d60f19eea5ea5ec71434
Author: Vasyl Saienko <email address hidden>
Date: Thu Jan 12 13:40:52 2017 +0200

    Allow to set min,max API microversion in tempest

    This patch introduce new devstack variables to set min and max Ironic
    API version to allow skip tempest tests.

     TEMPEST_BAREMETAL_MIN_MICROVERSION
     TEMPEST_BAREMETAL_MAX_MICROVERSION

    Update release documentation.

    Related-Bug: #1655888
    Change-Id: Id6d36280f622549a2877aab99c11e4008af67fe7

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to ironic (stable/newton)

Reviewed: https://review.openstack.org/419430
Committed: https://git.openstack.org/cgit/openstack/ironic/commit/?id=cc03e0262aeb92308b4f264b69db8c01d5296b20
Submitter: Jenkins
Branch: stable/newton

commit cc03e0262aeb92308b4f264b69db8c01d5296b20
Author: Vasyl Saienko <email address hidden>
Date: Thu Jan 12 13:40:52 2017 +0200

    Allow to set min,max API microversion in tempest

    This patch introduce new devstack variables to set min and max Ironic
    API version to allow skip tempest tests.

     TEMPEST_BAREMETAL_MIN_MICROVERSION
     TEMPEST_BAREMETAL_MAX_MICROVERSION

    Set TEMPEST_BAREMETAL_MAX_MICROVERSION to 1.22 as it is latest API version for
    newton release.

    Conflicts:
          doc/source/dev/releasing.rst

    Related-Bug: #1655888
    Change-Id: Id6d36280f622549a2877aab99c11e4008af67fe7
    (cherry picked from commit 76b91709ae24490721f0d60f19eea5ea5ec71434)

tags: added: in-stable-newton
tags: added: in-stable-mitaka
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to ironic (stable/mitaka)

Reviewed: https://review.openstack.org/419516
Committed: https://git.openstack.org/cgit/openstack/ironic/commit/?id=7d2e71c0e40a85f32da8a8d0b66cb449c80a8955
Submitter: Jenkins
Branch: stable/mitaka

commit 7d2e71c0e40a85f32da8a8d0b66cb449c80a8955
Author: Vasyl Saienko <email address hidden>
Date: Thu Jan 12 13:40:52 2017 +0200

    Allow to set min,max API microversion in tempest

    This patch introduce new devstack variables to set min and max Ironic
    API version to allow skip tempest tests.

     TEMPEST_BAREMETAL_MIN_MICROVERSION
     TEMPEST_BAREMETAL_MAX_MICROVERSION

    Set TEMPEST_BAREMETAL_MAX_MICROVERSION to 1.16 as it is latest API
    version for mitaka release.

    Conflicts:
          devstack/lib/ironic
          doc/source/dev/releasing.rst

    Related-Bug: #1655888
    Change-Id: Id6d36280f622549a2877aab99c11e4008af67fe7
    (cherry picked from commit 76b91709ae24490721f0d60f19eea5ea5ec71434)

Dmitry Tantsur (divius)
Changed in ironic:
importance: Undecided → High
status: New → In Progress
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to ironic-tempest-plugin (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/427429

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on ironic-tempest-plugin (master)

Change abandoned by John L. Villalovos (<email address hidden>) on branch: master
Review: https://review.openstack.org/427429
Reason: Restarting the process

Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Change abandoned by John L. Villalovos (<email address hidden>) on branch: master
Review: https://review.openstack.org/427429
Reason: Will work with infra to do a batch upload.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.