Aligning tempest config with defcore

[Justin Shepherd]

The current tempest config does not fully align with defcore (https://github.com/stackforge/refstack/blob/master/defcore/icehousecore.json). There are about 15 tests currently skipped, that are considered "core" functionality.

[Justin Shepherd (jshepher)]

Looks like enabling the following features in [compute-feature-enabled] would fix those sections:

change_password = true
console_output = true
resize = true
snapshot = true

[Justin Shepherd (jshepher)]

Enabling the following features in [image-feature-enabled] would fix glance sections:

api_v2 = true

[Justin Shepherd (jshepher)]

Enabling the following features in [object-storage-feature-enabled] would fix swift sections:

object_versioning = true

[Justin Shepherd (jshepher)]

The last set of tests that need to run, will need to set tempest_compute_run_ssh to true.

https://github.com/stackforge/os-ansible-deployment/blob/master/playbooks/roles/os_tempest/defaults/main.yml#L30

[Justin Shepherd (jshepher)]

last outstanding test.. not sure how to enable it:

https://github.com/openstack/tempest/blob/master/tempest/api/compute/servers/test_server_actions.py#L104-L109

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/159906
Committed: https://git.openstack.org/cgit/stackforge/os-ansible-deployment/commit/?id=2d097cb05fa20c746ee6c49aa47c6fd842f2a424
Submitter: Jenkins
Branch: master

commit 2d097cb05fa20c746ee6c49aa47c6fd842f2a424
Author: Justin Shepherd <email address hidden>
Date: Fri Feb 27 09:58:43 2015 -0600

    Modifying the default tempest config

    * Adding snapshot to [compute-feature-enabled]
      * enables: test_list_images_filter_by_server_id
      * enables: test_list_images_filter_by_type
      * enables: test_list_images_filter_by_server_ref
      * enables: test_list_images_with_detail_filter_by_type
      * enables: test_list_images_with_detail_filter_by_server_ref
      * enables: class(ImagesTestJSON)
      * enables: tempest.api.compute.images.test_images_oneserver
    * Adding resize to [compute-feature-enabled]
      * enables: test_resize_server_with_null_flavor
      * enables: test_resize_server_with_non_existent_flavor
      * enables: test_resize_server_confirm
      * enables: test_resize_server_revert
    * Adding console_output to [compute-feature-enabled]
      * enables: test_get_console_output
    * Adding api_v2 to [image-feature-enabled]
      * enables: tempest.api.image.v2.test_images
    * Adding object_versioning to [object-storage-feature-enabled]
      * enables: tempest.api.object_storage.test_object_version

    Closes-Bug: 1426442

    Change-Id: I2a3c549a7c861d80c00e3779f6a585527e7a9fbd

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/161680
Committed: https://git.openstack.org/cgit/stackforge/os-ansible-deployment/commit/?id=e2d6ee0780e19660d759d609f0346ccc456bfd23
Submitter: Jenkins
Branch: master

commit e2d6ee0780e19660d759d609f0346ccc456bfd23
Author: Hugh Saunders <email address hidden>
Date: Thu Mar 5 11:23:44 2015 +0000

    Add test lists for defcore

    Parse defcore/refstack specs to extract the test lists.

    Change-Id: Ib82807b0182938c6f61156e6afd530b1f4c45ec6
    partial-bug: #1426442

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/165516

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/165516
Committed: https://git.openstack.org/cgit/stackforge/os-ansible-deployment/commit/?id=4ff31114e5175bfb331acab8cc4d82977045b585
Submitter: Jenkins
Branch: master

commit 4ff31114e5175bfb331acab8cc4d82977045b585
Author: Justin Shepherd <email address hidden>
Date: Wed Mar 18 12:10:16 2015 -0500

    Updating defcore test definitions

    Defcore now has its own repository, at
    https://github.com/openstack/defcore. Updating the tempest gate script
    to pull the json files from there. Also defcore is moving to a release
    that does not match the branch names, so there is now a version map.

    Change-Id: I7b70a8a9f036bb218e1d4d005998af8257835dcb
    Closes-Bug: #1426442

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/167329

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/167329
Committed: https://git.openstack.org/cgit/stackforge/os-ansible-deployment/commit/?id=c974780bdd9a63f80afd1c3713280b7630521040
Submitter: Jenkins
Branch: master

commit c974780bdd9a63f80afd1c3713280b7630521040
Author: Justin Shepherd <email address hidden>
Date: Tue Mar 24 12:15:36 2015 -0500

    Fixing defcore test list generation

    Currently a test list must include the test tags as part of the test
    name. This patch will filter the list of discovered tests against the
    defcore list, to produce a test list with the proper test names
    (including tags).

    Change-Id: Ifdbd6ff9140f8fd7da332dde33de507d86e2015d
    Closes-Bug: #1426442