[Tempest] [SSL] Tempest test "test_volume_list_pagination" and "test_volume_list_details_pagination" FAIL in MOS with TLS

[Oleksiy Butenko]

Tempest test "test_volume_list_pagination" and "test_volume_list_details_pagination" FAIL in MOS with TLS

Steps:
1. Deploy env with TLS (Controller - 1, Compute + Ceph - 1, Neutron with VLAN segmentation)
2. Install mos-tempest-runner on the Fuel master node (https://github.com/Mirantis/mos-tempest-runner)
3. run_tests tempest.api.volume.v2.test_volumes_list

Expected result:
All tests passed.

Actual result:
tempest.api.volume.v2.test_volumes_list.VolumesV2ListTestJSON.test_volume_list_details_pagination[id-e9138a2c-f67b-4796-8efa-635c196d01de] - FAIL
tempest.api.volume.v2.test_volumes_list.VolumesV2ListTestJSON.test_volume_list_pagination[id-af55e775-8e4b-4feb-8719-215c43b0238c] - FAIL

Tempest traceback:
http://paste.openstack.org/show/433517/

{"build_id": "2015-08-29_21-15-00", "build_number": "253", "release_versions": {"2015.1.0-7.0": {"VERSION": {"build_id": "2015-08-29_21-15-00", "build_number": "253", "api": "1.0", "fuel-library_sha": "bc04a7092d92400c79e6ea6ede25e7b67c6a6355", "nailgun_sha": "3189ccfb8c1dac888e351f535b03bdbc9d392406", "feature_groups": ["mirantis"], "fuel-nailgun-agent_sha": "d7027952870a35db8dc52f185bb1158cdd3d1ebd", "openstack_version": "2015.1.0-7.0", "fuel-agent_sha": "1e8f38bbb864ed99aa8fe862b6367e82afec3263", "production": "docker", "python-fuelclient_sha": "9643fa07f1290071511066804f962f62fe27b512", "astute_sha": "53c86cba593ddbac776ce5a3360240274c20738c", "fuel-ostf_sha": "83048d68609854324ceeaf04242e68d658cfb55d", "release": "7.0", "fuelmain_sha": "0e54d68392b359bc122e5bbba9249c729eeaf579"}}}, "auth_required": true, "api": "1.0", "fuel-library_sha": "bc04a7092d92400c79e6ea6ede25e7b67c6a6355", "nailgun_sha": "3189ccfb8c1dac888e351f535b03bdbc9d392406", "feature_groups": ["mirantis"], "fuel-nailgun-agent_sha": "d7027952870a35db8dc52f185bb1158cdd3d1ebd", "openstack_version": "2015.1.0-7.0", "fuel-agent_sha": "1e8f38bbb864ed99aa8fe862b6367e82afec3263", "production": "docker", "python-fuelclient_sha": "9643fa07f1290071511066804f962f62fe27b512", "astute_sha": "53c86cba593ddbac776ce5a3360240274c20738c", "fuel-ostf_sha": "83048d68609854324ceeaf04242e68d658cfb55d", "release": "7.0", "fuelmain_sha": "0e54d68392b359bc122e5bbba9249c729eeaf579"}

[Timur Nurlygayanov (tnurlygayanov)]

Looks like Tempest issue, we need to check configuration and fix it on the Tempest side.

Yaroslav, could you please take a look?

[Yaroslav Lobankov (ylobankov)]

Moving to 8.0 because it's a medium issue.

[Roman Bogorodskiy (novel)]

Actually, I'm not quite sure that's a Tempest issue. If you forget about Tempest for a second a do something like:

$ cinder --debug --os-volume-api-version 2 list --limit 1

You'll see that even if it makes requests through HTTPS, all the hrefs are using HTTP. I guess it happens because the load balancer talks to the actual cinder-api instances through HTTP, not HTTPS. However, I think that this behavior is not quite correct and it should use HTTPS in hrefs, so Tempest tests are failing for reason.

However, I'm not sure if that's a bug in cinder code or configuration. Most likely it can be solved by defining 'osapi_volume_base_URL' though.

[Roman Bogorodskiy (novel)]

FYI, in my environment I reconfigured cinder to set 'osapi_volume_base_URL' in cinder.conf's DEFAULT section to match the value of the volume API endpoint. After that cinder started to return proper refs. That's probably a thing that should be configured automatically at deployment time.

[Oleksiy Butenko (obutenko)]

Roman, thank you for information!

[Timur Nurlygayanov (tnurlygayanov)]

So, we have the workaround for the issue in MOS 8.0 and we can't fix this medium issue in MOS 8.0 already but we should fix it for MOS 9.0 release.

[Fuel Devops McRobotson (fuel-devops-robot)]

Related fix proposed to branch: 9.0/mitaka
Change author: Yuriy Nesenenko <email address hidden>
Review: https://review.fuel-infra.org/19570

[Dina Belova (dbelova)]

Added move-to-10.0 tag due to the fact bug was transferred from 9.0 to 10.0

[Oleksiy Butenko (obutenko)]

remove tag move-to-10.0, tempest, non-release. It's not tempest issue. And we need fix it in 9.0 - change to High

[Fuel Devops McRobotson (fuel-devops-robot)]

Change abandoned by Yuriy Nesenenko <email address hidden> on branch: 9.0/mitaka
Review: https://review.fuel-infra.org/19570
Reason: wrong aprouch

[Fuel Devops McRobotson (fuel-devops-robot)]

Related fix proposed to branch: 9.0/mitaka
Change author: Yuriy Nesenenko <email address hidden>
Review: https://review.fuel-infra.org/20056

[Fuel Devops McRobotson (fuel-devops-robot)]

Reviewed: https://review.fuel-infra.org/20056
Submitter: Pkgs Jenkins <email address hidden>
Branch: 9.0/mitaka

Commit: 2ddf86a8fadaf359327a68d3c361db88f696b027
Author: Yuriy Nesenenko <email address hidden>
Date: Mon Apr 25 13:42:14 2016

Handle SSL termination proxies for version list

Cinder list with pagination contains wrong scheme
for 'next' link in case of SSL endpoints. This
patch fixes it and returns the correct scheme in
version URLs if service is behind an SSL termination
proxy.

Change-Id: If5aab9cc25a2e7c66a0bb13b5f7488a667b30309
Closes-Bug: #1569355
Related-Bug: #1490266