python-novaclient

os-endpoint-type not really working internalURL required 2nd region only support http access.

Bug #1517171 reported by Michael Duncan on 2015-11-17

This bug affects 1 person

Affects		Status	Importance	Assigned to	Milestone
	OpenStack Compute (nova)	Invalid	Undecided	Michael Duncan
	python-novaclient	Invalid	Undecided	Michael Duncan

Bug Description

FAILED:

[root@controller-0 ~(keystone_admin)]# nova --debug --os-endpoint-type internalURL list
DEBUG (session:195) REQ: curl -g -i -X GET http://10.30.3.103:5000/v2.0/ -H "Accept: application/json" -H "User-Agent: python-keystoneclient"
INFO (connectionpool:203) Starting new HTTP connection (1): 10.30.3.103
DEBUG (connectionpool:383) "GET /v2.0/ HTTP/1.1" 200 338
DEBUG (session:224) RESP: [200] content-length: 338 vary: X-Auth-Token connection: keep-alive date: Tue, 17 Nov 2015 18:46:50 GMT content-type: application/json x-openstack-request-id: req-9eee79c9-b916-419a-b6ff-30db684966fb
RESP BODY: {"version": {"status": "stable", "updated": "2014-04-17T00:00:00Z", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v2.0+json"}], "id": "v2.0", "links": [{"href": "https://10.30.4.100:5000/v2.0/", "rel": "self"}, {"href": "http://docs.openstack.org/", "type": "text/html", "rel": "describedby"}]}}

DEBUG (v2:76) Making authentication request to https://10.30.4.100:5000/v2.0/tokens
INFO (connectionpool:735) Starting new HTTPS connection (1): 10.30.4.100
DEBUG (shell:923) SSL exception connecting to https://10.30.4.100:5000/v2.0/tokens: [Errno bad handshake] [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')]
Traceback (most recent call last):
  File "/usr/lib64/python2.7/site-packages/novaclient/shell.py", line 920, in main
  File "/usr/lib64/python2.7/site-packages/novaclient/shell.py", line 847, in main
  File "./usr/lib64/python2.7/site-packages/novaclient/v2/shell.py", line 1412, in do_list
  File "./usr/lib64/python2.7/site-packages/novaclient/v2/servers.py", line 602, in list
  File "/usr/lib64/python2.7/site-packages/novaclient/base.py", line 64, in _list
  File "/usr/lib64/python2.7/site-packages/keystoneclient/adapter.py", line 170, in get
  File "./usr/lib64/python2.7/site-packages/novaclient/client.py", line 90, in request
  File "/usr/lib64/python2.7/site-packages/keystoneclient/adapter.py", line 206, in request
  File "/usr/lib64/python2.7/site-packages/keystoneclient/adapter.py", line 95, in request
  File "./usr/lib64/python2.7/site-packages/keystoneclient/utils.py", line 318, in inner
  File "./usr/lib64/python2.7/site-packages/keystoneclient/session.py", line 313, in request
  File "./usr/lib64/python2.7/site-packages/keystoneclient/session.py", line 598, in get_auth_headers
  File "./usr/lib64/python2.7/site-packages/keystoneclient/auth/base.py", line 114, in get_headers
  File "./usr/lib64/python2.7/site-packages/keystoneclient/auth/identity/base.py", line 104, in get_token
  File "./usr/lib64/python2.7/site-packages/keystoneclient/auth/identity/base.py", line 144, in get_access
  File "./usr/lib64/python2.7/site-packages/keystoneclient/auth/identity/generic/base.py", line 176, in get_auth_ref
  File "./usr/lib64/python2.7/site-packages/keystoneclient/auth/identity/v2.py", line 78, in get_auth_ref
  File "./usr/lib64/python2.7/site-packages/keystoneclient/session.py", line 497, in post
  File "./usr/lib64/python2.7/site-packages/keystoneclient/utils.py", line 318, in inner
  File "./usr/lib64/python2.7/site-packages/keystoneclient/session.py", line 382, in request
  File "./usr/lib64/python2.7/site-packages/keystoneclient/session.py", line 420, in _send_request
SSLError: SSL exception connecting to https://10.30.4.100:5000/v2.0/tokens: [Errno bad handshake] [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')]
ERROR (SSLError): SSL exception connecting to https://10.30.4.100:5000/v2.0/tokens: [Errno bad handshake] [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')]

Working with bypass-url:

[root@controller-0 ~(keystone_admin)]# nova --debug --bypass-url http://10.30.3.103:5000/v2.0/ list
REQ: curl -g -i 'http://10.30.3.103:5000/v2.0/tokens' -X POST -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -d '{"auth": {"tenantName": "admin", "passwordCredentials": {"username": "admin", "password": "{SHA1}e19993bc289d21c00f6a33038a848235ae5fc0e3"}}}'
RESP: [200] {'content-length': '8179', 'vary': 'X-Auth-Token', 'connection': 'keep-alive', 'date': 'Tue, 17 Nov 2015 18:49:04 GMT', 'content-type': 'application/json', 'x-openstack-request-id': 'req-77a990e3-98a7-4cd4-be07-44b2ea3af5c3'}
RESP BODY: {"access": {"token": {"issued_at": "2015-11-17T18:49:04.401803", "expires": "2015-11-17T22:49:04Z", "id": "{SHA1}30e50677c2772d83fe134f47a1d1fa4eb425680b", "tenant": {"enabled": true, "description": null, "name": "admin", "id": "89bd8f83a47a40589ce34a6921b3454b"}, "audit_ids": ["Mg0ntCAZQ9GXi6Xvbi2bxA"]}, "serviceCatalog": [{"endpoints_links": [], "endpoints": [{"adminURL": "http://10.30.3.103:8774/v2/89bd8f83a47a40589ce34a6921b3454b", "region": "memphis", "publicURL": "https://10.30.4.100:8774/v2/89bd8f83a47a40589ce34a6921b3454b", "internalURL": "http://10.30.3.103:8774/v2/89bd8f83a47a40589ce34a6921b3454b", "id": "3a928c51dbf24f8d914baf47aac5cfe2"}, {"adminURL": "http://10.30.3.50:8774/v2/89bd8f83a47a40589ce34a6921b3454b", "region": "regionkvm", "publicURL": "https://10.30.4.50:8774/v2/89bd8f83a47a40589ce34a6921b3454b", "internalURL": "http://10.30.3.50:8774/v2/89bd8f83a47a40589ce34a6921b3454b", "id": "4fe0a6f01d99410b96804d85aab0271f"}], "type": "compute", "name": "nova"}, {"endpoints_links": [], "endpoints": [{"adminURL": "http://10.30.3.103:9696", "region": "memphis", "publicURL": "https://10.30.4.100:9696", "internalURL": "http://10.30.3.103:9696", "id": "5fe4b81c49ee470b8c0c622499caa7c2"}, {"adminURL": "http://10.30.3.103:9696/", "region": "regionkvm", "publicURL": "https://10.30.4.100:9696/", "internalURL": "http://10.30.3.103:9696/", "id": "2a1f665425274d438c3e03b479bd2bf0"}], "type": "network", "name": "neutron"}, {"endpoints_links": [], "endpoints": [{"adminURL": "http://10.30.3.103:8776/v2/89bd8f83a47a40589ce34a6921b3454b", "region": "memphis", "publicURL": "https://10.30.4.100:8776/v2/89bd8f83a47a40589ce34a6921b3454b", "internalURL": "http://10.30.3.103:8776/v2/89bd8f83a47a40589ce34a6921b3454b", "id": "5ead188c11dd4327979843fd7428099b"}, {"adminURL": "http://10.30.3.103:8776/v2/89bd8f83a47a40589ce34a6921b3454b", "region": "regionkvm", "publicURL": "https://10.30.4.100:8776/v2/89bd8f83a47a40589ce34a6921b3454b", "internalURL": "http://10.30.3.103:8776/v2/89bd8f83a47a40589ce34a6921b3454b", "id": "3b5b3a0b65ca404b9794d46ef795b765"}], "type": "volumev2", "name": "cinderv2"}, {"endpoints_links": [], "endpoints": [{"adminURL": "http://10.30.3.50:8774/v3", "region": "regionkvm", "publicURL": "https://10.30.4.50:8774/v3", "internalURL": "http://10.30.3.50:8774/v3", "id": "7c62065a1107402ba3e78df8e19e7293"}], "type": "computev3", "name": "novav3"}, {"endpoints_links": [], "endpoints": [{"adminURL": "http://10.30.3.103:9292/v2", "region": "memphis", "publicURL": "https://10.30.4.100:9292/", "internalURL": "http://10.30.3.103:9292/v2", "id": "0577163581644aefb75e192b2282dfd9"}, {"adminURL": "http://10.30.3.103:9292/v2", "region": "regionkvm", "publicURL": "https://10.30.4.100:9292/v2", "internalURL": "http://10.30.3.103:9292/v2", "id": "322dd666dede48ada1217c9ec3bc2c7d"}], "type": "image", "name": "glance"}, {"endpoints_links": [], "endpoints": [{"adminURL": "http://10.30.3.103:8777", "region": "memphis", "publicURL": "https://10.30.4.100:8777", "internalURL": "http://10.30.3.103:8777", "id": "100e5b1a82a644ed9312ef62bbb9ba45"}, {"adminURL": "http://10.30.3.50:8777", "region": "regionkvm", "publicURL": "https://10.30.4.50:8777", "internalURL": "http://10.30.3.50:8777", "id": "643c3fc2513c40ac90936c7814bd9622"}], "type": "metering", "name": "ceilometer"}, {"endpoints_links": [], "endpoints": [{"adminURL": "http://10.30.3.103:8000/v2/89bd8f83a47a40589ce34a6921b3454b", "region": "memphis", "publicURL": "https://10.30.4.100:8000/v2/89bd8f83a47a40589ce34a6921b3454b", "internalURL": "http://10.30.3.103:8000/v2/89bd8f83a47a40589ce34a6921b3454b", "id": "0d60319f1fee4eddbca19d0c3cdab11e"}, {"adminURL": "http://10.30.3.50:8000/v1/", "region": "regionkvm", "publicURL": "https://10.30.4.50:8000/v1/", "internalURL": "http://10.30.3.50:8000/v1/", "id": "0a996fb4d3bc4b45b588aa9fcae5fbfe"}], "type": "cloudformation", "name": "heat-api-cfn"}, {"endpoints_links": [], "endpoints": [{"adminURL": "http://10.30.3.103:8776/v1/89bd8f83a47a40589ce34a6921b3454b", "region": "memphis", "publicURL": "https://10.30.4.100:8776/v1/89bd8f83a47a40589ce34a6921b3454b", "internalURL": "http://10.30.3.103:8776/v1/89bd8f83a47a40589ce34a6921b3454b", "id": "1b3d6ef8d53142908e34196e15bdbd24"}, {"adminURL": "http://10.30.3.103:8776/v1/89bd8f83a47a40589ce34a6921b3454b", "region": "regionkvm", "publicURL": "https://10.30.4.100:8776/v1/89bd8f83a47a40589ce34a6921b3454b", "internalURL": "http://10.30.3.103:8776/v1/89bd8f83a47a40589ce34a6921b3454b", "id": "03c89b8ad26343e8b7491f8980474be6"}], "type": "volume", "name": "cinder"}, {"endpoints_links": [], "endpoints": [{"adminURL": "http://10.30.3.50:6385/v1", "region": "regionkvm", "publicURL": "https://10.30.4.50:6385/v1", "internalURL": "http://10.30.3.50:6385/v1", "id": "3f7c77ece3514379a63913b4d3fbc063"}], "type": "platform", "name": "sysinv"}, {"endpoints_links": [], "endpoints": [{"adminURL": "http://10.30.3.50:9999/v1", "region": "regionkvm", "publicURL": "https://10.30.4.50:9999/v1", "internalURL": "http://10.30.3.50:9999/v1", "id": "0177683529a74a6a9182bee4c3b90cdc"}], "type": "power", "name": "power_mgmt"}, {"endpoints_links": [], "endpoints": [{"adminURL": "http://BASE-CCP-T2-VIP-ATTIS-NETCLM:9898/v1", "region": "memphis", "publicURL": "https://10.30.4.100:9898/v1", "internalURL": "http://BASE-CCP-T2-VIP-ATTIS-NETCLM:9898/v1", "id": "8ba786ccc6244417b070c4631ce45e09"}], "type": "backupandrestore", "name": "attis"}, {"endpoints_links": [], "endpoints": [{"adminURL": "http://10.30.3.103:8004/v1/89bd8f83a47a40589ce34a6921b3454b", "region": "memphis", "publicURL": "https://10.30.4.100:8004/v1/89bd8f83a47a40589ce34a6921b3454b", "internalURL": "http://10.30.3.103:8004/v1/89bd8f83a47a40589ce34a6921b3454b", "id": "082117c5b7a94e518c454b4f5df38a73"}, {"adminURL": "http://10.30.3.50:8004/v1/89bd8f83a47a40589ce34a6921b3454b", "region": "regionkvm", "publicURL": "https://10.30.4.50:8004/v1/89bd8f83a47a40589ce34a6921b3454b", "internalURL": "http://10.30.3.50:8004/v1/89bd8f83a47a40589ce34a6921b3454b", "id": "49fe1d0475c046e9acad7d81156b5042"}], "type": "orchestration", "name": "heat"}, {"endpoints_links": [], "endpoints": [{"adminURL": "http://10.30.3.103:8080/v1", "region": "memphis", "publicURL": "https://10.30.4.100:8080/v1/AUTH_89bd8f83a47a40589ce34a6921b3454b", "internalURL": "http://10.30.3.103:8080/v1/AUTH_89bd8f83a47a40589ce34a6921b3454b", "id": "b5555aafc40d4bfcadef01a8c5fddb2b"}, {"adminURL": "http://10.30.3.103:8080/v1", "region": "regionkvm", "publicURL": "https://10.30.4.100:8080/v1/AUTH_89bd8f83a47a40589ce34a6921b3454b", "internalURL": "http://10.30.3.103:8080/v1/AUTH_89bd8f83a47a40589ce34a6921b3454b", "id": "294463edb16642f7a8828ab1c1dc1e3e"}], "type": "object-store", "name": "swift"}, {"endpoints_links": [], "endpoints": [{"adminURL": "http://10.30.3.50:5491", "region": "regionkvm", "publicURL": "https://10.30.4.50:15491", "internalURL": "http://10.30.3.50:5491", "id": "0582ea2208a548269b039e595543faa3"}], "type": "patching", "name": "patching"}, {"endpoints_links": [], "endpoints": [{"adminURL": "http://10.30.3.103:35357/v2.0", "region": "memphis", "publicURL": "https://10.30.4.100:5000/v2.0", "internalURL": "http://10.30.3.103:5000/v2.0", "id": "0077e2a59fc2465e9fdd3e975afe5d79"}, {"adminURL": "http://10.30.3.103:35357/v2.0", "region": "regionkvm", "publicURL": "https://10.30.4.100:5000/v2.0", "internalURL": "http://10.30.3.103:5000/v2.0", "id": "d52168ac4f9c4a25a9d0f50f1e91990b"}], "type": "identity", "name": "keystone"}, {"endpoints_links": [], "endpoints": [{"adminURL": "http://10.30.3.50:8773/services/Admin", "region": "regionkvm", "publicURL": "https://10.30.4.50:8773/services/Cloud", "internalURL": "http://10.30.3.50:8773/services/Cloud", "id": "3791522c91bf45a3b08e32117b7df461"}], "type": "ec2", "name": "nova_ec2"}], "user": {"username": "admin", "roles_links": [], "id": "a59a5debd6c549acb57e2a001a61722e", "roles": [{"name": "KeystoneAdmin"}, {"name": "KeystoneServiceAdmin"}, {"name": "admin"}, {"name": "_member_"}], "name": "admin"}, "metadata": {"is_admin": 0, "roles": ["e1f52480620d405896a89b4eb265a19d", "409af58a711a4cfba29b84e950389e4f", "25396eeac5d7459aacf21d9d47b92190", "9fe2ff9ee4384b1894a90878d3e92bab"]}}}

REQ: curl -g -i 'http://10.30.3.50:8774/v2/89bd8f83a47a40589ce34a6921b3454b/servers/detail' -X GET -H "Accept: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Project-Id: admin" -H "X-Auth-Token: {SHA1}30e50677c2772d83fe134f47a1d1fa4eb425680b"
RESP: [200] {'date': 'Tue, 17 Nov 2015 18:49:04 GMT', 'connection': 'keep-alive', 'content-type': 'application/json', 'content-length': '15', 'x-compute-request-id': 'req-8f866689-c708-4318-9f65-a1f163c85207'}
RESP BODY: {"servers": []}

Keystone Endpoint List:

Michael Duncan (mduncan-j) on 2015-11-17

summary:

- os-endpoint-type not really working it testing internalURL
+ os-endpoint-type not really working internalURL required

Michael Duncan (mduncan-j) on 2015-11-17

summary:

- os-endpoint-type not really working internalURL required
+ os-endpoint-type not really working internalURL required 2nd region only
+ support http access.

Revision history for this message

Markus Zoeller (markus_z) (mzoeller) wrote on 2015-11-30:

@Michael Duncan:

We need additional information to do a proper bug triage.
Would you please provide the following information:

* What was the result you expected? The error indicates that there is
an issue with your certificates (and I'm guessing that OpenStack does
not setup certificates).

    SSL exception connecting to https://10.30.4.100:5000/v2.0/tokens:
    [Errno bad handshake] [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE',
    'certificate verify failed')]

* Which version did you use? Depending on your package manager you can
  use:
    $ dpkg -l | grep nova
    or:
    $ rpm -ql | grep nova

If you installed it from git you can use:
$ cd /opt/stack/nova && git log -1

After you provided this information, please set this bug status back
to "New".

Changed in nova:
status:	New → Incomplete
Changed in python-novaclient:
status:	New → Incomplete
Changed in nova:
status:	Incomplete → Invalid

Revision history for this message

Michael Duncan (mduncan-j) wrote on 2015-11-30:

Sorry after furthering debugging the https issue and checking found the keystone endpoints setup incorrectly.

Closing ticket as false report.

Changed in python-novaclient:
status:	Incomplete → Invalid
Changed in nova:
assignee:	nobody → Michael Duncan (mduncan-j)
Changed in python-novaclient:
assignee:	nobody → Michael Duncan (mduncan-j)

Report a bug

This report contains Public information

Everyone can see this information.

You are

Subscribing...

Edit bug mail

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.