Juniper Openstack

Openstack HA : contrail-openstack-ha package installation fails without internet connection

Bug #1446419 reported by venu kolli
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R2.20
Fix Released
Critical
venu kolli
Juniper Openstack r2.20-fcs
Trunk
Fix Released
Critical
venu kolli
Juniper Openstack r3.0-fcs

Bug Description

Issue is observed on Openstack HA on juno R2.1 build 53

       'all': [host1, host2, host3, host4, host5, host6],
        'cfgm': [host1, host2, host3],
        'openstack': [host1, host2, host3],
        'control': [host1, host2, host3],
        'compute': [host4, host5],
        'collector': [host1, host2, host3],
        'webui': [host1, host2, host3],
        'database': [host1, host2, host3],
        'build': [host_build],

root@a6s33:/var/log/nova# nova --debug list
REQ: curl -i 'http://192.168.10.210:5000/v2.0/tokens' -X POST -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclien
t" -d '{"auth": {"tenantName": "admin", "passwordCredentials": {"username": "admin", "password": "{SHA1}d476b326d4965b3e25bb48404882d0bdcecd21f6"}}}'
INFO (connectionpool:258) Starting new HTTP connection (1): 192.168.10.210
DEBUG (connectionpool:375) Setting read timeout to 600.0
DEBUG (connectionpool:415) "POST /v2.0/tokens HTTP/1.1" 200 5778
RESP: [200] CaseInsensitiveDict({'date': 'Mon, 20 Apr 2015 23:13:29 GMT', 'vary': 'X-Auth-Token', 'content-length': '5778', 'content-type': 'application/json',
'x-distribution': 'Ubuntu'})
RESP BODY: {"access": {"token": {"issued_at": "2015-04-20T23:13:29.554480", "expires": "2015-04-21T00:13:29Z", "id": "{SHA1}b6b61bc8556d4ebf2ad5841ed0d6f5367465
44b4", "tenant": {"enabled": true, "description": null, "name": "admin", "id": "5eaa22fd63c247dd84ec05361378c498"}, "audit_ids": ["hqq9QRKrSOiPpLtKT-4Cyw"]}, "s
erviceCatalog": [{"endpoints_links": [], "endpoints": [{"adminURL": "http://localhost:8774/v1.1/5eaa22fd63c247dd84ec05361378c498", "region": "RegionOne", "publi
cURL": "http://192.168.10.210:8774/v1.1/5eaa22fd63c247dd84ec05361378c498", "internalURL": "http://192.168.10.210:8774/v1.1/5eaa22fd63c247dd84ec05361378c498", "i
d": "0f070077b2a4408da3f0a7f3447e3c3c"}], "type": "compute", "name": "nova"}, {"endpoints_links": [], "endpoints": [{"adminURL": "http://192.168.10.210:9696", "
region": "RegionOne", "publicURL": "http://192.168.10.210:9696", "internalURL": "http://192.168.10.210:9696", "id": "b67937a87ff64db28571264b00b2c51c"}], "type"
: "network", "name": "neutron"}, {"endpoints_links": [], "endpoints": [{"adminURL": "http://localhost:9393/v1", "region": "RegionOne", "publicURL": "http://192.
168.10.210:9292/v1", "internalURL": "http://localhost:9393/v1", "id": "34bc4d449cce455d9b1aab5d33779c98"}], "type": "image", "name": "glance"}, {"endpoints_link
s": [], "endpoints": [{"adminURL": "http://localhost:9776/v1/5eaa22fd63c247dd84ec05361378c498", "region": "RegionOne", "publicURL": "http://192.168.10.210:8776/
v1/5eaa22fd63c247dd84ec05361378c498", "internalURL": "http://localhost:9776/v1/5eaa22fd63c247dd84ec05361378c498", "id": "02eb0ab810794c1ea71ec432f829d209"}], "t
ype": "volume", "name": "cinder"}, {"endpoints_links": [], "endpoints": [{"adminURL": "http://localhost:8773/services/Admin", "region": "RegionOne", "publicURL"
: "http://localhost:8773/services/Cloud", "internalURL": "http://localhost:8773/services/Cloud", "id": "9e87bc50a835426488baf974125db850"}], "type": "ec2", "nam
e": "ec2"}, {"endpoints_links": [], "endpoints": [{"adminURL": "http://192.168.10.210:8004/v1/5eaa22fd63c247dd84ec05361378c498", "region": "RegionOne", "publicU
RL": "http://192.168.10.210:8004/v1/5eaa22fd63c247dd84ec05361378c498", "internalURL": "http://192.168.10.210:8004/v1/5eaa22fd63c247dd84ec05361378c498", "id": "8
d0cf1e792804b6cbc33442b6754d98e"}], "type": "orchestration", "name": "heat"}, {"endpoints_links": [], "endpoints": [{"adminURL": "http://192.168.10.210:35357/v2
.0", "region": "RegionOne", "publicURL": "http://192.168.10.210:6000/v2.0", "internalURL": "http://192.168.10.210:(public_port)s/v2.0", "id": "6efb79b086f349fd8
4d3f40459f4162e"}], "type": "identity", "name": "keystone"}], "user": {"username": "admin", "roles_links": [], "id": "0b3fc2ddd1734adcaf6ff4a9178ad4c2", "roles"
: [{"name": "KeystoneAdmin"}, {"name": "KeystoneServiceAdmin"}, {"name": "admin"}], "name": "admin"}, "metadata": {"is_admin": 0, "roles": ["8bf2b491e83042d980e
dfc2fe6d68024", "70e2d605907441548b4c07d258336799", "ebc57eaf2d904f9b8d7fff61f3a02800"]}}}

REQ: curl -i 'http://192.168.10.210:8774/v1.1/5eaa22fd63c247dd84ec05361378c498/servers/detail' -X GET -H "Accept: application/json" -H "User-Agent: python-novac
lient" -H "X-Auth-Project-Id: admin" -H "X-Auth-Token: {SHA1}b6b61bc8556d4ebf2ad5841ed0d6f536746544b4"
INFO (connectionpool:258) Starting new HTTP connection (1): 192.168.10.210
DEBUG (connectionpool:375) Setting read timeout to 600.0
DEBUG (connectionpool:415) "GET /v1.1/5eaa22fd63c247dd84ec05361378c498/servers/detail HTTP/1.1" 401 23
RESP: [401] CaseInsensitiveDict({'date': 'Mon, 20 Apr 2015 23:13:29 GMT', 'x-compute-request-id': 'req-9e92973d-8568-4e7a-a42e-7bf17a5a8115', 'content-type': 'text/plain', 'www-authenticate': "Keystone uri='http://192.168.10.210:5000'", 'content-length': '23'})
RESP BODY: null

REQ: curl -i 'http://192.168.10.210:5000/v2.0/tokens' -X POST -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -d '{"auth": {"passwordCredentials": {"username": "admin", "password": "{SHA1}d476b326d4965b3e25bb48404882d0bdcecd21f6"}, "tenantId": "5eaa22fd63c247dd84ec05361378c498"}}'
INFO (connectionpool:258) Starting new HTTP connection (1): 192.168.10.210
DEBUG (connectionpool:375) Setting read timeout to 600.0
DEBUG (connectionpool:415) "POST /v2.0/tokens HTTP/1.1" 200 5778
RESP: [200] CaseInsensitiveDict({'date': 'Mon, 20 Apr 2015 23:13:29 GMT', 'vary': 'X-Auth-Token', 'content-length': '5778', 'content-type': 'application/json', 'x-distribution': 'Ubuntu'})
RESP BODY: {"access": {"token": {"issued_at": "2015-04-20T23:13:29.681223", "expires": "2015-04-21T00:13:29Z", "id": "{SHA1}811b828dac102024beb30757297fb4fc6b3375b7", "tenant": {"enabled": true, "description": null, "name": "admin", "id": "5eaa22fd63c247dd84ec05361378c498"}, "audit_ids": ["70TUU99qSjicPMCVRmGNqg"]}, "serviceCatalog": [{"endpoints_links": [], "endpoints": [{"adminURL": "http://localhost:8774/v1.1/5eaa22fd63c247dd84ec05361378c498", "region": "RegionOne", "publicURL": "http://192.168.10.210:8774/v1.1/5eaa22fd63c247dd84ec05361378c498", "internalURL": "http://192.168.10.210:8774/v1.1/5eaa22fd63c247dd84ec05361378c498", "id": "0f070077b2a4408da3f0a7f3447e3c3c"}], "type": "compute", "name": "nova"}, {"endpoints_links": [], "endpoints": [{"adminURL": "http://192.168.10.210:9696", "region": "RegionOne", "publicURL": "http://192.168.10.210:9696", "internalURL": "http://192.168.10.210:9696", "id": "b67937a87ff64db28571264b00b2c51c"}], "type": "network", "name": "neutron"}, {"endpoints_links": [], "endpoints": [{"adminURL": "http://localhost:9393/v1", "region": "RegionOne", "publicURL": "http://192.168.10.210:9292/v1", "internalURL": "http://localhost:9393/v1", "id": "34bc4d449cce455d9b1aab5d33779c98"}], "type": "image", "name": "glance"}, {"endpoints_links": [], "endpoints": [{"adminURL": "http://localhost:9776/v1/5eaa22fd63c247dd84ec05361378c498", "region": "RegionOne", "publicURL": "http://192.168.10.210:8776/v1/5eaa22fd63c247dd84ec05361378c498", "internalURL": "http://localhost:9776/v1/5eaa22fd63c247dd84ec05361378c498", "id": "02eb0ab810794c1ea71ec432f829d209"}], "type": "volume", "name": "cinder"}, {"endpoints_links": [], "endpoints": [{"adminURL": "http://localhost:8773/services/Admin", "region": "RegionOne", "publicURL": "http://localhost:8773/services/Cloud", "internalURL": "http://localhost:8773/services/Cloud", "id": "9e87bc50a835426488baf974125db850"}], "type": "ec2", "name": "ec2"}, {"endpoints_links": [], "endpoints": [{"adminURL": "http://192.168.10.210:8004/v1/5eaa22fd63c247dd84ec05361378c498", "region": "RegionOne", "publicURL": "http://192.168.10.210:8004/v1/5eaa22fd63c247dd84ec05361378c498", "internalURL": "http://192.168.10.210:8004/v1/5eaa22fd63c247dd84ec05361378c498", "id": "8d0cf1e792804b6cbc33442b6754d98e"}], "type": "orchestration", "name": "heat"}, {"endpoints_links": [], "endpoints": [{"adminURL": "http://192.168.10.210:35357/v2.0", "region": "RegionOne", "publicURL": "http://192.168.10.210:6000/v2.0", "internalURL": "http://192.168.10.210:(public_port)s/v2.0", "id": "6efb79b086f349fd84d3f40459f4162e"}], "type": "identity", "name": "keystone"}], "user": {"username": "admin", "roles_links": [], "id": "0b3fc2ddd1734adcaf6ff4a9178ad4c2", "roles": [{"name": "KeystoneAdmin"}, {"name": "KeystoneServiceAdmin"}, {"name": "admin"}], "name": "admin"}, "metadata": {"is_admin": 0, "roles": ["8bf2b491e83042d980edfc2fe6d68024", "70e2d605907441548b4c07d258336799", "ebc57eaf2d904f9b8d7fff61f3a02800"]}}}
REQ: curl -i 'http://192.168.10.210:8774/v1.1/5eaa22fd63c247dd84ec05361378c498/servers/detail' -X GET -H "Accept: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Project-Id: admin" -H "X-Auth-Token: {SHA1}811b828dac102024beb30757297fb4fc6b3375b7"
INFO (connectionpool:258) Starting new HTTP connection (1): 192.168.10.210
DEBUG (connectionpool:375) Setting read timeout to 600.0
DEBUG (connectionpool:415) "GET /v1.1/5eaa22fd63c247dd84ec05361378c498/servers/detail HTTP/1.1" 401 23
RESP: [401] CaseInsensitiveDict({'date': 'Mon, 20 Apr 2015 23:13:29 GMT', 'x-compute-request-id': 'req-ed852871-be31-4bfc-94d2-ba641ea6a708', 'content-type': 'text/plain', 'www-authenticate': "Keystone uri='http://192.168.10.210:5000'", 'content-length': '23'})
RESP BODY: null

DEBUG (shell:803) Unauthorized (HTTP 401) (Request-ID: req-9e92973d-8568-4e7a-a42e-7bf17a5a8115)
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/novaclient/shell.py", line 800, in main
    OpenStackComputeShell().main(argv)
  File "/usr/lib/python2.7/dist-packages/novaclient/shell.py", line 730, in main
    args.func(self.cs, args)
  File "/usr/lib/python2.7/dist-packages/novaclient/v1_1/shell.py", line 1233, in do_list
    search_opts=search_opts)
  File "/usr/lib/python2.7/dist-packages/novaclient/v1_1/servers.py", line 595, in list
    return self._list("/servers%s%s" % (detail, query_string), "servers")
  File "/usr/lib/python2.7/dist-packages/novaclient/base.py", line 67, in _list
    _resp, body = self.api.client.get(url)
  File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 487, in get
    return self._cs_request(url, 'GET', **kwargs)
  File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 479, in _cs_request
    raise e
Unauthorized: Unauthorized (HTTP 401) (Request-ID: req-9e92973d-8568-4e7a-a42e-7bf17a5a8115)
ERROR (Unauthorized): Unauthorized (HTTP 401) (Request-ID: req-9e92973d-8568-4e7a-a42e-7bf17a5a8115)
root@a6s33:/var/log/nova# nova --debug list

Tags: blocker ha
venu kolli (vkolli)
Changed in juniperopenstack:
assignee: nobody → Ranjeet R (rranjeet-n)
venu kolli (vkolli)
Changed in juniperopenstack:
importance: Undecided → Critical
tags: added: blocker
Ranjeet R (rranjeet-n)
summary: - Openstack HA : In Juno nova list fails due to keystone authorization
- failure
+ Openstack HA : Openstack HA package installation fails without internet
+ connection
summary: - Openstack HA : Openstack HA package installation fails without internet
- connection
+ Openstack HA : contrail-openstack-ha package installation fails without
+ internet connection
Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : R2.20

Review in progress for https://review.opencontrail.org/9798
Submitter: Ranjeet R (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : master

Review in progress for https://review.opencontrail.org/9799
Submitter: Ranjeet R (<email address hidden>)

Ashish Ranjan (aranjan-n)
information type: Proprietary → Public
Revision history for this message
Ranjeet R (rranjeet-n) wrote :

Fixed as part of this review - https://review.opencontrail.org/#/c/9669/

Revision history for this message
venu kolli (vkolli) wrote :

Verified on R2.2 build 17

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.