Build "Ubuntu 12.04.3 LTS" 2.1-7~icehouse : Api server could not connect to keystone due to authentication error

[Sandip Dey]

I see a strange keystone client error(no clue about the cause).

Ajay, Have you seen this issue before? The file "/tmp/keystone-signing-bdVaLU/signing_cert.pem" does exist and with correct permission.

127.0.0.1 - - [2015-01-20 17:47:27] "GET / HTTP/1.1" 401 197 0.000389
ERROR:keystoneclient.middleware.auth_token:CMS Verify output: Error opening certificate file /tmp/keystone-signing-bdVaLU/signing_cert.pem
140091113670304:error:02001002:system library:fopen:No such file or directory:bss_file.c:169:fopen('/tmp/keystone-signing-bdVaLU/signing_cert.pem','r')
140091113670304:error:2006D080:BIO routines:BIO_new_file:no such file:bss_file.c:172:

WARNING:keystoneclient.middleware.auth_token:Authorization failed for token
127.0.0.1 - - [2015-01-20 17:47:27] "GET / HTTP/1.1" 401 197 0.055778
Traceback (most recent call last):
  File "/usr/lib/pymodules/python2.7/gevent/greenlet.py", line 328, in run
    result = self._run(*self.args, **self.kwargs)
  File "/usr/lib/python2.7/dist-packages/vnc_openstack/__init__.py", line 593, in _get_api_connection
    tenant_name=self._admin_tenant)
  File "/usr/lib/python2.7/dist-packages/vnc_api/vnc_api.py", line 185, in __init__
    retry_on_error=False)
  File "/usr/lib/python2.7/dist-packages/vnc_api/vnc_api.py", line 381, in _request
    content = self._request(op, url, data=data, retry_after_authn=True)
  File "/usr/lib/python2.7/dist-packages/vnc_api/vnc_api.py", line 406, in _request
    raise HttpError(status, content)
HttpError: HTTP Status: 401 Content: Authentication required
<Greenlet at 0x48470f0: <bound method ResourceApiDriver._get_api_connection of <vnc_openstack.ResourceApiDriver object at 0x484ec90>>> failed with HttpError

Thanks, Prakash

From: Sandip Dey
Sent: Tuesday, January 20, 2015 10:14 AM
To: Nagabhushana R; Prakash M Bailkeri
Cc: Senthilnathan Murugappan
Subject: Re: [Build "Ubuntu 12.04.3 LTS" 2.1-7~icehouse] vm_regression MultiNode Report

The setup is on hold, can be used.

Logs saved at /cs-shared/test_runs/nodei34/2015_01_20_16_49_59

Regards
Sandip

From: Nagabhushana R <email address hidden>
Date: Tuesday, January 20, 2015 11:40 PM
To: Sandip Dey <email address hidden>, Prakash M Bailkeri <email address hidden>
Cc: Senthilnathan Murugappan <email address hidden>
Subject: Re: [Build "Ubuntu 12.04.3 LTS" 2.1-7~icehouse] vm_regression MultiNode Report

+ Prakash

Prakash this is on build 7 R2.1. Could you check.

--
Bhushana

On Jan 20, 2015, at 11:33 PM, Sandip Dey <email address hidden>
 wrote:

I see this error in contrail-api log.

Senthil,could you have someone to take a look

27.0.0.1 - - [2015-01-20 18:03:13] "POST /fqname-to-id HTTP/1.1" 404 189 0.023040
ERROR:stevedore.extension:error calling 'xxx': 'NoneType' object has no attribute 'security_group_create'
ERROR:stevedore.extension:'NoneType' object has no attribute 'security_group_create'
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/stevedore/extension.py", line 247, in _invoke_one_plugin
    response_callback(func(e, *args, **kwds))
  File "/usr/lib/python2.7/dist-packages/stevedore/extension.py", line 221, in _call_extension_method
    return getattr(extension.obj, method_name)(*args, **kwds)
  File "/usr/lib/python2.7/dist-packages/vnc_openstack/__init__.py", line 691, in post_project_create
    self._create_default_security_group(proj_dict)
  File "/usr/lib/python2.7/dist-packages/vnc_openstack/__init__.py", line 654, in _create_default_security_group
    self._vnc_lib.security_group_create(sg_obj)
AttributeError: 'NoneType' object has no attribute 'security_group_create'
127.0.0.1 - - [2015-01-20 18:03:13] "POST /projects HTTP/1.1" 200 488 0.021445

[Sandip Dey (sandipd)]

Logs saved at :http://10.204.216.50/Docs/bugs/<bug-id>

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/8255
Submitter: Ignatious Johnson Christopher (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/8275
Submitter: Ignatious Johnson Christopher (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/8255
Submitter: Ignatious Johnson Christopher (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/8255
Committed: http://github.org/Juniper/contrail-controller/commit/c280e6e16aeab7571c9f75caa1e6127d1877d212
Submitter: Zuul
Branch: master

commit c280e6e16aeab7571c9f75caa1e6127d1877d212
Author: Ignatious Johnson <email address hidden>
Date: Wed Mar 11 10:22:02 2015 -0700

Fetching certificates if there is an eception during verifiaction of the
singned token.

Change-Id: I0f0cc0f5f7fab7a46c67111d9a1cce3f94c6cb18
Closes-Bug: 1413082

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/8275
Committed: http://github.org/Juniper/contrail-controller/commit/3d373c4b2b18694b5c20f8376d01da29dd4d363a
Submitter: Zuul
Branch: R2.1

commit 3d373c4b2b18694b5c20f8376d01da29dd4d363a
Author: Ignatious Johnson <email address hidden>
Date: Wed Mar 11 17:47:42 2015 -0700

Fetching certificates if there is an eception during verification of the
singned token.

Change-Id: Id9c4c66048a1878bc077bef25c0ac8636a7dc49c
Closes-Bug: 1413082