Zun

Internal Server Error (HTTP 500) - when try to create container

Bug #1763213 reported by Murali Birru
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Zun
Expired
Undecided
Unassigned

Bug Description

I running ZUN on pike I configured the "auth_url" properly in /etc/zun/zun.conf.

Still auth_url is not reading properly when zun-compute status throws the below when try to create container

2018-04-11 15:51:46.755 18017 DEBUG eventlet.wsgi.server [-] (18017) accepted ('10.11.142.2', 52374) server /usr/lib/python2.7/dist-packages/eventlet/wsgi.py:867
2018-04-11 15:51:47.490 18017 DEBUG zun.api.controllers.v1 [-] Processing request: url: http://cluster3-2:9517/v1/containers?run=true, POST, body: {"name": "container", "image": "cirros", "labels": {}, "environment": {}, "command": "\"ping\" \"8.8.8.8\"", "nets": [{"v4-fixed-ip": "", "network": "ee56f952-8ff1-4752-991f-605d29d71985", "v6-fixed-ip": "", "port": ""}], "hints": {}} _route /usr/local/lib/python2.7/dist-packages/zun/api/controllers/v1/__init__.py:172
2018-04-11 15:51:47.493 18017 DEBUG oslo_policy._cache_handler [req-646c3936-aef3-4a91-bb50-061757ac2839 3b136545b47b40709b78b1e36cdcdc63 a391261cffba4f4c827ab7420a352fe1 default - -] Reloading cached file /etc/zun/policy.json read_cached_file /usr/local/lib/python2.7/dist-packages/oslo_policy/_cache_handler.py:40
2018-04-11 15:51:47.517 18017 DEBUG oslo_policy.policy [req-646c3936-aef3-4a91-bb50-061757ac2839 3b136545b47b40709b78b1e36cdcdc63 a391261cffba4f4c827ab7420a352fe1 default - -] Reloaded policy file: /etc/zun/policy.json _load_policy_file /usr/local/lib/python2.7/dist-packages/oslo_policy/policy.py:757
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception [req-646c3936-aef3-4a91-bb50-061757ac2839 3b136545b47b40709b78b1e36cdcdc63 a391261cffba4f4c827ab7420a352fe1 default - -] 5f6a8cfc-1138-47bf-b2e0-0c01b9e2d8d9:unexpected keystone client error occurred: Auth plugin requires parameters which were not given: auth_url
Traceback (most recent call last):

  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 160, in _process_incoming
    res = self.dispatcher.dispatch(message)

  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 213, in dispatch
    return self._do_dispatch(endpoint, method, ctxt, args)

  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 183, in _do_dispatch
    result = func(ctxt, **new_args)

  File "/usr/local/lib/python2.7/dist-packages/zun/common/utils.py", line 162, in decorated_function
    return function(self, context, *args, **kwargs)

  File "/usr/local/lib/python2.7/dist-packages/zun/compute/manager.py", line 651, in image_search
    image_driver_name, exact_match)

  File "/usr/local/lib/python2.7/dist-packages/zun/image/driver.py", line 103, in search_image
    raise exception.ZunException(six.text_type(e))

ZunException: unexpected keystone client error occurred: Auth plugin requires parameters which were not given: auth_url
: ZunException_Remote: unexpected keystone client error occurred: Auth plugin requires parameters which were not given: auth_url
Traceback (most recent call last):

  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 160, in _process_incoming
    res = self.dispatcher.dispatch(message)

  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 213, in dispatch
    return self._do_dispatch(endpoint, method, ctxt, args)

  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 183, in _do_dispatch
    result = func(ctxt, **new_args)

  File "/usr/local/lib/python2.7/dist-packages/zun/common/utils.py", line 162, in decorated_function
    return function(self, context, *args, **kwargs)

  File "/usr/local/lib/python2.7/dist-packages/zun/compute/manager.py", line 651, in image_search
    image_driver_name, exact_match)

  File "/usr/local/lib/python2.7/dist-packages/zun/image/driver.py", line 103, in search_image
    raise exception.ZunException(six.text_type(e))

ZunException: unexpected keystone client error occurred: Auth plugin requires parameters which were not given: auth_url
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception Traceback (most recent call last):
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception File "/usr/local/lib/python2.7/dist-packages/zun/common/exception.py", line 109, in wrapped
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception return func(*args, **kwargs)
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception File "/usr/local/lib/python2.7/dist-packages/zun/common/validation/__init__.py", line 55, in wrapper
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception return func(*args, **kwargs)
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception File "/usr/local/lib/python2.7/dist-packages/zun/common/validation/__init__.py", line 33, in wrapper
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception return func(*args, **kwargs)
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception File "/usr/local/lib/python2.7/dist-packages/zun/api/controllers/v1/containers.py", line 251, in post
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception True)
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception File "/usr/lib/python2.7/dist-packages/osprofiler/profiler.py", line 153, in wrapper
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception return f(*args, **kwargs)
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception File "/usr/local/lib/python2.7/dist-packages/zun/compute/api.py", line 134, in image_search
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception return self.rpcapi.image_search(context, image, image_driver, *args)
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception File "/usr/lib/python2.7/dist-packages/osprofiler/profiler.py", line 153, in wrapper
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception return f(*args, **kwargs)
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception File "/usr/local/lib/python2.7/dist-packages/zun/compute/rpcapi.py", line 176, in image_search
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception exact_match=exact_match)
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception File "/usr/local/lib/python2.7/dist-packages/zun/common/rpc_service.py", line 103, in _call
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception return cctxt.call(self._context, method, *args, **kwargs)
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 169, in call
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception retry=self.retry)
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception File "/usr/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 123, in _send
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception timeout=timeout, retry=retry)
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 578, in send
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception retry=retry)
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 569, in _send
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception raise result
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception ZunException_Remote: unexpected keystone client error occurred: Auth plugin requires parameters which were not given: auth_url
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception Traceback (most recent call last):
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 160, in _process_incoming
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception res = self.dispatcher.dispatch(message)
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 213, in dispatch
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception return self._do_dispatch(endpoint, method, ctxt, args)
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 183, in _do_dispatch
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception result = func(ctxt, **new_args)
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception File "/usr/local/lib/python2.7/dist-packages/zun/common/utils.py", line 162, in decorated_function
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception return function(self, context, *args, **kwargs)
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception File "/usr/local/lib/python2.7/dist-packages/zun/compute/manager.py", line 651, in image_search
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception image_driver_name, exact_match)
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception File "/usr/local/lib/python2.7/dist-packages/zun/image/driver.py", line 103, in search_image
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception raise exception.ZunException(six.text_type(e))
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception ZunException: unexpected keystone client error occurred: Auth plugin requires parameters which were not given: auth_url
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception
2018-04-11 15:51:48.401 18017 ERROR zun.common.exception
2018-04-11 15:51:48.404 18017 INFO eventlet.wsgi.server [req-646c3936-aef3-4a91-bb50-061757ac2839 3b136545b47b40709b78b1e36cdcdc63 a391261cffba4f4c827ab7420a352fe1 default - -] 10.11.142.2 "POST /v1/containers?run=true HTTP/1.1" status: 500 len: 628 time: 1.6476400

Revision history for this message
Deepak Mourya (mourya007) wrote :

Hi, can you tell me what is the auth_url you are going to provide in [keystone_auth] section .
Seems like keystone could not find the particular one.

Revision history for this message
Murali Birru (mbirru) wrote :

Here is my config got "keystone_authtoken"
[keystone_authtoken]
#
# From keystonemiddleware.auth_token
#
memcached_servers = controller:11211
auth_uri = http://controller:5000
auth_url = http://controller:35357
project_domain_name = default
project_name = service
user_domain_name = default
password = password
username = zun
auth_type = password
auth_version = v3
auth_protocol = http
service_token_roles_required = True
endpoint_type = internalURL

Revision history for this message
hongbin (hongbin034) wrote :

Hi @Murali,

Sorry, I somehow missed this bug report. I think the quickest fix is to remove 'glance' from the config 'image_driver_list' if you are not using glance as image store. Then, 'docker' (DockerHub) will become the only location that zun tries to find the image:

  [DEFAULT]
  ...
  image_driver_list = docker

Revision history for this message
hongbin (hongbin034) wrote :

If it still doesn't work, I need to look into your config file. Would you attach your entire config file into this bug report (with sensitive information removed if any)?

hongbin (hongbin034)
Changed in zun:
status: New → Incomplete
Revision history for this message
Launchpad Janitor (janitor) wrote :

[Expired for Zun because there has been no activity for 60 days.]

Changed in zun:
status: Incomplete → Expired
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.