Karbor

  1. Bug #1798125
  2. Activity log

Activity log for bug #1798125

Date Who What changed Old value New value Message
2018-10-16 15:16:01 Gaëtan Trellu bug added bug
2018-10-16 16:38:51 Gaëtan Trellu description In karbor-operationengine.log I got an error because operation engine is not able to get the Karbor endpoint from Keystone catalog. url.replace("$(", "%(") failed because url is equal to None. ==> /var/lib/docker/volumes/kolla_logs/_data/karbor/karbor-operationengine.log <== 2018-10-16 15:12:10.051 7 DEBUG keystoneclient.session [req-1b1ea4c9-5148-4f3c-8a82-380c0a9a3023 - 2496480d09bc4c89acb4cb9ebc0101ce - - -] REQ: curl -g -i -X GET http://10.131.2.200:5000 -H "Accept: application/json" -H "User-Agent: python-keystoneclient" _http_log_request /var/lib/kolla/venv/local/lib/python2.7/site-packages/keystoneclient/session.py:216 2018-10-16 15:12:10.057 7 DEBUG keystoneclient.session [req-1b1ea4c9-5148-4f3c-8a82-380c0a9a3023 - 2496480d09bc4c89acb4cb9ebc0101ce - - -] RESP: [300] Date: Tue, 16 Oct 2018 15:12:10 GMT Server: Apache/2.4.18 (Ubuntu) Vary: X-Auth-Token Content-Length: 598 Content-Type: application/json RESP BODY: {"versions": {"values": [{"status": "stable", "updated": "2017-02-22T00:00:00Z", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v3+json"}], "id": "v3.8", "links": [{"href": "http://10.131.2.200:5000/v3/", "rel": "self"}]}, {"status": "deprecated", "updated": "2016-08-04T00:00:00Z", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v2.0+json"}], "id": "v2.0", "links": [{"href": "http://10.131.2.200:5000/v2.0/", "rel": "self"}, {"href": "https://docs.openstack.org/", "type": "text/html", "rel": "describedby"}]}]}} _http_log_response /var/lib/kolla/venv/local/lib/python2.7/site-packages/keystoneclient/session.py:256 2018-10-16 15:12:10.509 7 DEBUG karbor.services.operationengine.karbor_client 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor [req-1b1ea4c9-5148-4f3c-8a82-380c0a9a3023 - 2496480d09bc4c89acb4cb9ebc0101ce - - -] Run operation(b2e3832d-d3e6-4b2c-93bc-d14bd9779977) failed: AttributeError: 'NoneType' object has no attribute 'replace' 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor Traceback (most recent call last): 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/engine/executors/green_thread_executor.py", line 153, in _run_operation 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor param=param) 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/operation_manager.py", line 57, in run_operation 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor op.run(operation_definition, **kwargs) 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/operations/base.py", line 100, in run 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor self._execute(operation_definition, param) 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/operations/protect_operation.py", line 46, in _execute 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor self._run(operation_definition, param, log_ref) 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/operations/protect_operation.py", line 53, in _run 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor param.get("user_id"), param.get("project_id")) 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/operations/base.py", line 199, in _create_karbor_client 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor karbor_url = self.karbor_endpoint % {"project_id": project_id} 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/operations/base.py", line 64, in karbor_endpoint 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor self._karbor_endpoint = karbor_client.get_karbor_endpoint() 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/karbor_client.py", line 37, in get_karbor_endpoint 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor return url.replace("$(", "%(") 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor AttributeError: 'NoneType' object has no attribute 'replace' 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor In karbor-operationengine.log I got an error because operation engine is not able to get the Karbor endpoint from Keystone catalog. url.replace("$(", "%(") failed because url is equal to None. This prevents me to use the trigger/scheduler. ==> /var/lib/docker/volumes/kolla_logs/_data/karbor/karbor-operationengine.log <== 2018-10-16 15:12:10.051 7 DEBUG keystoneclient.session [req-1b1ea4c9-5148-4f3c-8a82-380c0a9a3023 - 2496480d09bc4c89acb4cb9ebc0101ce - - -] REQ: curl -g -i -X GET http://10.131.2.200:5000 -H "Accept: application/json" -H "User-Agent: python-keystoneclient" _http_log_request /var/lib/kolla/venv/local/lib/python2.7/site-packages/keystoneclient/session.py:216 2018-10-16 15:12:10.057 7 DEBUG keystoneclient.session [req-1b1ea4c9-5148-4f3c-8a82-380c0a9a3023 - 2496480d09bc4c89acb4cb9ebc0101ce - - -] RESP: [300] Date: Tue, 16 Oct 2018 15:12:10 GMT Server: Apache/2.4.18 (Ubuntu) Vary: X-Auth-Token Content-Length: 598 Content-Type: application/json RESP BODY: {"versions": {"values": [{"status": "stable", "updated": "2017-02-22T00:00:00Z", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v3+json"}], "id": "v3.8", "links": [{"href": "http://10.131.2.200:5000/v3/", "rel": "self"}]}, {"status": "deprecated", "updated": "2016-08-04T00:00:00Z", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v2.0+json"}], "id": "v2.0", "links": [{"href": "http://10.131.2.200:5000/v2.0/", "rel": "self"}, {"href": "https://docs.openstack.org/", "type": "text/html", "rel": "describedby"}]}]}}  _http_log_response /var/lib/kolla/venv/local/lib/python2.7/site-packages/keystoneclient/session.py:256 2018-10-16 15:12:10.509 7 DEBUG karbor.services.operationengine.karbor_client 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor [req-1b1ea4c9-5148-4f3c-8a82-380c0a9a3023 - 2496480d09bc4c89acb4cb9ebc0101ce - - -] Run operation(b2e3832d-d3e6-4b2c-93bc-d14bd9779977) failed: AttributeError: 'NoneType' object has no attribute 'replace' 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor Traceback (most recent call last): 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/engine/executors/green_thread_executor.py", line 153, in _run_operation 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor param=param) 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/operation_manager.py", line 57, in run_operation 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor op.run(operation_definition, **kwargs) 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/operations/base.py", line 100, in run 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor self._execute(operation_definition, param) 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/operations/protect_operation.py", line 46, in _execute 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor self._run(operation_definition, param, log_ref) 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/operations/protect_operation.py", line 53, in _run 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor param.get("user_id"), param.get("project_id")) 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/operations/base.py", line 199, in _create_karbor_client 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor karbor_url = self.karbor_endpoint % {"project_id": project_id} 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/operations/base.py", line 64, in karbor_endpoint 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor self._karbor_endpoint = karbor_client.get_karbor_endpoint() 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/karbor_client.py", line 37, in get_karbor_endpoint 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor return url.replace("$(", "%(") 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor AttributeError: 'NoneType' object has no attribute 'replace' 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor
2018-10-16 16:39:29 Gaëtan Trellu description In karbor-operationengine.log I got an error because operation engine is not able to get the Karbor endpoint from Keystone catalog. url.replace("$(", "%(") failed because url is equal to None. This prevents me to use the trigger/scheduler. ==> /var/lib/docker/volumes/kolla_logs/_data/karbor/karbor-operationengine.log <== 2018-10-16 15:12:10.051 7 DEBUG keystoneclient.session [req-1b1ea4c9-5148-4f3c-8a82-380c0a9a3023 - 2496480d09bc4c89acb4cb9ebc0101ce - - -] REQ: curl -g -i -X GET http://10.131.2.200:5000 -H "Accept: application/json" -H "User-Agent: python-keystoneclient" _http_log_request /var/lib/kolla/venv/local/lib/python2.7/site-packages/keystoneclient/session.py:216 2018-10-16 15:12:10.057 7 DEBUG keystoneclient.session [req-1b1ea4c9-5148-4f3c-8a82-380c0a9a3023 - 2496480d09bc4c89acb4cb9ebc0101ce - - -] RESP: [300] Date: Tue, 16 Oct 2018 15:12:10 GMT Server: Apache/2.4.18 (Ubuntu) Vary: X-Auth-Token Content-Length: 598 Content-Type: application/json RESP BODY: {"versions": {"values": [{"status": "stable", "updated": "2017-02-22T00:00:00Z", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v3+json"}], "id": "v3.8", "links": [{"href": "http://10.131.2.200:5000/v3/", "rel": "self"}]}, {"status": "deprecated", "updated": "2016-08-04T00:00:00Z", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v2.0+json"}], "id": "v2.0", "links": [{"href": "http://10.131.2.200:5000/v2.0/", "rel": "self"}, {"href": "https://docs.openstack.org/", "type": "text/html", "rel": "describedby"}]}]}}  _http_log_response /var/lib/kolla/venv/local/lib/python2.7/site-packages/keystoneclient/session.py:256 2018-10-16 15:12:10.509 7 DEBUG karbor.services.operationengine.karbor_client 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor [req-1b1ea4c9-5148-4f3c-8a82-380c0a9a3023 - 2496480d09bc4c89acb4cb9ebc0101ce - - -] Run operation(b2e3832d-d3e6-4b2c-93bc-d14bd9779977) failed: AttributeError: 'NoneType' object has no attribute 'replace' 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor Traceback (most recent call last): 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/engine/executors/green_thread_executor.py", line 153, in _run_operation 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor param=param) 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/operation_manager.py", line 57, in run_operation 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor op.run(operation_definition, **kwargs) 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/operations/base.py", line 100, in run 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor self._execute(operation_definition, param) 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/operations/protect_operation.py", line 46, in _execute 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor self._run(operation_definition, param, log_ref) 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/operations/protect_operation.py", line 53, in _run 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor param.get("user_id"), param.get("project_id")) 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/operations/base.py", line 199, in _create_karbor_client 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor karbor_url = self.karbor_endpoint % {"project_id": project_id} 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/operations/base.py", line 64, in karbor_endpoint 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor self._karbor_endpoint = karbor_client.get_karbor_endpoint() 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/karbor_client.py", line 37, in get_karbor_endpoint 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor return url.replace("$(", "%(") 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor AttributeError: 'NoneType' object has no attribute 'replace' 2018-10-16 15:12:10.510 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor In karbor-operationengine.log I got an error because operation engine is not able to get the Karbor endpoint from Keystone catalog. url.replace("$(", "%(") failed because url is equal to None. This prevents me to use the trigger/scheduler. ==> /var/lib/docker/volumes/kolla_logs/_data/karbor/karbor-operationengine.log <== 2018-10-16 16:37:51.614 7 DEBUG karbor.services.operationengine.engine.triggers.timetrigger.time_trigger_multi_node [req-8aeb35b8-4a7b-4752-ad3d-f523932981bc - - - - -] Time trigger (1e8220f3-ba26-4071-ace4-1d909492de57) is due _loop /var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/engine/triggers/timetrigger/time_trigger_multi_node.py:101 2018-10-16 16:37:51.615 7 DEBUG karbor.services.operationengine.engine.triggers.timetrigger.time_trigger_multi_node [req-8aeb35b8-4a7b-4752-ad3d-f523932981bc - - - - -] Rescheduling (1e8220f3-ba26-4071-ace4-1d909492de57) from 2018-10-16 16:37:49 to 2018-10-16 16:42:49 _loop /var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/engine/triggers/timetrigger/time_trigger_multi_node.py:118 2018-10-16 16:37:52.112 7 DEBUG karbor.db.sqlalchemy.api [req-d380a92f-9a58-4be4-9f80-85309f72fdcc - - - - -] Updated trigger execution (0900292d-ac6f-4500-bc4a-849c7b290335) from 2018-10-16 16:37:49 to 2018-10-16 16:42:49 trigger_execution_update /var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/db/sqlalchemy/api.py:502 2018-10-16 16:37:52.605 7 DEBUG karbor.services.operationengine.engine.triggers.timetrigger.time_trigger_multi_node [req-b8a7338a-ed1d-4631-9b3b-e3803dd1e119 - - - - -] Time trigger not yet due _loop /var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/engine/triggers/timetrigger/time_trigger_multi_node.py:88 2018-10-16 16:37:53.389 7 DEBUG keystoneclient.session [req-e4d90796-533f-4a1c-b63e-a587b7f0ab8f - 2496480d09bc4c89acb4cb9ebc0101ce - - -] REQ: curl -g -i -X GET http://10.131.2.200:5000 -H "Accept: application/json" -H "User-Agent: python-keystoneclient" _http_log_request /var/lib/kolla/venv/local/lib/python2.7/site-packages/keystoneclient/session.py:216 2018-10-16 16:37:53.395 7 DEBUG keystoneclient.session [req-e4d90796-533f-4a1c-b63e-a587b7f0ab8f - 2496480d09bc4c89acb4cb9ebc0101ce - - -] RESP: [300] Date: Tue, 16 Oct 2018 16:37:53 GMT Server: Apache/2.4.18 (Ubuntu) Vary: X-Auth-Token Content-Length: 598 Content-Type: application/json RESP BODY: {"versions": {"values": [{"status": "stable", "updated": "2017-02-22T00:00:00Z", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v3+json"}], "id": "v3.8", "links": [{"href": "http://10.131.2.200:5000/v3/", "rel": "self"}]}, {"status": "deprecated", "updated": "2016-08-04T00:00:00Z", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v2.0+json"}], "id": "v2.0", "links": [{"href": "http://10.131.2.200:5000/v2.0/", "rel": "self"}, {"href": "https://docs.openstack.org/", "type": "text/html", "rel": "describedby"}]}]}} _http_log_response /var/lib/kolla/venv/local/lib/python2.7/site-packages/keystoneclient/session.py:256 2018-10-16 16:37:53.782 7 DEBUG karbor.services.operationengine.karbor_client [req-e4d90796-533f-4a1c-b63e-a587b7f0ab8f - 2496480d09bc4c89acb4cb9ebc0101ce - - -] MSG010 None. get_karbor_endpoint /var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/karbor_client.py:36 2018-10-16 16:37:53.784 7 DEBUG karbor.services.operationengine.karbor_client [req-e4d90796-533f-4a1c-b63e-a587b7f0ab8f - 2496480d09bc4c89acb4cb9ebc0101ce - - -] MSG011 <karbor.common.karbor_keystone_plugin.KarborKeystonePlugin object at 0x7f7bc9445650>. get_karbor_endpoint /var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/karbor_client.py:37 2018-10-16 16:37:53.784 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor [req-e4d90796-533f-4a1c-b63e-a587b7f0ab8f - 2496480d09bc4c89acb4cb9ebc0101ce - - -] Run operation(7220b09b-3e8d-43bc-886a-59c2d1c81be7) failed: AttributeError: 'NoneType' object has no attribute 'replace' 2018-10-16 16:37:53.784 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor Traceback (most recent call last): 2018-10-16 16:37:53.784 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/engine/executors/green_thread_executor.py", line 153, in _run_operation 2018-10-16 16:37:53.784 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor param=param) 2018-10-16 16:37:53.784 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/operation_manager.py", line 57, in run_operation 2018-10-16 16:37:53.784 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor op.run(operation_definition, **kwargs) 2018-10-16 16:37:53.784 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/operations/base.py", line 100, in run 2018-10-16 16:37:53.784 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor self._execute(operation_definition, param) 2018-10-16 16:37:53.784 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/operations/protect_operation.py", line 46, in _execute 2018-10-16 16:37:53.784 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor self._run(operation_definition, param, log_ref) 2018-10-16 16:37:53.784 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/operations/protect_operation.py", line 53, in _run 2018-10-16 16:37:53.784 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor param.get("user_id"), param.get("project_id")) 2018-10-16 16:37:53.784 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/operations/base.py", line 199, in _create_karbor_client 2018-10-16 16:37:53.784 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor karbor_url = self.karbor_endpoint % {"project_id": project_id} 2018-10-16 16:37:53.784 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/operations/base.py", line 64, in karbor_endpoint 2018-10-16 16:37:53.784 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor self._karbor_endpoint = karbor_client.get_karbor_endpoint() 2018-10-16 16:37:53.784 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/karbor/services/operationengine/karbor_client.py", line 38, in get_karbor_endpoint 2018-10-16 16:37:53.784 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor return url.replace("$(", "%(") 2018-10-16 16:37:53.784 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor AttributeError: 'NoneType' object has no attribute 'replace' 2018-10-16 16:37:53.784 7 ERROR karbor.services.operationengine.engine.executors.green_thread_executor