magnum-api version:4.1.0
magnum-conductor version:4.1.0
image:fedora-atomic-latest.qcow2
Magnum cluster create kube_masters stuck in progress
So I login in to kube_masters and use journalctl -xe command to check,
got some error messsage: Failed to start Etcd Server.
My kube_masters can access to internet.
And then,I check magnum-conductor log , got error message:
2017-06-13 05:29:18.999 2797 ERROR magnum.common.keystone [req-a069610f-fd8f-4156-a49c-295729f63e67 - - - - -] Keystone API connection failed: no password, trust_id or token found.
2017-06-13 05:29:19.000 2797 ERROR magnum.common.exception [req-a069610f-fd8f-4156-a49c-295729f63e67 - - - - -] Exception in string format operation, kwargs: {'code': 500}
2017-06-13 05:29:19.000 2797 ERROR magnum.common.exception Traceback (most recent call last):
2017-06-13 05:29:19.000 2797 ERROR magnum.common.exception File "/usr/lib/python2.7/dist-packages/magnum/common/exception.py", line 92, in __init__
2017-06-13 05:29:19.000 2797 ERROR magnum.common.exception self.message = self.message % kwargs
2017-06-13 05:29:19.000 2797 ERROR magnum.common.exception KeyError: u'client'
2017-06-13 05:29:19.000 2797 ERROR magnum.common.exception
2017-06-13 05:29:19.000 2797 ERROR oslo.service.loopingcall [req-a069610f-fd8f-4156-a49c-295729f63e67 - - - - -] Fixed interval looping call 'magnum.service.periodic.ClusterUpdateJob.update_status' failed
2017-06-13 05:29:19.000 2797 ERROR oslo.service.loopingcall Traceback (most recent call last):
2017-06-13 05:29:19.000 2797 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/oslo_service/loopingcall.py", line 137, in _run_loop
2017-06-13 05:29:19.000 2797 ERROR oslo.service.loopingcall result = func(*self.args, **self.kw)
2017-06-13 05:29:19.000 2797 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/magnum/service/periodic.py", line 71, in update_status
2017-06-13 05:29:19.000 2797 ERROR oslo.service.loopingcall cdriver.update_cluster_status(self.ctx, self.cluster)
2017-06-13 05:29:19.000 2797 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/magnum/drivers/heat/driver.py", line 80, in update_cluster_status
2017-06-13 05:29:19.000 2797 ERROR oslo.service.loopingcall poller.poll_and_check()
2017-06-13 05:29:19.000 2797 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/magnum/drivers/heat/driver.py", line 169, in poll_and_check
2017-06-13 05:29:19.000 2797 ERROR oslo.service.loopingcall stack = self.openstack_client.heat().stacks.get(
2017-06-13 05:29:19.000 2797 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/magnum/common/exception.py", line 59, in wrapped
2017-06-13 05:29:19.000 2797 ERROR oslo.service.loopingcall return func(*args, **kw)
2017-06-13 05:29:19.000 2797 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/magnum/common/clients.py", line 94, in heat
2017-06-13 05:29:19.000 2797 ERROR oslo.service.loopingcall region_name=region_name)
2017-06-13 05:29:19.000 2797 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/magnum/common/clients.py", line 45, in url_for
2017-06-13 05:29:19.000 2797 ERROR oslo.service.loopingcall return self.keystone().session.get_endpoint(**kwargs)
2017-06-13 05:29:19.000 2797 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/magnum/common/keystone.py", line 59, in session
2017-06-13 05:29:19.000 2797 ERROR oslo.service.loopingcall auth = self._get_auth()
2017-06-13 05:29:19.000 2797 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/magnum/common/keystone.py", line 98, in _get_auth
2017-06-13 05:29:19.000 2797 ERROR oslo.service.loopingcall raise exception.AuthorizationFailure()
2017-06-13 05:29:19.000 2797 ERROR oslo.service.loopingcall AuthorizationFailure: %(client)s connection failed. %(message)s
2017-06-13 05:29:19.000 2797 ERROR oslo.service.loopingcall
2017-06-13 06:29:30.859 2797 ERROR magnum.drivers.heat.driver [req-4e9abffe-c7aa-48e4-8157-133be23e1063 - - - - -] Cluster error, stack status: CREATE_FAILED, stack_id: 5367ac4f-df5b-45c6-a042-11b3faecbfce, reason: Timed out
2017-06-13 22:24:11.894 2797 INFO magnum.drivers.heat.driver [req-c85f25a6-b195-4a32-96ec-310ce88684d1 - - - - -] Cluster has been deleted, stack_id: 5367ac4f-df5b-45c6-a042-11b3faecbfce
2017-06-13 22:39:49.120 2797 ERROR magnum.common.keystone [req-1182beae-1e64-44e9-ac9f-7eb53695b960 - - - - -] Keystone API connection failed: no password, trust_id or token found.
2017-06-13 22:39:49.121 2797 ERROR magnum.common.exception [req-1182beae-1e64-44e9-ac9f-7eb53695b960 - - - - -] Exception in string format operation, kwargs: {'code': 500}
2017-06-13 22:39:49.121 2797 ERROR magnum.common.exception Traceback (most recent call last):
2017-06-13 22:39:49.121 2797 ERROR magnum.common.exception File "/usr/lib/python2.7/dist-packages/magnum/common/exception.py", line 92, in __init__
2017-06-13 22:39:49.121 2797 ERROR magnum.common.exception self.message = self.message % kwargs
2017-06-13 22:39:49.121 2797 ERROR magnum.common.exception KeyError: u'client'
2017-06-13 22:39:49.121 2797 ERROR magnum.common.exception
2017-06-13 22:39:49.121 2797 ERROR oslo.service.loopingcall [req-1182beae-1e64-44e9-ac9f-7eb53695b960 - - - - -] Fixed interval looping call 'magnum.service.periodic.ClusterUpdateJob.update_status' failed
2017-06-13 22:39:49.121 2797 ERROR oslo.service.loopingcall Traceback (most recent call last):
2017-06-13 22:39:49.121 2797 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/oslo_service/loopingcall.py", line 137, in _run_loop
2017-06-13 22:39:49.121 2797 ERROR oslo.service.loopingcall result = func(*self.args, **self.kw)
2017-06-13 22:39:49.121 2797 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/magnum/service/periodic.py", line 71, in update_status
2017-06-13 22:39:49.121 2797 ERROR oslo.service.loopingcall cdriver.update_cluster_status(self.ctx, self.cluster)
2017-06-13 22:39:49.121 2797 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/magnum/drivers/heat/driver.py", line 80, in update_cluster_status
2017-06-13 22:39:49.121 2797 ERROR oslo.service.loopingcall poller.poll_and_check()
2017-06-13 22:39:49.121 2797 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/magnum/drivers/heat/driver.py", line 169, in poll_and_check
2017-06-13 22:39:49.121 2797 ERROR oslo.service.loopingcall stack = self.openstack_client.heat().stacks.get(
2017-06-13 22:39:49.121 2797 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/magnum/common/exception.py", line 59, in wrapped
2017-06-13 22:39:49.121 2797 ERROR oslo.service.loopingcall return func(*args, **kw)
2017-06-13 22:39:49.121 2797 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/magnum/common/clients.py", line 94, in heat
2017-06-13 22:39:49.121 2797 ERROR oslo.service.loopingcall region_name=region_name)
2017-06-13 22:39:49.121 2797 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/magnum/common/clients.py", line 45, in url_for
2017-06-13 22:39:49.121 2797 ERROR oslo.service.loopingcall return self.keystone().session.get_endpoint(**kwargs)
2017-06-13 22:39:49.121 2797 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/magnum/common/keystone.py", line 59, in session
2017-06-13 22:39:49.121 2797 ERROR oslo.service.loopingcall auth = self._get_auth()
2017-06-13 22:39:49.121 2797 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/magnum/common/keystone.py", line 98, in _get_auth
2017-06-13 22:39:49.121 2797 ERROR oslo.service.loopingcall raise exception.AuthorizationFailure()
2017-06-13 22:39:49.121 2797 ERROR oslo.service.loopingcall AuthorizationFailure: %(client)s connection failed. %(message)s
2017-06-13 22:39:49.121 2797 ERROR oslo.service.loopingcall
2017-06-13 23:24:55.213 14591 WARNING oslo_reports.guru_meditation_report [-] Guru meditation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
2017-06-13 23:24:55.214 14591 INFO magnum.cmd.conductor [-] Starting server in PID 14591
2017-06-13 23:24:55.225 14591 WARNING oslo_config.cfg [-] Option "rabbit_host" from group "oslo_messaging_rabbit" is deprecated for removal. Its value may be silently ignored in the future.
2017-06-13 23:24:55.227 14591 WARNING oslo_config.cfg [-] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal. Its value may be silently ignored in the future.
2017-06-13 23:24:55.228 14591 WARNING oslo_config.cfg [-] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal. Its value may be silently ignored in the future.
2017-06-13 23:24:55.247 14591 INFO oslo_messaging.server [-] blocking executor handles only one message at once. threading or eventlet executor is recommended.
2017-06-13 23:39:58.569 14591 ERROR magnum.drivers.heat.driver [req-37918be0-e5e5-498a-b9f9-10b07b16bc4b - - - - -] Cluster error, stack status: CREATE_FAILED, stack_id: 99761269-8ed2-4d57-812d-5a3546d3a9ba, reason: Timed out
