Error launching new instance in
Error: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. <class 'oslo_messaging.exceptions.MessagingTimeout'> (HTTP 500) (Request-ID: req-6831fe1e-3236-4a30-9bd4-1b8a923dcc5b)
reply to message ID 0e988d6a55e74a1c9c8c3522d7b8b428\n']
2016-07-26 13:39:23.516 12910 INFO oslo_messaging._drivers.amqpdriver [-] No calling threads waiting for msg_id : 71be54c972444d4cacdd6834f3be97c1
2016-07-26 13:39:23.517 12910 INFO oslo_messaging._drivers.amqpdriver [-] No calling threads waiting for msg_id : fe31b3fcac8e4beea70e43ba676eaedb
2016-07-26 13:39:23.519 12911 INFO oslo_messaging._drivers.amqpdriver [-] No calling threads waiting for msg_id : 2fdc3b9accd94c64b6dc09dda7405707
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher [req-e30b0bb2-4942-460e-96fc-86ba05f5be4c - - - - -] Exception during message handling: Timed out waiting for a reply to message ID dd70d3ed54d44cb68014e489293335b1
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher Traceback (most recent call last):
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 142, in _dispatch_and_reply
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher executor_callback))
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 186, in _dispatch
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher executor_callback)
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 124, in _do_dispatch
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher new_args[argname] = self.serializer.deserialize_entity(ctxt, arg)
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/rpc.py", line 111, in deserialize_entity
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher return self._base.deserialize_entity(context, entity)
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/objects/base.py", line 322, in deserialize_entity
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher entity = self._process_object(context, entity)
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/objects/base.py", line 284, in _process_object
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher context, objprim, version_manifest)
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/conductor/api.py", line 77, in object_backport_versions
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher object_versions)
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/conductor/rpcapi.py", line 247, in object_backport_versions
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher object_versions=object_versions)
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/client.py", line 158, in call
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher retry=self.retry)
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 90, in _send
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher timeout=timeout, retry=retry)
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 431, in send
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher retry=retry)
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 420, in _send
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher result = self._waiter.wait(msg_id, timeout)
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 318, in wait
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher message = self.waiters.get(msg_id, timeout=timeout)
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 223, in get
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher 'to message ID %s' % msg_id)
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher MessagingTimeout: Timed out waiting for a reply to message ID dd70d3ed54d44cb68014e489293335b1
2016-07-26 13:39:23.519 12909 ERROR oslo_messaging.rpc.dispatcher
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher [req-e30b0bb2-4942-460e-96fc-86ba05f5be4c - - - - -] Exception during message handling: Timed out waiting for a reply to message ID 5e8d0ccd2fb84b0f82fb2987bb72befa
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher Traceback (most recent call last):
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 142, in _dispatch_and_reply
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher executor_callback))
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 186, in _dispatch
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher executor_callback)
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 124, in _do_dispatch
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher new_args[argname] = self.serializer.deserialize_entity(ctxt, arg)
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/rpc.py", line 111, in deserialize_entity
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher return self._base.deserialize_entity(context, entity)
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/objects/base.py", line 322, in deserialize_entity
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher entity = self._process_object(context, entity)
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/objects/base.py", line 284, in _process_object
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher context, objprim, version_manifest)
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/conductor/api.py", line 77, in object_backport_versions
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher object_versions)
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/conductor/rpcapi.py", line 247, in object_backport_versions
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher object_versions=object_versions)
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/client.py", line 158, in call
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher retry=self.retry)
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 90, in _send
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher timeout=timeout, retry=retry)
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 431, in send
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher retry=retry)
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 420, in _send
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher result = self._waiter.wait(msg_id, timeout)
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 318, in wait
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher message = self.waiters.get(msg_id, timeout=timeout)
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 223, in get
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher 'to message ID %s' % msg_id)
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher MessagingTimeout: Timed out waiting for a reply to message ID 5e8d0ccd2fb84b0f82fb2987bb72befa
2016-07-26 13:39:23.519 12910 ERROR oslo_messaging.rpc.dispatcher
2016-07-26 13:39:23.520 12909 ERROR oslo_messaging._drivers.common [req-e30b0bb2-4942-460e-96fc-86ba05f5be4c - - - - -] Returning exception Timed out waiting for a reply to message ID dd70d3ed54d44cb68014e489293335b1 to caller
2016-07-26 13:39:23.520 12909 ERROR oslo_messaging._drivers.common [req-e30b0bb2-4942-460e-96fc-86ba05f5be4c - - - - -] ['Traceback (most recent call last):\n', ' File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 142, in _dispatch_and_reply\n executor_callback))\n', ' File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 186, in _dispatch\n executor_callback)\n', ' File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 124, in _do_dispatch\n new_args[argname] = self.serializer.deserialize_entity(ctxt, arg)\n', ' File "/usr/lib/python2.7/site-packages/nova/rpc.py", line 111, in deserialize_entity\n return self._base.deserialize_entity(context, entity)\n', ' File "/usr/lib/python2.7/site-packages/nova/objects/base.py", line 322, in deserialize_entity\n entity = self._process_object(context, entity)\n', ' File "/usr/lib/python2.7/site-packages/nova/objects/base.py", line 284, in _process_object\n context, objprim, version_manifest)\n', ' File "/usr/lib/python2.7/site-packages/nova/conductor/api.py", line 77, in object_backport_versions\n object_versions)\n', ' File "/usr/lib/python2.7/site-packages/nova/conductor/rpcapi.py", line 247, in object_backport_versions\n object_versions=object_versions)\n', ' File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/client.py", line 158, in call\n retry=self.retry)\n', ' File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 90, in _send\n timeout=timeout, retry=retry)\n', ' File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 431, in send\n retry=retry)\n', ' File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 420, in _send\n result = self._waiter.wait(msg_id, timeout)\n', ' File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 318, in wait\n message = self.waiters.get(msg_id, timeout=timeout)\n', ' File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 223, in get\n \'to message ID %s\' % msg_id)\n', 'MessagingTimeout: Timed out waiting for a reply to message ID dd70d3ed54d44cb68014e489293335b1\n']
Do you maybe have a compute-node in your setup which is *newer* than the Liberty release? nova.conf" file.
Please also attach the nova-conductor log and your "/etc/nova/