The bit from the n-cpu log:
2017-02-02 16:30:34.816 DEBUG nova.compute.manager [req-d0b3d3d8-d1d2-43de-8eec-efaa0d75b7e3 admin admin] [instance: 6e971b2d-31ff-4aa2-b737-c5 ece9d37d23] Start spawning the instance on the hypervisor. from (pid=30650) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:192 5 2017-02-02 16:30:34.816 DEBUG nova.virt.ironic.driver [req-d0b3d3d8-d1d2-43de-8eec-efaa0d75b7e3 admin admin] [instance: 6e971b2d-31ff-4aa2-b737 -c5ece9d37d23] Spawn called for instance from (pid=30650) spawn /opt/stack/nova/nova/virt/ironic/driver.py:802 2017-02-02 16:30:34.854 ERROR nova.compute.manager [req-d0b3d3d8-d1d2-43de-8eec-efaa0d75b7e3 admin admin] [instance: 6e971b2d-31ff-4aa2-b737-c5ece9d37d23] Instance failed to spawn 2017-02-02 16:30:34.854 TRACE nova.compute.manager [instance: 6e971b2d-31ff-4aa2-b737-c5ece9d37d23] Traceback (most recent call last): 2017-02-02 16:30:34.854 TRACE nova.compute.manager [instance: 6e971b2d-31ff-4aa2-b737-c5ece9d37d23] File "/opt/stack/nova/nova/compute/manager.py", line 2125, in _build_resources 2017-02-02 16:30:34.854 TRACE nova.compute.manager [instance: 6e971b2d-31ff-4aa2-b737-c5ece9d37d23] yield resources 2017-02-02 16:30:34.854 TRACE nova.compute.manager [instance: 6e971b2d-31ff-4aa2-b737-c5ece9d37d23] File "/opt/stack/nova/nova/compute/manager.py", line 1930, in _build_and_run_instance 2017-02-02 16:30:34.854 TRACE nova.compute.manager [instance: 6e971b2d-31ff-4aa2-b737-c5ece9d37d23] block_device_info=block_device_info) 2017-02-02 16:30:34.854 TRACE nova.compute.manager [instance: 6e971b2d-31ff-4aa2-b737-c5ece9d37d23] File "/opt/stack/nova/nova/virt/ironic/driver.py", line 812, in spawn 2017-02-02 16:30:34.854 TRACE nova.compute.manager [instance: 6e971b2d-31ff-4aa2-b737-c5ece9d37d23] node = self._get_node(node_uuid) 2017-02-02 16:30:34.854 TRACE nova.compute.manager [instance: 6e971b2d-31ff-4aa2-b737-c5ece9d37d23] File "/opt/stack/nova/nova/virt/ironic/driver.py", line 160, in _get_node 2017-02-02 16:30:34.854 TRACE nova.compute.manager [instance: 6e971b2d-31ff-4aa2-b737-c5ece9d37d23] fields=_NODE_FIELDS) 2017-02-02 16:30:34.854 TRACE nova.compute.manager [instance: 6e971b2d-31ff-4aa2-b737-c5ece9d37d23] File "/opt/stack/nova/nova/virt/ironic/client_wrapper.py", line 148, in call 2017-02-02 16:30:34.854 TRACE nova.compute.manager [instance: 6e971b2d-31ff-4aa2-b737-c5ece9d37d23] return self._multi_getattr(client, method)(*args, **kwargs) 2017-02-02 16:30:34.854 TRACE nova.compute.manager [instance: 6e971b2d-31ff-4aa2-b737-c5ece9d37d23] File "/usr/local/lib/python2.7/dist-packages/ironicclient/v1/node.py", line 195, in get 2017-02-02 16:30:34.854 TRACE nova.compute.manager [instance: 6e971b2d-31ff-4aa2-b737-c5ece9d37d23] return self._get(resource_id=node_id, fields=fields) 2017-02-02 16:30:34.854 TRACE nova.compute.manager [instance: 6e971b2d-31ff-4aa2-b737-c5ece9d37d23] File "/usr/local/lib/python2.7/dist-packages/ironicclient/common/base.py", line 88, in _get 2017-02-02 16:30:34.854 TRACE nova.compute.manager [instance: 6e971b2d-31ff-4aa2-b737-c5ece9d37d23] return self._list(self._path(resource_id))[0] 2017-02-02 16:30:34.854 TRACE nova.compute.manager [instance: 6e971b2d-31ff-4aa2-b737-c5ece9d37d23] File "/usr/local/lib/python2.7/dist-packages/ironicclient/common/base.py", line 174, in _list 2017-02-02 16:30:34.854 TRACE nova.compute.manager [instance: 6e971b2d-31ff-4aa2-b737-c5ece9d37d23] resp, body = self.api.json_request('GET', url) 2017-02-02 16:30:34.854 TRACE nova.compute.manager [instance: 6e971b2d-31ff-4aa2-b737-c5ece9d37d23] File "/usr/local/lib/python2.7/dist-packages/ironicclient/common/http.py", line 552, in json_request 2017-02-02 16:30:34.854 TRACE nova.compute.manager [instance: 6e971b2d-31ff-4aa2-b737-c5ece9d37d23] resp = self._http_request(url, method, **kwargs) 2017-02-02 16:30:34.854 TRACE nova.compute.manager [instance: 6e971b2d-31ff-4aa2-b737-c5ece9d37d23] File "/usr/local/lib/python2.7/dist-packages/ironicclient/common/http.py", line 190, in wrapper 2017-02-02 16:30:34.854 TRACE nova.compute.manager [instance: 6e971b2d-31ff-4aa2-b737-c5ece9d37d23] return func(self, url, method, **kwargs) 2017-02-02 16:30:34.854 TRACE nova.compute.manager [instance: 6e971b2d-31ff-4aa2-b737-c5ece9d37d23] File "/usr/local/lib/python2.7/dist-packages/ironicclient/common/http.py", line 534, in _http_request 2017-02-02 16:30:34.854 TRACE nova.compute.manager [instance: 6e971b2d-31ff-4aa2-b737-c5ece9d37d23] error_json.get('debuginfo'), method, url) 2017-02-02 16:30:34.854 TRACE nova.compute.manager [instance: 6e971b2d-31ff-4aa2-b737-c5ece9d37d23] NotFound: Node 6cc8803d-4e77-4948-b653-663d8d5e52b7 could not be found. (HTTP 404) 2017-02-02 16:30:34.854 TRACE nova.compute.manager [instance: 6e971b2d-31ff-4aa2-b737-c5ece9d37d23]
The bit from the n-cpu log:
2017-02-02 16:30:34.816 DEBUG nova.compute. manager [req-d0b3d3d8- d1d2-43de- 8eec-efaa0d75b7 e3 admin admin] [instance: 6e971b2d- 31ff-4aa2- b737-c5 and_run_ instance /opt/stack/ nova/nova/ compute/ manager. py:192 ironic. driver [req-d0b3d3d8- d1d2-43de- 8eec-efaa0d75b7 e3 admin admin] [instance: 6e971b2d- 31ff-4aa2- b737 nova/nova/ virt/ironic/ driver. py:802 manager [req-d0b3d3d8- d1d2-43de- 8eec-efaa0d75b7 e3 admin admin] [instance: 6e971b2d- 31ff-4aa2- b737-c5ece9d37d 23] Instance failed to spawn manager [instance: 6e971b2d- 31ff-4aa2- b737-c5ece9d37d 23] Traceback (most recent call last): manager [instance: 6e971b2d- 31ff-4aa2- b737-c5ece9d37d 23] File "/opt/stack/ nova/nova/ compute/ manager. py", line 2125, in _build_resources manager [instance: 6e971b2d- 31ff-4aa2- b737-c5ece9d37d 23] yield resources manager [instance: 6e971b2d- 31ff-4aa2- b737-c5ece9d37d 23] File "/opt/stack/ nova/nova/ compute/ manager. py", line 1930, in _build_ and_run_ instance manager [instance: 6e971b2d- 31ff-4aa2- b737-c5ece9d37d 23] block_device_ info=block_ device_ info) manager [instance: 6e971b2d- 31ff-4aa2- b737-c5ece9d37d 23] File "/opt/stack/ nova/nova/ virt/ironic/ driver. py", line 812, in spawn manager [instance: 6e971b2d- 31ff-4aa2- b737-c5ece9d37d 23] node = self._get_ node(node_ uuid) manager [instance: 6e971b2d- 31ff-4aa2- b737-c5ece9d37d 23] File "/opt/stack/ nova/nova/ virt/ironic/ driver. py", line 160, in _get_node manager [instance: 6e971b2d- 31ff-4aa2- b737-c5ece9d37d 23] fields= _NODE_FIELDS) manager [instance: 6e971b2d- 31ff-4aa2- b737-c5ece9d37d 23] File "/opt/stack/ nova/nova/ virt/ironic/ client_ wrapper. py", line 148, in call manager [instance: 6e971b2d- 31ff-4aa2- b737-c5ece9d37d 23] return self._multi_ getattr( client, method)(*args, **kwargs) manager [instance: 6e971b2d- 31ff-4aa2- b737-c5ece9d37d 23] File "/usr/local/ lib/python2. 7/dist- packages/ ironicclient/ v1/node. py", line 195, in get manager [instance: 6e971b2d- 31ff-4aa2- b737-c5ece9d37d 23] return self._get( resource_ id=node_ id, fields=fields) manager [instance: 6e971b2d- 31ff-4aa2- b737-c5ece9d37d 23] File "/usr/local/ lib/python2. 7/dist- packages/ ironicclient/ common/ base.py" , line 88, in _get manager [instance: 6e971b2d- 31ff-4aa2- b737-c5ece9d37d 23] return self._list( self._path( resource_ id))[0] manager [instance: 6e971b2d- 31ff-4aa2- b737-c5ece9d37d 23] File "/usr/local/ lib/python2. 7/dist- packages/ ironicclient/ common/ base.py" , line 174, in _list manager [instance: 6e971b2d- 31ff-4aa2- b737-c5ece9d37d 23] resp, body = self.api. json_request( 'GET', url) manager [instance: 6e971b2d- 31ff-4aa2- b737-c5ece9d37d 23] File "/usr/local/ lib/python2. 7/dist- packages/ ironicclient/ common/ http.py" , line 552, in json_request manager [instance: 6e971b2d- 31ff-4aa2- b737-c5ece9d37d 23] resp = self._http_ request( url, method, **kwargs) manager [instance: 6e971b2d- 31ff-4aa2- b737-c5ece9d37d 23] File "/usr/local/ lib/python2. 7/dist- packages/ ironicclient/ common/ http.py" , line 190, in wrapper manager [instance: 6e971b2d- 31ff-4aa2- b737-c5ece9d37d 23] return func(self, url, method, **kwargs) manager [instance: 6e971b2d- 31ff-4aa2- b737-c5ece9d37d 23] File "/usr/local/ lib/python2. 7/dist- packages/ ironicclient/ common/ http.py" , line 534, in _http_request manager [instance: 6e971b2d- 31ff-4aa2- b737-c5ece9d37d 23] error_json. get('debuginfo' ), method, url) manager [instance: 6e971b2d- 31ff-4aa2- b737-c5ece9d37d 23] NotFound: Node 6cc8803d- 4e77-4948- b653-663d8d5e52 b7 could not be found. (HTTP 404) manager [instance: 6e971b2d- 31ff-4aa2- b737-c5ece9d37d 23]
ece9d37d23] Start spawning the instance on the hypervisor. from (pid=30650) _build_
5
2017-02-02 16:30:34.816 DEBUG nova.virt.
-c5ece9d37d23] Spawn called for instance from (pid=30650) spawn /opt/stack/
2017-02-02 16:30:34.854 ERROR nova.compute.
2017-02-02 16:30:34.854 TRACE nova.compute.
2017-02-02 16:30:34.854 TRACE nova.compute.
2017-02-02 16:30:34.854 TRACE nova.compute.
2017-02-02 16:30:34.854 TRACE nova.compute.
2017-02-02 16:30:34.854 TRACE nova.compute.
2017-02-02 16:30:34.854 TRACE nova.compute.
2017-02-02 16:30:34.854 TRACE nova.compute.
2017-02-02 16:30:34.854 TRACE nova.compute.
2017-02-02 16:30:34.854 TRACE nova.compute.
2017-02-02 16:30:34.854 TRACE nova.compute.
2017-02-02 16:30:34.854 TRACE nova.compute.
2017-02-02 16:30:34.854 TRACE nova.compute.
2017-02-02 16:30:34.854 TRACE nova.compute.
2017-02-02 16:30:34.854 TRACE nova.compute.
2017-02-02 16:30:34.854 TRACE nova.compute.
2017-02-02 16:30:34.854 TRACE nova.compute.
2017-02-02 16:30:34.854 TRACE nova.compute.
2017-02-02 16:30:34.854 TRACE nova.compute.
2017-02-02 16:30:34.854 TRACE nova.compute.
2017-02-02 16:30:34.854 TRACE nova.compute.
2017-02-02 16:30:34.854 TRACE nova.compute.
2017-02-02 16:30:34.854 TRACE nova.compute.
2017-02-02 16:30:34.854 TRACE nova.compute.
2017-02-02 16:30:34.854 TRACE nova.compute.
2017-02-02 16:30:34.854 TRACE nova.compute.