PXE deploy failed with nova.virt.baremetal

[Giulio Fidente]

Booting the undercloud instance seems to fail sometimes in CI due to nova.virt.baremetal being unable do PXE boot the instance.

Logs from a failure: http://logs.openstack.org/59/105959/1/check-tripleo/check-tripleo-undercloud-precise/e60ba5f/logs/seed_logs/nova-compute.txt.gz

The following appears in seed's nova-compute log:
2014-07-10 04:44:16.775 4384 ERROR nova.virt.baremetal.driver [req-e9c3f034-526f-4b5c-8120-ac49a5d73589 None] Error deploying instance 6935bfb7-7d04-4a69-bcb8-15cfe0442653 on baremetal node 15ca8d36-c0e2-46d3-86e6-1fe09d7c2b7c.
2014-07-10 04:44:23.817 4384 ERROR nova.compute.manager [req-e9c3f034-526f-4b5c-8120-ac49a5d73589 None] [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] Instance failed to spawn
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] Traceback (most recent call last):
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py", line 2076, in _build_resources
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] yield resources
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py", line 1970, in _build_and_run_instance
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] block_device_info=block_device_info)
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/virt/baremetal/driver.py", line 249, in spawn
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] block_device_info=block_device_info)
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/virt/baremetal/driver.py", line 307, in _spawn
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] _update_state(context, node, None, baremetal_states.DELETED)
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 82, in __exit__
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] six.reraise(self.type_, self.value, self.tb)
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/virt/baremetal/driver.py", line 285, in _spawn
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] self.driver.activate_node(context, node, instance)
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/virt/baremetal/pxe.py", line 500, in activate_node
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] locals['error'] % instance['uuid'])
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] InstanceDeployFailure: PXE deploy failed for instance 6935bfb7-7d04-4a69-bcb8-15cfe0442653

[Marios Andreou (marios-b)]

not 100% sure this is related, but in my recent Devstack/Ironic runs, I've had to revert a nova commit to get pxe boot completing (thanks lucasagomes and dtantsur): "https://review.openstack.org/#/c/71557/33 that's the commit that broke us" - this is:

git checkout bf02f134d711a040b117788009843e7edc9f3040 (the review just before it)

[Ben Nemec (bnemec)]

I'm going to mark this as fixed by the fact that nova baremetal no longer exists. Feel free to reopen if it turns out this is still a problem with Ironic.