PXE deploy failed with nova.virt.baremetal

Bug #1340087 reported by Giulio Fidente on 2014-07-10
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Medium
Unassigned

Bug Description

Booting the undercloud instance seems to fail sometimes in CI due to nova.virt.baremetal being unable do PXE boot the instance.

Logs from a failure: http://logs.openstack.org/59/105959/1/check-tripleo/check-tripleo-undercloud-precise/e60ba5f/logs/seed_logs/nova-compute.txt.gz

The following appears in seed's nova-compute log:
2014-07-10 04:44:16.775 4384 ERROR nova.virt.baremetal.driver [req-e9c3f034-526f-4b5c-8120-ac49a5d73589 None] Error deploying instance 6935bfb7-7d04-4a69-bcb8-15cfe0442653 on baremetal node 15ca8d36-c0e2-46d3-86e6-1fe09d7c2b7c.
2014-07-10 04:44:23.817 4384 ERROR nova.compute.manager [req-e9c3f034-526f-4b5c-8120-ac49a5d73589 None] [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] Instance failed to spawn
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] Traceback (most recent call last):
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py", line 2076, in _build_resources
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] yield resources
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py", line 1970, in _build_and_run_instance
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] block_device_info=block_device_info)
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/virt/baremetal/driver.py", line 249, in spawn
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] block_device_info=block_device_info)
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/virt/baremetal/driver.py", line 307, in _spawn
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] _update_state(context, node, None, baremetal_states.DELETED)
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 82, in __exit__
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] six.reraise(self.type_, self.value, self.tb)
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/virt/baremetal/driver.py", line 285, in _spawn
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] self.driver.activate_node(context, node, instance)
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/virt/baremetal/pxe.py", line 500, in activate_node
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] locals['error'] % instance['uuid'])
2014-07-10 04:44:23.817 4384 TRACE nova.compute.manager [instance: 6935bfb7-7d04-4a69-bcb8-15cfe0442653] InstanceDeployFailure: PXE deploy failed for instance 6935bfb7-7d04-4a69-bcb8-15cfe0442653

Dan Prince (dan-prince) on 2014-07-25
Changed in tripleo:
status: New → Triaged
importance: Undecided → Medium
Marios Andreou (marios-b) wrote :

not 100% sure this is related, but in my recent Devstack/Ironic runs, I've had to revert a nova commit to get pxe boot completing (thanks lucasagomes and dtantsur): "https://review.openstack.org/#/c/71557/33 that's the commit that broke us" - this is:

git checkout bf02f134d711a040b117788009843e7edc9f3040 (the review just before it)

Ben Nemec (bnemec) wrote :

I'm going to mark this as fixed by the fact that nova baremetal no longer exists. Feel free to reopen if it turns out this is still a problem with Ironic.

Changed in tripleo:
status: Triaged → Fix Released
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers