Ironic

nova.virt.ironic tries to remove vif_port_id unnecessarily

Bug #1311401 reported by aeva black on 2014-04-23

This bug affects 2 people

Affects		Status	Importance	Assigned to	Milestone
	Ironic	Won't Fix	Low	Unassigned
	OpenStack Compute (nova)	Fix Released	Low	Unassigned

Bug Description

While spawning an instance, Ironic nova driver logs the following warning every time:

2014-04-22 17:23:21.967 15379 WARNING wsme.api [-] Client-side error: Couldn't apply patch '[{'path': '/extra/vif_port_id', 'op': 'remove'}]'. Reason: u'vif_port_id'

See original description

Tags:

aeva black (tenbrae) on 2014-04-23

Changed in ironic:
status:	New → Triaged
importance:	Undecided → Low
tags:	added: low-hanging-fruit

Talusani Mani Shanker (shanker-mani0) on 2014-04-29

Changed in ironic:
assignee:	nobody → Talusani Mani Shanker (shanker-mani0)

Revision history for this message

Talusani Mani Shanker (shanker-mani0) wrote on 2014-04-29:

I would like to work on this bug. How can i reproduce this bug and fix it ?

Thanks
Manishanker

Revision history for this message

Robert Collins (lifeless) wrote on 2014-05-15:

This cause deploy failures when it occurs - for no good reason breaking the deployment.

Changed in ironic:
importance:	Low → High

Revision history for this message

Robert Collins (lifeless) wrote on 2014-05-15:

Download full text (6.6 KiB)

2014-05-14 23:16:04.130 11301 ERROR nova.compute.manager [req-0a67d139-3760-47d8-861f-97bd7f4ed038 1c34f9f8c3cb49b9ae0267709f67cf53 0a50fb3027684c07a5447675be49b6e5] [instance: 63ae6e42-1b80-4303-abc7-421bf1210876] Error: Failed to provision instance 63ae6e42-1b80-4303-abc7-421bf1210876: PXE driver failed to continue deployment.
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876] Traceback (most recent call last):
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876] File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py", line 1309, in _build_instance
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876] set_access_ip=set_access_ip)
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876] File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py", line 399, in decorated_function
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876] return function(self, context, *args, **kwargs)
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876] File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py", line 1721, in _spawn
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876] LOG.exception(_('Instance failed to spawn'), instance=instance)
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876] File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876] six.reraise(self.type_, self.value, self.tb)
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876] File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py", line 1718, in _spawn
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876] block_device_info)
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876] File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/ironic/nova/virt/ironic/driver.py", line 503, in spawn
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876] timer.start(interval=10).wait()
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876] File "/usr/lib/python2.7/dist-packages/eventlet/event.py", line 116, in wait
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876] return hubs.get_hub().switch()
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876] File "/usr/lib/python2.7/dist-packages/eventlet/hubs/hub....

2014-05-14 23:16:04.130 11301 ERROR nova.compute.manager [req-0a67d139-3760-47d8-861f-97bd7f4ed038 1c34f9f8c3cb49b9ae0267709f67cf53 0a50fb3027684c07a5447675be49b6e5] [instance: 63ae6e42-1b80-4303-abc7-421bf1210876] Error: Failed to provision instance 63ae6e42-1b80-4303-abc7-421bf1210876: PXE driver failed to continue deployment.
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876] Traceback (most recent call last):
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876]   File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py", line 1309, in _build_instance
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876]     set_access_ip=set_access_ip)
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876]   File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py", line 399, in decorated_function
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876]     return function(self, context, *args, **kwargs)
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876]   File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py", line 1721, in _spawn
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876]     LOG.exception(_('Instance failed to spawn'), instance=instance)
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876]   File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876]     six.reraise(self.type_, self.value, self.tb)
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876]   File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py", line 1718, in _spawn
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876]     block_device_info)
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876]   File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/ironic/nova/virt/ironic/driver.py", line 503, in spawn
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876]     timer.start(interval=10).wait()
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876]   File "/usr/lib/python2.7/dist-packages/eventlet/event.py", line 116, in wait
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876]     return hubs.get_hub().switch()
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876]   File "/usr/lib/python2.7/dist-packages/eventlet/hubs/hub.py", line 187, in switch
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876]     return self.greenlet.switch()
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876]   File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py", line 78, in _inner
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876]     self.f(*self.args, **self.kw)
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876]   File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/ironic/nova/virt/ironic/driver.py", line 499, in _wait_for_active
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876]     raise exception.InstanceDeployFailure(msg)
2014-05-14 23:16:04.130 11301 TRACE nova.compute.manager [instance: 63ae6e42-1b80-4303-abc7-421bf1210876] InstanceDeployFailure: Failed to provision instance 63ae6e42-1b80-4303-abc7-421bf1210876: PXE driver failed to continue deployment.

2014-05-14 23:16:07.437 11301 WARNING ironicclient.common.http [-] Request returned failure status.
2014-05-14 23:16:07.437 11301 ERROR nova.openstack.common.loopingcall [-] in fixed duration looping call
2014-05-14 23:16:07.437 11301 TRACE nova.openstack.common.loopingcall Traceback (most recent call last):
2014-05-14 23:16:07.437 11301 TRACE nova.openstack.common.loopingcall   File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py", line 78, in _inner
2014-05-14 23:16:07.437 11301 TRACE nova.openstack.common.loopingcall     self.f(*self.args, **self.kw)
2014-05-14 23:16:07.437 11301 TRACE nova.openstack.common.loopingcall   File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/ironic/nova/virt/ironic/driver.py", line 169, in _request_api
2014-05-14 23:16:07.437 11301 TRACE nova.openstack.common.loopingcall     func(*args)
2014-05-14 23:16:07.437 11301 TRACE nova.openstack.common.loopingcall   File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/ironicclient/v1/port.py", line 57, in update
2014-05-14 23:16:07.437 11301 TRACE nova.openstack.common.loopingcall     return self._update(self._path(port_id), patch)
2014-05-14 23:16:07.437 11301 TRACE nova.openstack.common.loopingcall   File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/ironicclient/common/base.py", line 68, in _update
2014-05-14 23:16:07.437 11301 TRACE nova.openstack.common.loopingcall     resp, body = self.api.json_request(method, url, body=body)
2014-05-14 23:16:07.437 11301 TRACE nova.openstack.common.loopingcall   File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/ironicclient/common/http.py", line 186, in json_request
2014-05-14 23:16:07.437 11301 TRACE nova.openstack.common.loopingcall     resp, body_iter = self._http_request(url, method, **kwargs)
2014-05-14 23:16:07.437 11301 TRACE nova.openstack.common.loopingcall   File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/ironicclient/common/http.py", line 169, in _http_request
2014-05-14 23:16:07.437 11301 TRACE nova.openstack.common.loopingcall     error_json.get('debuginfo'))
2014-05-14 23:16:07.437 11301 TRACE nova.openstack.common.loopingcall HTTPBadRequest: Couldn't apply patch '[{'path': '/extra/vif_port_id', 'op': 'remove'}]'. Reason: u'vif_port_id'
2014-05-14 23:16:07.437 11301 TRACE nova.openstack.common.loopingcall

Revision history for this message

Dmitry Tantsur (divius) wrote on 2014-06-04:

Hi! Per global bugs clean-up, we're unassigning bugs that are without patch and other visible progress for more than 7 days. Please feel free to reassign yourself, set status to In Progress and leave some status comment, if this is wrong. Thank you for understanding!

Revision history for this message

Dmitry Tantsur (divius) wrote on 2014-06-04:

Robert, judging by source code, error you mention is not catched and should no longer break deploy, so I'm setting it back to Low.

Changed in ironic:
assignee:	Talusani Mani Shanker (shanker-mani0) → nobody
importance:	High → Low

Dmitry Tantsur (divius) on 2014-06-05

tags:

added: driver

aeva black (tenbrae) on 2014-06-09

tags:

added: nova-driver
removed: driver

Dmitry Tantsur (divius) on 2014-09-11

tags:	added: ironic
Changed in ironic:
status:	Triaged → Invalid

Sean Dague (sdague) on 2014-09-11

Changed in nova:
status:	New → Confirmed
importance:	Undecided → Low

James Polley (tchaypo) on 2014-09-18

Changed in ironic:
status:	Invalid → Confirmed

Revision history for this message

Dmitry Tantsur (divius) wrote on 2014-09-19:

Hi James, could you provide some reasoning for reopening it against Ironic. Driver is not in our code base, but if you think something is required from our side, please state it (and possibly update the description).