unable to delete server that use port from different network

[Bhuvan Arumugam]

nova delete fail to delete the server. The conductor has this traceback.
File "/usr/local/csi/share/csi-nova.venv/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 959, in _nw_info_build_network\n label=network_name,\n', u'result': u'Error', u'request_id': u'req-1b6a86b8-6485-4a3f-b76e-584ce815fd65', u'message': u"local variable 'network_name' referenced before assignment"

Detailed error log:

2013-12-04 19:26:09,103 (nova.openstack.common.rpc.amqp): DEBUG common _safe_log received {u'_msg_id': u'59359af3f88249a2ba9cf14981cc03da', u'_context_quota_class': None, u'_context_request_id': u'req-1b6a86b8-6485-4a3f-b76e-584ce815fd65', u'_context_service_catalog': [], u'_context_auth_token': '<SANITIZED>', u'_context_user_id': u'tempest-admin', u'_reply_q': u'reply_ac6c4ff91f1343628fbbdb615fdf7cd2', u'namespace': None, u'_context_is_admin': True, u'version': u'1.25', u'_context_timestamp': u'2013-12-04T19:26:07.626153', u'_context_user': u'tempest-admin', u'method': u'action_event_finish', u'_context_remote_address': u'17.115.165.169', u'_context_roles': [u'csi-tenant-admin', u'csi-role-admin', u'admin'], u'args': {u'values': {u'instance_uuid': u'a18d9974-1152-461c-bd90-6e54a2d9094b', u'finish_time': u'2013-12-04T19:26:09.094045', u'traceback': u' File "/usr/local/csi/share/csi-nova.venv/lib/python2.6/site-packages/nova/compute/manager.py", line 302, in decorated_function\n function(self, context, *args, **kwargs)\n File "/usr/local/csi/share/csi-nova.venv/lib/python2.6/site-packages/nova/compute/manager.py", line 279, in decorated_function\n e, sys.exc_info())\n File "/usr/local/csi/share/csi-nova.venv/lib/python2.6/site-packages/nova/compute/manager.py", line 266, in decorated_function\n return function(self, context, *args, **kwargs)\n File "/usr/local/csi/share/csi-nova.venv/lib/python2.6/site-packages/nova/compute/manager.py", line 1995, in terminate_instance\n do_terminate_instance(instance, bdms)\n File "/usr/local/csi/share/csi-nova.venv/lib/python2.6/site-packages/nova/openstack/common/lockutils.py", line 248, in inner\n return f(*args, **kwargs)\n File "/usr/local/csi/share/csi-nova.venv/lib/python2.6/site-packages/nova/compute/manager.py", line 1987, in do_terminate_instance\n reservations=reservations)\n File "/usr/local/csi/share/csi-nova.venv/lib/python2.6/site-packages/nova/hooks.py", line 105, in inner\n rv = f(*args, **kwargs)\n File "/usr/local/csi/share/csi-nova.venv/lib/python2.6/site-packages/nova/compute/manager.py", line 1965, in _delete_instance\n user_id=user_id)\n File "/usr/local/csi/share/csi-nova.venv/lib/python2.6/site-packages/nova/compute/manager.py", line 1935, in _delete_instance\n self._shutdown_instance(context, db_inst, bdms)\n File "/usr/local/csi/share/csi-nova.venv/lib/python2.6/site-packages/nova/compute/manager.py", line 1845, in _shutdown_instance\n network_info = self._get_instance_nw_info(context, instance)\n File "/usr/local/csi/share/csi-nova.venv/lib/python2.6/site-packages/nova/compute/manager.py", line 886, in _get_instance_nw_info\n instance)\n File "/usr/local/csi/share/csi-nova.venv/lib/python2.6/site-packages/nova/network/api.py", line 50, in wrapper\n res = f(self, context, *args, **kwargs)\n File "/usr/local/csi/share/csi-nova.venv/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 451, in get_instance_nw_info\n result = self._get_instance_nw_info(context, instance, networks)\n File "/usr/local/csi/share/csi-nova.venv/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 458, in _get_instance_nw_info\n nw_info = self._build_network_info_model(context, instance, networks)\n File "/usr/local/csi/share/csi-nova.venv/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 1029, in _build_network_info_model\n subnets)\n File "/usr/local/csi/share/csi-nova.venv/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 959, in _nw_info_build_network\n label=network_name,\n', u'result': u'Error', u'request_id': u'req-1b6a86b8-6485-4a3f-b76e-584ce815fd65', u'message': u"local variable 'network_name' referenced before assignment", u'event': u'compute_terminate_instance'}}, u'_unique_id': u'02521df0a35d4abebf5a038dd136e747', u'_context_project_name': u'csi-tenant-tempest', u'_context_read_deleted': u'no', u'_context_tenant': u'csi-tenant-tempest', u'_context_instance_lock_checked': False, u'_context_project_id': u'csi-tenant-tempest', u'_context_user_name': u'tempest-admin'}

Refer to this link for following logs:
  1. nova delete --debug
  2. neutron log (no error)
  3. conductor log (above traceback and more)

http://paste.openstack.org/show/54451/

[Bhuvan Arumugam (bhuvan)]

sounds like the port belong to a network configured for different tenant. Example: mr11a00ms-11b12489. It is using openstack-net network and the server belong to csi-tenant-tempest tenant. However, the network openstack-net belong to csi-tenant-openstack tenant. In the first place, the server shouldn't be created in csi-tenant-tempest using openstack-net network. A different bug?

In this case, if I delete the port explicitly, I could delete the server successfully.
  neutron port-delete
  nova delete

I think the code should be fixed to read port information from different network, if port don't belong to default network.

[bhuvan@build spocon]$ nova list | grep mr11
| 985f282d-d2a2-4159-ad88-1f05c8a71626 | mr11a00ms-11b12489 | ACTIVE | None | Running | openstack-net=17.177.36.137 |
| f277a4cc-06d3-446d-b177-732fb75a8b7a | mr11a00ms-11b1248a | ACTIVE | None | Running | openstack-net=17.177.36.138 |
| a18d9974-1152-461c-bd90-6e54a2d9094b | mr11a00ms-11b1248b | ACTIVE | None | Running | openstack-net=17.177.36.139 |
[bhuvan@build spocon]$ nova show mr11a00ms-11b12489
+-------------------------------------+----------------------------------------------------------+
| Property | Value |
+-------------------------------------+----------------------------------------------------------+
| status | ACTIVE |
| updated | 2013-12-04T19:55:33Z |
| OS-EXT-STS:task_state | None |
| OS-EXT-SRV-ATTR:host | vp25q01is-hpam080104.isg.apple.com |
| key_name | None |
| image | cirros-0.3.1 (46f13e39-d3a5-407d-8ded-ac8e2455acad) |
| openstack-net network | 17.177.36.137 |
| hostId | a402e69ac491d008e120639120e1eeeebc3e70416999d31a3898190b |
| OS-EXT-STS:vm_state | active |
| OS-EXT-SRV-ATTR:instance_name | instance-00001e32 |
| OS-SRV-USG:launched_at | 2013-12-03T21:56:00.000000 |
| OS-EXT-SRV-ATTR:hypervisor_hostname | vp25q01is-hpam080104.isg.apple.com |
| flavor | m1.medium (3) |
| id | 985f282d-d2a2-4159-ad88-1f05c8a71626 |
| security_groups | [{u'name': u'default'}] |
| OS-SRV-USG:terminated_at | None |
| user_id | tempest-admin |
| name | mr11a00ms-11b12489 ...

[Armando Migliaccio (armando-migliaccio)]

This looks like a duplicate of the bug above, please check if that's the case, but from what I understand that has nothing to do with NVP per se.