Discovered the following in our PoC environment testing out Mitaka. The neutron-server.log contained the following traceback. I don't have a recreate procedure, so hopefully the traceback is enough.
1398576f9be6477e957b5154bbe96b5b 1436a59bbdd3454eb28a3a2902706a6b - - -] CAST unique_id: c79b6d96d6fd42e18b671dab9a43ff41 NOTIFY exchange 'neutron' topic 'notifications.info' _send /usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:438
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors [-] An error occurred during processing the request: DELETE /v2.0/networks/8cc09955-7344-442a-b08c-96444c5694ff.json HTTP/1.0
Accept: application/json
Accept-Encoding: gzip, deflate
Connection: close
Content-Length: 0
Content-Type: text/plain
Host: 192.169.123.50:9696
User-Agent: python-neutronclient
X-Auth-Token: gAAAAABXj3V9f9GafdIOTQj8_JVoCXatiQ-4eoJHZZ4q4uzgn0g5FTB7Lwqh11VsPm3JQxxdr59_tT6C5Ta0Dm51PJVs23275jFHPJLFwiri__rPE7k3e9YyXh8oK6aModYIkKFsLIbr0NAdc98DPAj1-2eact4Q6Gv6pKFOGtv_vsV6qCXVZYI
X-Domain-Id: None
X-Domain-Name: None
X-Forwarded-For: 192.169.1.81
X-Identity-Status: Confirmed
X-Project-Domain-Id: default
X-Project-Domain-Name: Default
X-Project-Id: 1436a59bbdd3454eb28a3a2902706a6b
X-Project-Name: ctx_rally_b2a2145e-ab02-471f-8d5b-76f949a3e23e_tenant_4
X-Role: _member_
X-Roles: _member_
X-Tenant: ctx_rally_b2a2145e-ab02-471f-8d5b-76f949a3e23e_tenant_4
X-Tenant-Id: 1436a59bbdd3454eb28a3a2902706a6b
X-Tenant-Name: ctx_rally_b2a2145e-ab02-471f-8d5b-76f949a3e23e_tenant_4
X-User: ctx_rally_1436a59bbdd3454eb28a3a2902706a6b_user_0
X-User-Domain-Id: default
X-User-Domain-Name: Default
X-User-Id: 1398576f9be6477e957b5154bbe96b5b
X-User-Name: ctx_rally_1436a59bbdd3454eb28a3a2902706a6b_user_0
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors Traceback (most recent call last):
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors File "/usr/lib/python2.7/dist-packages/oslo_middleware/catch_errors.py", line 38, in __call__
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors response = req.get_response(self.application)
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1317, in send
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors application, catch_exc_info=False)
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1281, in call_application
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors app_iter = application(self.environ, start_response)
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 130, in __call__
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors resp = self.call_func(req, *args, **self.kwargs)
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 195, in call_func
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors return self.func(req, *args, **kwargs)
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors File "/usr/lib/python2.7/dist-packages/keystonemiddleware/auth_token/__init__.py", line 464, in __call__
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors response = self.process_request(req)
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors File "/usr/lib/python2.7/dist-packages/keystonemiddleware/auth_token/__init__.py", line 762, in process_request
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors request.set_service_catalog_headers(user_auth_ref)
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors File "/usr/lib/python2.7/dist-packages/keystonemiddleware/auth_token/_request.py", line 176, in set_service_catalog_headers
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors catalog = _v3_to_v2_catalog(catalog)
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors File "/usr/lib/python2.7/dist-packages/keystonemiddleware/auth_token/_request.py", line 29, in _v3_to_v2_catalog
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors v2_service = {'type': v3_service['type']}
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors TypeError: string indices must be integers
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors
2016-07-20 12:58:37.922 1173 INFO neutron.wsgi [-] 192.169.1.81,192.168.123.60 - - [20/Jul/2016 12:58:37] "DELETE /v2.0/networks/8cc09955-7344-442a-b08c-96444c5694ff.json HTTP/1.1" 500 336 0.137946
2016-07-20 12:58:37.926 1173 DEBUG oslo_messaging._drivers.amqpdriver [req-2c46e398-fa6e-4c23-96a2-6e9283219e8b 53bbd4c301f04f0bb30d1d294da15464 7752bc30d6d44c99872a4848c9e4a928 - - -] CAST unique_id: 6d24de28908f4c4bbf93a039cffcaf9b NOTIFY exchange 'neutron' topic 'notifications.info' _send /usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:438
2016-07-20 12:58:37.928 1178 DEBUG neutron.wsgi [-] (1178) accepted ('192.168.123.60', 27389) server /usr/lib/python2.7/dist-packages/eventlet/wsgi.py:867
2016-07-20 12:58:37.930 1175 DEBUG neutron.wsgi [-] (1175) accepted ('192.168.123.60', 27390) server /usr/lib/python2.7/dist-packages/eventlet/wsgi.py:867
2016-07-20 12:58:37.953 1179 DEBUG vmware_nsx.plugins.nsx_v.vshield.vcns [-] VcnsApiHelper reply: header={'Content-Length': '0', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains', 'Expires': 'Thu, 01 Jan 1970 00:00:00 GMT', 'Server': '', 'Cache-Control': 'private, no-cache', 'Date': 'Wed, 20 Jul 2016 12:58:39 GMT'} content= took 0.9983 do_request /usr/lib/python2.7/dist-packages/vmware_nsx/plugins/nsx_v/vshield/vcns.py:130
2016-07-20 12:58:37.955 1179 INFO vmware_nsx.plugins.nsx_v.vshield.edge_appliance_driver [-] Task delete-virtualwire-virtualwire-459 completed.
2016-07-20 12:58:37.955 1179 DEBUG vmware_nsx.plugins.nsx_v.vshield.tasks.tasks [-] Task Task-delete-virtualwire-virtualwire-459-virtualwire-459-abbf298e-4e79-11e6-be03-005056b7922a return 2 _execute /usr/lib/python2.7/dist-packages/vmware_nsx/plugins/nsx_v/vshield/tasks/tasks.py:198
2016-07-20 12:58:37.955 1179 DEBUG vmware_nsx.plugins.nsx_v.vshield.tasks.tasks [-] Task Task-delete-virtualwire-virtualwire-459-virtualwire-459-abbf298e-4e79-11e6-be03-005056b7922a return 2 _result /usr/lib/python2.7/dist-packages/vmware_nsx/plugins/nsx_v/vshield/tasks/tasks.py:214
2016-07-20 12:58:37.956 1179 DEBUG vmware_nsx.plugins.nsx_v.vshield.tasks.tasks [-] Start task Task-delete-virtualwire-virtualwire-461-virtualwire-461-abc221ac-4e79-11e6-be03-005056b7922a _execute /usr/lib/python2.7/dist-packages/vmware_nsx/plugins/nsx_v/vshield/tasks/tasks.py:185
2016-07-20 12:58:37.956 1179 DEBUG vmware_nsx.plugins.nsx_v.vshield.vcns [-] VcnsApiHelper('DELETE', '/api/2.0/vdn/virtualwires/virtualwire-461', 'null') do_request /usr/lib/python2.7/dist-packages/vmware_nsx/plugins/nsx_v/vshield/vcns.py:115
2016-07-20 12:58:37.972 1174 DEBUG vmware_nsx.plugins.nsx_v.vshield.vcns [req-bc47d9aa-e5f1-44bd-9652-9140cd4a1aae 1398576f9be6477e957b5154bbe96b5b 1436a59bbdd3454eb28a3a2902706a6b - - -] VcnsApiHelper('DELETE', '/api/4.0/services/spoofguard/policies/spoofguardpolicy-500', 'null') do_request /usr/lib/python2.7/dist-packages/vmware_nsx/plugins/nsx_v/vshield/vcns.py:115
Somewhat more readable:
http:// paste.openstack .org/show/ 539104/