TypeError: string indices must be integers

Bug #1605355 reported by Eric Brown
16
This bug affects 3 people
Affects Status Importance Assigned to Milestone
keystonemiddleware
Invalid
Undecided
Unassigned

Bug Description

Discovered the following in our PoC environment testing out Mitaka. The neutron-server.log contained the following traceback. I don't have a recreate procedure, so hopefully the traceback is enough.

1398576f9be6477e957b5154bbe96b5b 1436a59bbdd3454eb28a3a2902706a6b - - -] CAST unique_id: c79b6d96d6fd42e18b671dab9a43ff41 NOTIFY exchange 'neutron' topic 'notifications.info' _send /usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:438
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors [-] An error occurred during processing the request: DELETE /v2.0/networks/8cc09955-7344-442a-b08c-96444c5694ff.json HTTP/1.0
Accept: application/json
Accept-Encoding: gzip, deflate
Connection: close
Content-Length: 0
Content-Type: text/plain
Host: 192.169.123.50:9696
User-Agent: python-neutronclient
X-Auth-Token: gAAAAABXj3V9f9GafdIOTQj8_JVoCXatiQ-4eoJHZZ4q4uzgn0g5FTB7Lwqh11VsPm3JQxxdr59_tT6C5Ta0Dm51PJVs23275jFHPJLFwiri__rPE7k3e9YyXh8oK6aModYIkKFsLIbr0NAdc98DPAj1-2eact4Q6Gv6pKFOGtv_vsV6qCXVZYI
X-Domain-Id: None
X-Domain-Name: None
X-Forwarded-For: 192.169.1.81
X-Identity-Status: Confirmed
X-Project-Domain-Id: default
X-Project-Domain-Name: Default
X-Project-Id: 1436a59bbdd3454eb28a3a2902706a6b
X-Project-Name: ctx_rally_b2a2145e-ab02-471f-8d5b-76f949a3e23e_tenant_4
X-Role: _member_
X-Roles: _member_
X-Tenant: ctx_rally_b2a2145e-ab02-471f-8d5b-76f949a3e23e_tenant_4
X-Tenant-Id: 1436a59bbdd3454eb28a3a2902706a6b
X-Tenant-Name: ctx_rally_b2a2145e-ab02-471f-8d5b-76f949a3e23e_tenant_4
X-User: ctx_rally_1436a59bbdd3454eb28a3a2902706a6b_user_0
X-User-Domain-Id: default
X-User-Domain-Name: Default
X-User-Id: 1398576f9be6477e957b5154bbe96b5b
X-User-Name: ctx_rally_1436a59bbdd3454eb28a3a2902706a6b_user_0
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors Traceback (most recent call last):
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors File "/usr/lib/python2.7/dist-packages/oslo_middleware/catch_errors.py", line 38, in __call__
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors response = req.get_response(self.application)
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1317, in send
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors application, catch_exc_info=False)
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1281, in call_application
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors app_iter = application(self.environ, start_response)
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 130, in __call__
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors resp = self.call_func(req, *args, **self.kwargs)
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 195, in call_func
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors return self.func(req, *args, **kwargs)
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors File "/usr/lib/python2.7/dist-packages/keystonemiddleware/auth_token/__init__.py", line 464, in __call__
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors response = self.process_request(req)
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors File "/usr/lib/python2.7/dist-packages/keystonemiddleware/auth_token/__init__.py", line 762, in process_request
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors request.set_service_catalog_headers(user_auth_ref)
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors File "/usr/lib/python2.7/dist-packages/keystonemiddleware/auth_token/_request.py", line 176, in set_service_catalog_headers
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors catalog = _v3_to_v2_catalog(catalog)
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors File "/usr/lib/python2.7/dist-packages/keystonemiddleware/auth_token/_request.py", line 29, in _v3_to_v2_catalog
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors v2_service = {'type': v3_service['type']}
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors TypeError: string indices must be integers
2016-07-20 12:58:37.917 1173 ERROR oslo_middleware.catch_errors
2016-07-20 12:58:37.922 1173 INFO neutron.wsgi [-] 192.169.1.81,192.168.123.60 - - [20/Jul/2016 12:58:37] "DELETE /v2.0/networks/8cc09955-7344-442a-b08c-96444c5694ff.json HTTP/1.1" 500 336 0.137946
2016-07-20 12:58:37.926 1173 DEBUG oslo_messaging._drivers.amqpdriver [req-2c46e398-fa6e-4c23-96a2-6e9283219e8b 53bbd4c301f04f0bb30d1d294da15464 7752bc30d6d44c99872a4848c9e4a928 - - -] CAST unique_id: 6d24de28908f4c4bbf93a039cffcaf9b NOTIFY exchange 'neutron' topic 'notifications.info' _send /usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:438
2016-07-20 12:58:37.928 1178 DEBUG neutron.wsgi [-] (1178) accepted ('192.168.123.60', 27389) server /usr/lib/python2.7/dist-packages/eventlet/wsgi.py:867
2016-07-20 12:58:37.930 1175 DEBUG neutron.wsgi [-] (1175) accepted ('192.168.123.60', 27390) server /usr/lib/python2.7/dist-packages/eventlet/wsgi.py:867
2016-07-20 12:58:37.953 1179 DEBUG vmware_nsx.plugins.nsx_v.vshield.vcns [-] VcnsApiHelper reply: header={'Content-Length': '0', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains', 'Expires': 'Thu, 01 Jan 1970 00:00:00 GMT', 'Server': '', 'Cache-Control': 'private, no-cache', 'Date': 'Wed, 20 Jul 2016 12:58:39 GMT'} content= took 0.9983 do_request /usr/lib/python2.7/dist-packages/vmware_nsx/plugins/nsx_v/vshield/vcns.py:130
2016-07-20 12:58:37.955 1179 INFO vmware_nsx.plugins.nsx_v.vshield.edge_appliance_driver [-] Task delete-virtualwire-virtualwire-459 completed.
2016-07-20 12:58:37.955 1179 DEBUG vmware_nsx.plugins.nsx_v.vshield.tasks.tasks [-] Task Task-delete-virtualwire-virtualwire-459-virtualwire-459-abbf298e-4e79-11e6-be03-005056b7922a return 2 _execute /usr/lib/python2.7/dist-packages/vmware_nsx/plugins/nsx_v/vshield/tasks/tasks.py:198
2016-07-20 12:58:37.955 1179 DEBUG vmware_nsx.plugins.nsx_v.vshield.tasks.tasks [-] Task Task-delete-virtualwire-virtualwire-459-virtualwire-459-abbf298e-4e79-11e6-be03-005056b7922a return 2 _result /usr/lib/python2.7/dist-packages/vmware_nsx/plugins/nsx_v/vshield/tasks/tasks.py:214
2016-07-20 12:58:37.956 1179 DEBUG vmware_nsx.plugins.nsx_v.vshield.tasks.tasks [-] Start task Task-delete-virtualwire-virtualwire-461-virtualwire-461-abc221ac-4e79-11e6-be03-005056b7922a _execute /usr/lib/python2.7/dist-packages/vmware_nsx/plugins/nsx_v/vshield/tasks/tasks.py:185
2016-07-20 12:58:37.956 1179 DEBUG vmware_nsx.plugins.nsx_v.vshield.vcns [-] VcnsApiHelper('DELETE', '/api/2.0/vdn/virtualwires/virtualwire-461', 'null') do_request /usr/lib/python2.7/dist-packages/vmware_nsx/plugins/nsx_v/vshield/vcns.py:115
2016-07-20 12:58:37.972 1174 DEBUG vmware_nsx.plugins.nsx_v.vshield.vcns [req-bc47d9aa-e5f1-44bd-9652-9140cd4a1aae 1398576f9be6477e957b5154bbe96b5b 1436a59bbdd3454eb28a3a2902706a6b - - -] VcnsApiHelper('DELETE', '/api/4.0/services/spoofguard/policies/spoofguardpolicy-500', 'null') do_request /usr/lib/python2.7/dist-packages/vmware_nsx/plugins/nsx_v/vshield/vcns.py:115

Revision history for this message
Eric Brown (ericwb) wrote :
Revision history for this message
Steve Martinelli (stevemar) wrote :
Revision history for this message
Steve Martinelli (stevemar) wrote :

Eric, still hitting these errors?

Revision history for this message
Eric Brown (ericwb) wrote :

Yeah, this was resolved with the cache fixes that were backported.

Changed in keystonemiddleware:
status: New → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.