python-swiftclient

json decode errors thrown by swift driver

Bug #1554739 reported by gordon chung
10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
Gnocchi
Invalid
High
Unassigned
python-swiftclient
New
Undecided
Unassigned

Bug Description

the following is thrown occasionally

2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara [-] Error processing new measures
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara Traceback (most recent call last):
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara File "/opt/stack/gnocchi/gnocchi/storage/_carbonara.py", line 406, in process_measures
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara ignore_too_old_timestamps=True)
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara File "/opt/stack/gnocchi/gnocchi/carbonara.py", line 230, in set_values
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara before_truncate_callback(self)
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara File "/opt/stack/gnocchi/gnocchi/storage/_carbonara.py", line 399, in _map_add_measures
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara for aggregation in agg_methods
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara File "/opt/stack/gnocchi/gnocchi/storage/_carbonara.py", line 503, in _map_in_thread
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara return list(executor.map(lambda args: method(*args), list_of_args))
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara File "/usr/lib/python2.7/site-packages/concurrent/futures/_base.py", line 581, in result_iterator
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara yield future.result()
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara File "/usr/lib/python2.7/site-packages/concurrent/futures/_base.py", line 405, in result
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara return self.__get_result()
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara File "/usr/lib/python2.7/site-packages/concurrent/futures/thread.py", line 55, in run
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara result = self.fn(*self.args, **self.kwargs)
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara File "/opt/stack/gnocchi/gnocchi/storage/_carbonara.py", line 503, in <lambda>
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara return list(executor.map(lambda args: method(*args), list_of_args))
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara File "/opt/stack/gnocchi/gnocchi/storage/_carbonara.py", line 228, in _add_measures
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara oldest_point_to_keep)
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara File "/opt/stack/gnocchi/gnocchi/storage/_carbonara.py", line 266, in _delete_metric_measures_before
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara metric, aggregation_method, granularity):
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara File "/opt/stack/gnocchi/gnocchi/storage/swift.py", line 236, in _list_split_keys_for_metric
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara container, full_listing=True)
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara File "/usr/lib/python2.7/site-packages/swiftclient/client.py", line 1638, in get_container
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara full_listing=full_listing, headers=headers)
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara File "/usr/lib/python2.7/site-packages/swiftclient/client.py", line 1565, in _retry
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara service_token=self.service_token, **kwargs)
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara File "/usr/lib/python2.7/site-packages/swiftclient/client.py", line 838, in get_container
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara service_token=service_token, headers=headers)
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara File "/usr/lib/python2.7/site-packages/swiftclient/client.py", line 888, in get_container
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara return resp_headers, parse_api_response(resp_headers, body)
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara File "/usr/lib/python2.7/site-packages/swiftclient/utils.py", line 118, in parse_api_response
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara return json.loads(body.decode(charset))
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara File "/usr/lib64/python2.7/json/__init__.py", line 338, in loads
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara return _default_decoder.decode(s)
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara File "/usr/lib64/python2.7/json/decoder.py", line 366, in decode
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara obj, end = self.raw_decode(s, idx=_w(s, 0).end())
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara File "/usr/lib64/python2.7/json/decoder.py", line 384, in raw_decode
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara raise ValueError("No JSON object could be decoded")
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara ValueError: No JSON object could be decoded
2016-03-08 16:08:00.768 20443 ERROR gnocchi.storage._carbonara

Julien Danjou (jdanjou)
Changed in gnocchi:
status: New → Triaged
importance: Undecided → High
Revision history for this message
Julien Danjou (jdanjou) wrote :

Looks like swiftclient is not catching a JSON error that it should catch somewhere.

Revision history for this message
Julien Danjou (jdanjou) wrote :

Didn't see that in a while in our gate, I imagine it's a "bug" in Swift server somewhere, marking as invalid as I cannot reproduce it.

Changed in gnocchi:
status: Triaged → Incomplete
Revision history for this message
gordon chung (chungg) wrote :

i haven't tried the swift driver in a long time. we can close this and reopen if necessary

Julien Danjou (jdanjou)
Changed in gnocchi:
status: Incomplete → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.