gnocchi dispatcher fails on stable/netwon

Bug #1635307 reported by sean mooney
14
This bug affects 3 people
Affects Status Importance Assigned to Milestone
kolla
Invalid
Critical
Jeffrey Zhang
Newton
Invalid
Critical
Jeffrey Zhang

Bug Description

on stable/newton the cieometer gnocci intergration is broken withthe follow error in the ceilometer-collector.log

2016-10-20 15:00:08.459 19 ERROR ceilometer.collector [-] Dispatcher failed to handle the notification, re-queuing it.
2016-10-20 15:00:08.459 19 ERROR ceilometer.collector Traceback (most recent call last):
2016-10-20 15:00:08.459 19 ERROR ceilometer.collector File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/ceilometer/collector.py", line 164, in sample
2016-10-20 15:00:08.459 19 ERROR ceilometer.collector self.dispatcher_manager.map_method(self.method, goods)
2016-10-20 15:00:08.459 19 ERROR ceilometer.collector File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py", line 259, in map_method
2016-10-20 15:00:08.459 19 ERROR ceilometer.collector method_name, *args, **kwds)
2016-10-20 15:00:08.459 19 ERROR ceilometer.collector File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py", line 232, in map
2016-10-20 15:00:08.459 19 ERROR ceilometer.collector self._invoke_one_plugin(response.append, func, e, args, kwds)
2016-10-20 15:00:08.459 19 ERROR ceilometer.collector File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py", line 263, in _invoke_one_plugin
2016-10-20 15:00:08.459 19 ERROR ceilometer.collector response_callback(func(e, *args, **kwds))
2016-10-20 15:00:08.459 19 ERROR ceilometer.collector File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/stevedore/extension.py", line 237, in _call_extension_method
2016-10-20 15:00:08.459 19 ERROR ceilometer.collector return getattr(extension.obj, method_name)(*args, **kwds)
2016-10-20 15:00:08.459 19 ERROR ceilometer.collector File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/ceilometer/dispatcher/gnocchi.py", line 514, in record_events
2016-10-20 15:00:08.459 19 ERROR ceilometer.collector extra_resources = cfg['event_associated_resources'].items()
2016-10-20 15:00:08.459 19 ERROR ceilometer.collector TypeError: 'module' object has no attribute '__getitem__'
2016-10-20 15:00:08.459 19 ERROR ceilometer.collector

Changed in kolla:
status: New → Confirmed
importance: Undecided → High
no longer affects: kolla/ocata
Changed in kolla:
milestone: none → ocata-1
Revision history for this message
shake.chen (shake-chen) wrote :

https://github.com/openstack/ceilometer/commit/bc073f7592250b13450c566470576d0cbc5a0ec4

Now Newton kolla have no panko.but

The gnocchi event dispatcher have been broken by two major changes
because of no tests coverage (requests->gnocchiclient and panko
refactoring)

Revision history for this message
Steven Dake (sdake) wrote :

Jeffrey,

Can you fix this asap? We need to cut a 3.0.1 this week because external neutron bridges are busted. If this can't make thursday of this week, please let me know, and I'll cut the 3.0.1 release without it.

Regards,
-steve

Changed in kolla:
assignee: nobody → Jeffrey Zhang (jeffrey4l)
Steven Dake (sdake)
Changed in kolla:
importance: High → Critical
Changed in kolla:
milestone: ocata-1 → ocata-2
Changed in kolla:
milestone: ocata-2 → ocata-3
Changed in kolla:
milestone: ocata-3 → ocata-rc1
Changed in kolla:
milestone: ocata-rc1 → pike-1
Revision history for this message
Jeffrey Zhang (jeffrey4l) wrote :

Seems this can not be reproduced.

there is a patch with ceilometer + gnocchi in gate. check https://review.openstack.org/417283

Revision history for this message
Jeffrey Zhang (jeffrey4l) wrote :
Changed in kolla:
status: Confirmed → Incomplete
Changed in kolla:
milestone: pike-2 → pike-3
Changed in kolla:
milestone: pike-3 → pike-rc1
Changed in kolla:
milestone: pike-rc1 → queens-1
Changed in kolla:
milestone: queens-2 → queens-3
Revision history for this message
Jeffrey Zhang (jeffrey4l) wrote :

no further information. just re-open it when you hit this issue.

Changed in kolla:
status: Incomplete → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.