Ceilometer

Failed to record metering data for hardware.system_stats.io.incoming.blocks and hardware.system_stats.io.outgoing.blocks

Bug #1378742 reported by Samta Rangare on 2014-10-08

This bug affects 1 person

Affects		Status	Importance	Assigned to	Milestone
	Ceilometer	Fix Released	High	Samta Rangare	Ceilometer 2014.2 "juno"

Bug Description

ceilometer-collector have error for collecting metering data for system stats.
Here is the log:

2014-10-08 15:36:55.152 10618 DEBUG ceilometer.dispatcher.database [-] metering data hardware.system_stats.io.incoming.blocks for localhost @ 2014-10-08T10:06:47Z: 114197404 record_metering_data /opt/stack/ceilometer/ceilometer/dispatcher/database.py:55
2014-10-08 15:36:55.177 10618 ERROR oslo.db.sqlalchemy.exc_filters [-] DBAPIError exception wrapped from (ProgrammingError) (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ') AND meter.unit = 'blocks'' at line 3") 'SELECT meter.id \nFROM meter \nWHERE meter.name = %s AND meter.type = %s AND meter.unit = %s' ('hardware.system_stats.io.incoming.blocks', [u'cumulative'], 'blocks')
2014-10-08 15:36:55.177 10618 TRACE oslo.db.sqlalchemy.exc_filters Traceback (most recent call last):
2014-10-08 15:36:55.177 10618 TRACE oslo.db.sqlalchemy.exc_filters File "/usr/local/lib/python2.7/dist-packages/oslo/db/sqlalchemy/compat/handle_error.py", line 59, in _handle_dbapi_exception
2014-10-08 15:36:55.177 10618 TRACE oslo.db.sqlalchemy.exc_filters e, statement, parameters, cursor, context)
2014-10-08 15:36:55.177 10618 TRACE oslo.db.sqlalchemy.exc_filters File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1024, in _handle_dbapi_exception
2014-10-08 15:36:55.177 10618 TRACE oslo.db.sqlalchemy.exc_filters exc_info
2014-10-08 15:36:55.177 10618 TRACE oslo.db.sqlalchemy.exc_filters File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 196, in raise_from_cause
2014-10-08 15:36:55.177 10618 TRACE oslo.db.sqlalchemy.exc_filters reraise(type(exception), exception, tb=exc_tb)
2014-10-08 15:36:55.177 10618 TRACE oslo.db.sqlalchemy.exc_filters File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 867, in _execute_context
2014-10-08 15:36:55.177 10618 TRACE oslo.db.sqlalchemy.exc_filters context)
2014-10-08 15:36:55.177 10618 TRACE oslo.db.sqlalchemy.exc_filters File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 324, in do_execute
2014-10-08 15:36:55.177 10618 TRACE oslo.db.sqlalchemy.exc_filters cursor.execute(statement, parameters)
2014-10-08 15:36:55.177 10618 TRACE oslo.db.sqlalchemy.exc_filters File "/usr/lib/python2.7/dist-packages/MySQLdb/cursors.py", line 174, in execute
2014-10-08 15:36:55.177 10618 TRACE oslo.db.sqlalchemy.exc_filters self.errorhandler(self, exc, value)
2014-10-08 15:36:55.177 10618 TRACE oslo.db.sqlalchemy.exc_filters File "/usr/lib/python2.7/dist-packages/MySQLdb/connections.py", line 36, in defaulterrorhandler
2014-10-08 15:36:55.177 10618 TRACE oslo.db.sqlalchemy.exc_filters raise errorclass, errorvalue
2014-10-08 15:36:55.177 10618 TRACE oslo.db.sqlalchemy.exc_filters ProgrammingError: (ProgrammingError) (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ') AND meter.unit = 'blocks'' at line 3") 'SELECT meter.id \nFROM meter \nWHERE meter.name = %s AND meter.type = %s AND meter.unit = %s' ('hardware.system_stats.io.incoming.blocks', [u'cumulative'], 'blocks')
2014-10-08 15:36:55.177 10618 TRACE oslo.db.sqlalchemy.exc_filters
2014-10-08 15:36:55.283 10618 ERROR ceilometer.dispatcher.database [-] Failed to record metering data: (ProgrammingError) (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ') AND meter.unit = 'blocks'' at line 3") 'SELECT meter.id \nFROM meter \nWHERE meter.name = %s AND meter.type = %s AND meter.unit = %s' ('hardware.system_stats.io.incoming.blocks', [u'cumulative'], 'blocks')
2014-10-08 15:36:55.283 10618 TRACE ceilometer.dispatcher.database Traceback (most recent call last):
2014-10-08 15:36:55.283 10618 TRACE ceilometer.dispatcher.database File "/opt/stack/ceilometer/ceilometer/dispatcher/database.py", line 66, in record_metering_data
2014-10-08 15:36:55.283 10618 TRACE ceilometer.dispatcher.database self.storage_conn.record_metering_data(meter)
2014-10-08 15:36:55.283 10618 TRACE ceilometer.dispatcher.database File "/opt/stack/ceilometer/ceilometer/storage/impl_sqlalchemy.py", line 334, in record_metering_data
2014-10-08 15:36:55.283 10618 TRACE ceilometer.dispatcher.database data['counter_unit'])
2014-10-08 15:36:55.283 10618 TRACE ceilometer.dispatcher.database File "/opt/stack/ceilometer/ceilometer/storage/impl_sqlalchemy.py", line 258, in _create_meter
2014-10-08 15:36:55.283 10618 TRACE ceilometer.dispatcher.database meter.c.unit == unit))).first()
2014-10-08 15:36:55.283 10618 TRACE ceilometer.dispatcher.database File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 662, in execute
2014-10-08 15:36:55.283 10618 TRACE ceilometer.dispatcher.database params)
2014-10-08 15:36:55.283 10618 TRACE ceilometer.dispatcher.database File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 761, in _execute_clauseelement
2014-10-08 15:36:55.283 10618 TRACE ceilometer.dispatcher.database compiled_sql, distilled_params
2014-10-08 15:36:55.283 10618 TRACE ceilometer.dispatcher.database File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 874, in _execute_context
2014-10-08 15:36:55.283 10618 TRACE ceilometer.dispatcher.database context)
2014-10-08 15:36:55.283 10618 TRACE ceilometer.dispatcher.database File "/usr/local/lib/python2.7/dist-packages/oslo/db/sqlalchemy/compat/handle_error.py", line 125, in _handle_dbapi_exception
2014-10-08 15:36:55.283 10618 TRACE ceilometer.dispatcher.database six.reraise(type(newraise), newraise, sys.exc_info()[2])
2014-10-08 15:36:55.283 10618 TRACE ceilometer.dispatcher.database File "/usr/local/lib/python2.7/dist-packages/oslo/db/sqlalchemy/compat/handle_error.py", line 102, in _handle_dbapi_exception
2014-10-08 15:36:55.283 10618 TRACE ceilometer.dispatcher.database per_fn = fn(ctx)
2014-10-08 15:36:55.283 10618 TRACE ceilometer.dispatcher.database File "/usr/local/lib/python2.7/dist-packages/oslo/db/sqlalchemy/exc_filters.py", line 323, in handler
2014-10-08 15:36:55.283 10618 TRACE ceilometer.dispatcher.database context.is_disconnect)
2014-10-08 15:36:55.283 10618 TRACE ceilometer.dispatcher.database File "/usr/local/lib/python2.7/dist-packages/oslo/db/sqlalchemy/exc_filters.py", line 278, in _raise_for_remaining_DBAPIError
2014-10-08 15:36:55.283 10618 TRACE ceilometer.dispatcher.database raise exception.DBError(error)
2014-10-08 15:36:55.283 10618 TRACE ceilometer.dispatcher.database DBError: (ProgrammingError) (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ') AND meter.unit = 'blocks'' at line 3") 'SELECT meter.id \nFROM meter \nWHERE meter.name = %s AND meter.type = %s AND meter.unit = %s' ('hardware.system_stats.io.incoming.blocks', [u'cumulative'], 'blocks')

Samta Rangare (srangare) on 2014-10-08

Changed in ceilometer:
assignee:	nobody → Samta Rangare (srangare)

OpenStack Infra (hudson-openstack) on 2014-10-08

Changed in ceilometer:
status:	New → In Progress

gordon chung (chungg) on 2014-10-08

tags:

added: juno-rc-potential

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2014-10-08: Fix merged to ceilometer (master)

Reviewed: https://review.openstack.org/126871
Committed: https://git.openstack.org/cgit/openstack/ceilometer/commit/?id=f8f63d4b15ce68797d6e16943bd85efb19a77752
Submitter: Jenkins
Branch: master

commit f8f63d4b15ce68797d6e16943bd85efb19a77752
Author: Samta <email address hidden>
Date: Wed Oct 8 16:27:12 2014 +0530

Fix recording failure for system pollster

    The parameter "cumulative" was interpreted as a list and could
    not be recognized as a valid Type for SQL query hence failing
    to record the data for the pollster.

The presence of ',' operator in the pollster class after the term
CUMULATIVE caused it to be treated as a list

This is corrected to interpret the field as a string which will
be successfully recorded to the meter database.

Change-Id: I10a69134a7f0c42a3e6c0d9bb7568e8d8fd2a932
Closes-Bug: 1378742

Changed in ceilometer:
status:	In Progress → Fix Committed

Thierry Carrez (ttx) on 2014-10-14

Changed in ceilometer:
milestone:	none → juno-rc3
tags:	removed: juno-rc-potential

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2014-10-14: Fix proposed to ceilometer (proposed/juno)

Fix proposed to branch: proposed/juno
Review: https://review.openstack.org/128249

Eoghan Glynn (eglynn) on 2014-10-14

Changed in ceilometer:
importance:	Undecided → High

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2014-10-14: Fix merged to ceilometer (proposed/juno)

Reviewed: https://review.openstack.org/128249
Committed: https://git.openstack.org/cgit/openstack/ceilometer/commit/?id=9899b6f12f5072787ac72a1a64d4a712db222cb3
Submitter: Jenkins
Branch: proposed/juno

commit 9899b6f12f5072787ac72a1a64d4a712db222cb3
Author: Samta <email address hidden>
Date: Wed Oct 8 16:27:12 2014 +0530

Fix recording failure for system pollster

    The parameter "cumulative" was interpreted as a list and could
    not be recognized as a valid Type for SQL query hence failing
    to record the data for the pollster.

The presence of ',' operator in the pollster class after the term
CUMULATIVE caused it to be treated as a list

This is corrected to interpret the field as a string which will
be successfully recorded to the meter database.

    Change-Id: I10a69134a7f0c42a3e6c0d9bb7568e8d8fd2a932
    Closes-Bug: 1378742
    (cherry picked from commit f8f63d4b15ce68797d6e16943bd85efb19a77752)

Changed in ceilometer:
status:	Fix Committed → Fix Released

Thierry Carrez (ttx) on 2014-10-16

Changed in ceilometer:
milestone:	juno-rc3 → 2014.2

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2014-10-16: Fix proposed to ceilometer (master)

Fix proposed to branch: master
Review: https://review.openstack.org/128905

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2014-12-03: Change abandoned on ceilometer (master)

Change abandoned by gordon chung (<email address hidden>) on branch: master
Review: https://review.openstack.org/128905
Reason: i've no idea what this is but the changes don't appear to exist in code

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2015-06-10: Fix merged to ceilometer (master)

Download full text (4.4 KiB)

Reviewed: https://review.openstack.org/128905
Committed: https://git.openstack.org/cgit/openstack/ceilometer/commit/?id=e67bdae2a2430d5d7763e83daa202bcb5cebf619
Submitter: Jenkins
Branch: master

commit 9899b6f12f5072787ac72a1a64d4a712db222cb3
Author: Samta <email address hidden>
Date: Wed Oct 8 16:27:12 2014 +0530

Fix recording failure for system pollster

    The parameter "cumulative" was interpreted as a list and could
    not be recognized as a valid Type for SQL query hence failing
    to record the data for the pollster.

The presence of ',' operator in the pollster class after the term
CUMULATIVE caused it to be treated as a list

This is corrected to interpret the field as a string which will
be successfully recorded to the meter database.

    Change-Id: I10a69134a7f0c42a3e6c0d9bb7568e8d8fd2a932
    Closes-Bug: 1378742
    (cherry picked from commit f8f63d4b15ce68797d6e16943bd85efb19a77752)

commit 619291bd6c5d9775aaa9fcc2b47e8120e6f3443d
Author: Julien Danjou <email address hidden>
Date: Fri Oct 10 16:25:58 2014 +0200

Add oslo.db to config generator

Otherwise we miss the oslo.db configuration option in the sample config
file.

Closes-Bug: 1379808

Change-Id: I3a70e5da42562081002286d37ba1a200150c8cfc
(cherry picked from commit f7392e47575c8baa081406b03cf14ce2894a5996)

commit 5b966ba778ad9e87a41fc639a64e68f84d6ca8e2
Author: Eoghan Glynn <email address hidden>
Date: Tue Oct 7 16:25:34 2014 +0000

Manually updated translations

The workflow boils down to:

     $ sudo easy_install Babel
     $ sudo yum install gettext
     $ python setup.py extract_messages
     $ python setup.py update_catalog --no-fuzzy-matching \
       --ignore-obsolete=true
     $ source \
       ../project-config/jenkins/scripts/common_translation_update.sh
     $ setup_loglevel_vars
     $ cleanup_po_files ceilometer

Change-Id: Ia16b2b15004e0e0cbd4332ed5106ba04f1736ade

commit aa15b2d7ed02822b72f878e889b3a77c97b4a6c5
Author: Pradeep Kilambi <email address hidden>
Date: Tue Sep 30 11:24:20 2014 -0700

Fix neutron client to catch 404 exceptions

    When network services such as lbaas, fwaas or vpnaas are disabled
    in neutron, the discovery continues to poll the api calls and gets
    back a not found exception. The fix here is to catch the exception
    so it doesn't go unhandled.

    Change-Id: I8f350b9009f0d8c172836b1dd1123e966f887fdb
    Closes-Bug: #1374012
    (cherry picked from commit b65554eb460a282a2ab0a2dcc0053a8691cb9373)

commit fc22a04cfbab9a868347bea78a0b55c2b3316ef1
Author: Thomas Bechtold <email address hidden>
Date: Mon Sep 29 10:53:50 2014 +0200

Fix OrderedDict usage for Python 2.6

    "import collections" also works on Python 2.6 but
    collections.OrderedDict() is not available so the current check is
    wrong. Using a function to get an OrderedDict() instance works fine for
    that.

    Closes-Bug: #1375568
    Change-Id: Iaf739dc2deb7d4b09bf477be60de4df8c4fcf5c0
    (cherry picked from commit 7212f7dc92c1c6fd5d7e36fc270b74efec412d72)

commit cac21417118c9aa72705088f8d04ff5250d93123
Author: Chris Dent <chd...

Reviewed:  https://review.openstack.org/128905
Committed: https://git.openstack.org/cgit/openstack/ceilometer/commit/?id=e67bdae2a2430d5d7763e83daa202bcb5cebf619
Submitter: Jenkins
Branch:    master

commit 9899b6f12f5072787ac72a1a64d4a712db222cb3
Author: Samta <srangare@mvista.com>
Date:   Wed Oct 8 16:27:12 2014 +0530

Fix recording failure for system pollster
    
    The parameter "cumulative" was interpreted as a list and could
    not be recognized as a valid Type for SQL query hence failing
    to record the data for the pollster.
    
    The presence of ',' operator in the pollster class after the term
    CUMULATIVE caused it to be treated as a list
    
    This is corrected to interpret the field as a string which will
    be successfully recorded to the meter database.
    
    Change-Id: I10a69134a7f0c42a3e6c0d9bb7568e8d8fd2a932
    Closes-Bug: 1378742
    (cherry picked from commit f8f63d4b15ce68797d6e16943bd85efb19a77752)

commit 619291bd6c5d9775aaa9fcc2b47e8120e6f3443d
Author: Julien Danjou <julien@danjou.info>
Date:   Fri Oct 10 16:25:58 2014 +0200

Add oslo.db to config generator
    
    Otherwise we miss the oslo.db configuration option in the sample config
    file.
    
    Closes-Bug: 1379808
    
    Change-Id: I3a70e5da42562081002286d37ba1a200150c8cfc
    (cherry picked from commit f7392e47575c8baa081406b03cf14ce2894a5996)

commit 5b966ba778ad9e87a41fc639a64e68f84d6ca8e2
Author: Eoghan Glynn <eglynn@redhat.com>
Date:   Tue Oct 7 16:25:34 2014 +0000

Manually updated translations
    
    The workflow boils down to:
    
     $ sudo easy_install Babel
     $ sudo yum install gettext
     $ python setup.py extract_messages
     $ python setup.py update_catalog --no-fuzzy-matching \
       --ignore-obsolete=true
     $ source \
       ../project-config/jenkins/scripts/common_translation_update.sh
     $ setup_loglevel_vars
     $ cleanup_po_files ceilometer
    
    Change-Id: Ia16b2b15004e0e0cbd4332ed5106ba04f1736ade

commit aa15b2d7ed02822b72f878e889b3a77c97b4a6c5
Author: Pradeep Kilambi <pkilambi@cisco.com>
Date:   Tue Sep 30 11:24:20 2014 -0700

Fix neutron client to catch 404 exceptions
    
    When network services such as lbaas, fwaas or vpnaas are disabled
    in neutron, the discovery continues to poll the api calls and gets
    back a not found exception. The fix here is to catch the exception
    so it doesn't go unhandled.
    
    Change-Id: I8f350b9009f0d8c172836b1dd1123e966f887fdb
    Closes-Bug: #1374012
    (cherry picked from commit b65554eb460a282a2ab0a2dcc0053a8691cb9373)

commit fc22a04cfbab9a868347bea78a0b55c2b3316ef1
Author: Thomas Bechtold <tbechtold@suse.com>
Date:   Mon Sep 29 10:53:50 2014 +0200

Fix OrderedDict usage for Python 2.6
    
    "import collections" also works on Python 2.6 but
    collections.OrderedDict() is not available so the current check is
    wrong. Using a function to get an OrderedDict() instance works fine for
    that.
    
    Closes-Bug: #1375568
    Change-Id: Iaf739dc2deb7d4b09bf477be60de4df8c4fcf5c0
    (cherry picked from commit 7212f7dc92c1c6fd5d7e36fc270b74efec412d72)

commit cac21417118c9aa72705088f8d04ff5250d93123
Author: Chris Dent <chdent@redhat.com>
Date:   Mon Oct 6 20:00:08 2014 +0100

Include a 'node' key and value in ipmi metadata
    
    The ipmi meters use resource_ids which make it challenging
    to select information for all the sensors of a particular type.
    This change adds metadata that identifies the physical node on
    which a sensor exists.
    
    There are still remaining issues with the naming of ipmi and
    sensor-related meters that will need to be addressed separately.
    
    Closes-Bug: 1377157
    Change-Id: Ib53755112e4757aa53ab60079f3c555e21a72b63
    (cherry picked from commit 3b20fa08527170aaca38253277feedf0f2d11217)

commit e6078929fd3235eab7f2b5f136a5c9df347bf94c
Author: gordon chung <gord@live.ca>
Date:   Mon Sep 29 18:39:03 2014 -0400

clean path in swift middleware
    
    the path also requires encoding as syslogs still show errors.
    
    Closes-Bug: #1369124
    Change-Id: Ie4d19a5a7dd5ce29e10c6e082bfcb33e6e641623
    (cherry picked from commit dbe8c8b20f4231841d2086fbfd278f3a4cde8324)

commit 0e499f88d1f197aba59107237302009afcc2b500
Author: OpenStack Proposal Bot <openstack-infra@lists.openstack.org>
Date:   Mon Oct 6 16:08:39 2014 +0000

Updated from global requirements
    
    Change-Id: I4a0be4a03e6c3590a7cab8f4548a128fdc31d1ca

Report a bug

This report contains Public information

Everyone can see this information.

You are

Subscribing...

Edit bug mail

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.