syslog in gate-swift-dsvm-functional full of ceilometer errors

[gordon chung]

this seems to be only true for swift-dsvm-functional gate tests. the error that comes up is:

Sep 12 23:34:25 devstack-trusty-hpcloud-b3-2114692 proxy-server: STDOUT: 2014-09-12 23:34:25.770 24725 ERROR ceilometer.pipeline [-] Pipeline meter_sink: Continue after error from publisher <ceilometer.publisher.messaging.NotifierPublisher object at 0x7f24605d7310>#0122014-09-12 23:34:25.770 24725 TRACE ceilometer.pipeline Traceback (most recent call last):#0122014-09-12 23:34:25.770 24725 TRACE ceilometer.pipeline File "/opt/stack/new/ceilometer/ceilometer/pipeline.py", line 304, in _publish_samples#0122014-09-12 23:34:25.770 24725 TRACE ceilometer.pipeline p.publish_samples(ctxt, transformed_samples)#0122014-09-12 23:34:25.770 24725 TRACE ceilometer.pipeline File "/opt/stack/new/ceilometer/ceilometer/publisher/messaging.py", line 131, in publish_samples#0122014-09-12 23:34:25.770 24725 TRACE ceilometer.pipeline for sample in samples#0122014-09-12 23:34:25.770 24725 TRACE ceilometer.pipeline File "/opt/stack/new/ceilometer/ceilometer/publisher/utils.py", line 129, in meter_message_from_counter#0122014-09-12 23:34:25.770 24725 TRACE ceilometer.pipeline msg['message_signature'] = compute_signature(msg, secret)#0122014-09-12 23:34:25.770 24725 TRACE ceilometer.pipeline File "/opt/stack/new/ceilometer/ceilometer/publisher/utils.py", line 59, in compute_signature#0122014-09-12 23:34:25.770 24725 TRACE ceilometer.pipeline digest_maker.update(six.text_type(value).encode('utf-8'))#0122014-09-12 23:34:25.770 24725 TRACE ceilometer.pipeline UnicodeDecodeError: 'ascii' codec can't decode byte 0xe1 in position 0: ordinal not in range(128)#0122014-09-12 23:34:25.770 24725 TRACE ceilometer.pipeline (txn: tx56c944c4103945649a85c-0054138301) (client_ip: 127.0.0.1)

see http://logs.openstack.org/37/120537/6/gate/gate-swift-dsvm-functional/847d794/logs/syslog.txt.gz or any syslog run for swift-dsvm-functional

[Lianhao Lu (lianhao-lu)]

see patch https://review.openstack.org/#/c/121674/

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/121674
Committed: https://git.openstack.org/cgit/openstack/ceilometer/commit/?id=7ced6cb6bb420d07e6a0b2fd43c558643013d581
Submitter: Jenkins
Branch: master

commit 7ced6cb6bb420d07e6a0b2fd43c558643013d581
Author: gordon chung <email address hidden>
Date: Mon Sep 15 17:28:20 2014 -0400

    clean up swift middleware to avoid unicode errors

    the swift middleware does not handle environment variables correctly.
    this is causing ceilometer errors to be thrown in syslogs in the
    check-swift-dsvm-full tests.

    this patch adds in unicode support.

    Closes-Bug: #1369124
    Change-Id: Icf0874efcc69d9889df591b2cb4bbdd3930eaf68

[Eoghan Glynn (eglynn)]

Initial fix did not fully resolving, now addressed by:

  https://review.openstack.org/124916

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/124916
Committed: https://git.openstack.org/cgit/openstack/ceilometer/commit/?id=dbe8c8b20f4231841d2086fbfd278f3a4cde8324
Submitter: Jenkins
Branch: master

commit dbe8c8b20f4231841d2086fbfd278f3a4cde8324
Author: gordon chung <email address hidden>
Date: Mon Sep 29 18:39:03 2014 -0400

    clean path in swift middleware

    the path also requires encoding as syslogs still show errors.

    Closes-Bug: #1369124
    Change-Id: Ie4d19a5a7dd5ce29e10c6e082bfcb33e6e641623

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: proposed/juno
Review: https://review.openstack.org/126537

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/126537
Committed: https://git.openstack.org/cgit/openstack/ceilometer/commit/?id=e6078929fd3235eab7f2b5f136a5c9df347bf94c
Submitter: Jenkins
Branch: proposed/juno

commit e6078929fd3235eab7f2b5f136a5c9df347bf94c
Author: gordon chung <email address hidden>
Date: Mon Sep 29 18:39:03 2014 -0400

    clean path in swift middleware

    the path also requires encoding as syslogs still show errors.

    Closes-Bug: #1369124
    Change-Id: Ie4d19a5a7dd5ce29e10c6e082bfcb33e6e641623
    (cherry picked from commit dbe8c8b20f4231841d2086fbfd278f3a4cde8324)

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/128905

[OpenStack Infra (hudson-openstack)]

Change abandoned by gordon chung (<email address hidden>) on branch: master
Review: https://review.openstack.org/128905
Reason: i've no idea what this is but the changes don't appear to exist in code

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/128905
Committed: https://git.openstack.org/cgit/openstack/ceilometer/commit/?id=e67bdae2a2430d5d7763e83daa202bcb5cebf619
Submitter: Jenkins
Branch: master

commit 9899b6f12f5072787ac72a1a64d4a712db222cb3
Author: Samta <email address hidden>
Date: Wed Oct 8 16:27:12 2014 +0530

    Fix recording failure for system pollster

    The parameter "cumulative" was interpreted as a list and could
    not be recognized as a valid Type for SQL query hence failing
    to record the data for the pollster.

    The presence of ',' operator in the pollster class after the term
    CUMULATIVE caused it to be treated as a list

    This is corrected to interpret the field as a string which will
    be successfully recorded to the meter database.

    Change-Id: I10a69134a7f0c42a3e6c0d9bb7568e8d8fd2a932
    Closes-Bug: 1378742
    (cherry picked from commit f8f63d4b15ce68797d6e16943bd85efb19a77752)

commit 619291bd6c5d9775aaa9fcc2b47e8120e6f3443d
Author: Julien Danjou <email address hidden>
Date: Fri Oct 10 16:25:58 2014 +0200

    Add oslo.db to config generator

    Otherwise we miss the oslo.db configuration option in the sample config
    file.

    Closes-Bug: 1379808

    Change-Id: I3a70e5da42562081002286d37ba1a200150c8cfc
    (cherry picked from commit f7392e47575c8baa081406b03cf14ce2894a5996)

commit 5b966ba778ad9e87a41fc639a64e68f84d6ca8e2
Author: Eoghan Glynn <email address hidden>
Date: Tue Oct 7 16:25:34 2014 +0000

    Manually updated translations

    The workflow boils down to:

     $ sudo easy_install Babel
     $ sudo yum install gettext
     $ python setup.py extract_messages
     $ python setup.py update_catalog --no-fuzzy-matching \
       --ignore-obsolete=true
     $ source \
       ../project-config/jenkins/scripts/common_translation_update.sh
     $ setup_loglevel_vars
     $ cleanup_po_files ceilometer

    Change-Id: Ia16b2b15004e0e0cbd4332ed5106ba04f1736ade

commit aa15b2d7ed02822b72f878e889b3a77c97b4a6c5
Author: Pradeep Kilambi <email address hidden>
Date: Tue Sep 30 11:24:20 2014 -0700

    Fix neutron client to catch 404 exceptions

    When network services such as lbaas, fwaas or vpnaas are disabled
    in neutron, the discovery continues to poll the api calls and gets
    back a not found exception. The fix here is to catch the exception
    so it doesn't go unhandled.

    Change-Id: I8f350b9009f0d8c172836b1dd1123e966f887fdb
    Closes-Bug: #1374012
    (cherry picked from commit b65554eb460a282a2ab0a2dcc0053a8691cb9373)

commit fc22a04cfbab9a868347bea78a0b55c2b3316ef1
Author: Thomas Bechtold <email address hidden>
Date: Mon Sep 29 10:53:50 2014 +0200

    Fix OrderedDict usage for Python 2.6

    "import collections" also works on Python 2.6 but
    collections.OrderedDict() is not available so the current check is
    wrong. Using a function to get an OrderedDict() instance works fine for
    that.

    Closes-Bug: #1375568
    Change-Id: Iaf739dc2deb7d4b09bf477be60de4df8c4fcf5c0
    (cherry picked from commit 7212f7dc92c1c6fd5d7e36fc270b74efec412d72)

commit cac21417118c9aa72705088f8d04ff5250d93123
Author: Chris Dent <chd...