Kibana displays incorrect timestamps when the cluster nodes are in another TZ than UTC

[Simon Pasquier]

MOS 9 + StackLight plugins from master

When the operator configures the nodes with another TZ, Elasticsearch/Kibana assume UTC datetimes because the data pushed to Elasticsearch has no TZ information.

[Simon Pasquier (simon-pasquier)]

Workaround:

Override the timezone setting of Kibana and set it to 'UTC'. See https://drive.google.com/file/d/0B2Tm7Jz65CjVSGU4amdKTDFseDg/view?usp=sharing

[Simon Pasquier (simon-pasquier)]

Note that oslo.log has now a 'isotime' formatter that should probably be used instead of 'asctime'. Unfortunately it's only available starting from MOS 9.0 AFAICT.

[Simon Pasquier (simon-pasquier)]

In the same manner, the Syslog messages should be logged with the RFC3339 format (eg, '2016-11-04T15:16:39.967154+03:00') but unfortunately this isn't something which is of StackLight's responsibility.

[Simon Pasquier (simon-pasquier)]

For these reasons and also because other services (like MySQL, RabbitMQ, ...) don't use Syslog for logging, we have to let the Heka decoders know about the timezone to apply the correct offset. Also the Elasticsearch encoder will be updated to encode the timestamps following RFC3339.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/394311

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/394311
Committed: https://git.openstack.org/cgit/openstack/fuel-plugin-lma-collector/commit/?id=737336a09cb978ad153562aab3d1347763e23042
Submitter: Jenkins
Branch: master

commit 737336a09cb978ad153562aab3d1347763e23042
Author: Simon Pasquier <email address hidden>
Date: Fri Nov 4 17:30:21 2016 +0100

    Enforce timezone setting in log processing

    Change-Id: I1fc5ecf8471c2effa1dadd72cf369c64bb11ec41
    Closes-Bug: #1633074

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/0.10
Review: https://review.openstack.org/395669

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/1.0
Review: https://review.openstack.org/395670

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/395670
Committed: https://git.openstack.org/cgit/openstack/fuel-plugin-lma-collector/commit/?id=b943f5b11d99a597a8f9cf2262921d88274d8346
Submitter: Jenkins
Branch: stable/1.0

commit b943f5b11d99a597a8f9cf2262921d88274d8346
Author: Simon Pasquier <email address hidden>
Date: Fri Nov 4 17:30:21 2016 +0100

    Enforce timezone setting in log processing

    Change-Id: I1fc5ecf8471c2effa1dadd72cf369c64bb11ec41
    Closes-Bug: #1633074
    (cherry picked from commit 737336a09cb978ad153562aab3d1347763e23042)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/395669
Committed: https://git.openstack.org/cgit/openstack/fuel-plugin-lma-collector/commit/?id=20c51d59912981c933d9c4ac05ed56b02c39811d
Submitter: Jenkins
Branch: stable/0.10

commit 20c51d59912981c933d9c4ac05ed56b02c39811d
Author: Simon Pasquier <email address hidden>
Date: Fri Nov 4 17:30:21 2016 +0100

    Enforce timezone setting in log processing

    Change-Id: I1fc5ecf8471c2effa1dadd72cf369c64bb11ec41
    Closes-Bug: #1633074
    (cherry picked from commit 737336a09cb978ad153562aab3d1347763e23042)

[Vitaly Gusev (vgusev)]

Verified on 0.10.3 version.