Nova sends notifications with different timestamp formats

[Nadya Privalova]

Nova sends metadata about instances with different timestamp formats.
Example:
[{"meters":{"instance":{"type":"gauge","unit":"instance"}},"source":"openstack","metadata":{"launched_at":"20
17-01-16T09:00:15.000000","progress":"","host":"compute.node-2.domain.tld","bandwidth":{},"kernel_id":"","ramdisk_id":"","disk_gb":1,"memory_mb":512,"created_at":"2017-0
1-16 09:00:00+00:00","cell_name":"","state":"active","state_description":"","tenant_id":"c99e47b77866411a9819823ddfc98751","root_gb":1,"terminated_at":"","user_id":"2707
ffeac90949cbbd9fe809da63b60b","audit_period_beginning":"2017-01-17 07:00:00","image_ref_url":"http://10.21.2.9:9292/images/33350a42-3c6e-41b4-b449-8c180599f57b","deleted
_at":"","audit_period_ending":"2017-01-17 08:00:00"....

"launched_at":"2017-01-16T09:00:15.000000"
"created_at":"2017-01-16 09:00:00+00:00"
"audit_period_beginning":"2017-01-17 07:00:00"
"audit_period_ending":"2017-01-17 08:00:00"

Because of this inconsistency, we cannot insert this data in ElasticSearch without additional processing. The following error occurs:
IllegalArgumentException[Invalid format: "2017-01-16 09:00:00+00:00" is malformed at " 09:00:00+00:00"];
        at org.elasticsearch.index.mapper.FieldMapper.parse(FieldMapper.java:329)
        at org.elasticsearch.index.mapper.DocumentParser.parseObjectOrField(DocumentParser.java:309)
        at org.elasticsearch.index.mapper.DocumentParser.parseValue(DocumentParser.java:436)
        at org.elasticsearch.index.mapper.DocumentParser.parseObject(DocumentParser.java:262)
        at org.elasticsearch.index.mapper.DocumentParser.parseObjectOrField(DocumentParser.java:306)
        at org.elasticsearch.index.mapper.DocumentParser.parseObject(DocumentParser.java:326) .....

This bug is high from Ceilometer/Telemetry plugin perspective because affects Resourse API usage very much. We cannot put data to ES

[Nadya Privalova (nprivalova)]

Review is here https://review.fuel-infra.org/#/c/29897

[Fuel Devops McRobotson (fuel-devops-robot)]

Fix proposed to branch: 9.0/mitaka
Change author: Nadya Shakhat <email address hidden>
Review: https://review.fuel-infra.org/30006

[Fuel Devops McRobotson (fuel-devops-robot)]

Change abandoned by Timofey Durakov <email address hidden> on branch: 9.0/mitaka
Review: https://review.fuel-infra.org/29897
Reason: wrong change-id, resubmitted new one: https://review.fuel-infra.org/#/c/30006/

[Fuel Devops McRobotson (fuel-devops-robot)]

Reviewed: https://review.fuel-infra.org/30006
Submitter: Pkgs Jenkins <email address hidden>
Branch: 9.0/mitaka

Commit: a5a68d653d0a89764ba3e375b0f25a34b0566afe
Author: Nadya Shakhat <email address hidden>
Date: Fri Jan 20 12:46:11 2017

Make all datastamps formats equal

Prior to this patch notifications for instance
uses different format for datetime fields
This patch aligns that formating.

Co-Authored-By: Nadya Shakhat <email address hidden>

Closes-bug:1657133
Change-Id: I946a92601e4268bb224fc35b2052bca7436531f4

[TatyanaGladysheva (tgladysheva)]

Verified on 9.2 snapshot #802.

Actual results:
After the fix timestamp has correct format in nova notifications:
"created_at": "2017-01-24T11:46:21.000000"
"audit_period_beginning": "2017-01-01T00:00:00.000000"
audit_period_ending": "2017-01-24T11:46:22.063333"

[Fuel Devops McRobotson (fuel-devops-robot)]

Fix proposed to branch: 11.0/ocata
Change author: Nadya Shakhat <email address hidden>
Review: https://review.fuel-infra.org/33889

[Fuel Devops McRobotson (fuel-devops-robot)]

Fix proposed to branch: mcp/ocata
Change author: Nadya Shakhat <email address hidden>
Review: https://review.fuel-infra.org/34559

[Fuel Devops McRobotson (fuel-devops-robot)]

Change abandoned by Roman Podoliaka <email address hidden> on branch: 11.0/ocata
Review: https://review.fuel-infra.org/33889
Reason: 11.0/ocata is deprecated in favor of mcp/ocata

[Fuel Devops McRobotson (fuel-devops-robot)]

Reviewed: https://review.fuel-infra.org/34559
Submitter: Pkgs Jenkins <email address hidden>
Branch: mcp/ocata

Commit: 7222d5aa18b40423f343acce29fe4990b4bdb329
Author: Nadya Shakhat <email address hidden>
Date: Wed May 3 09:14:02 2017

Make all datastamps formats equal

Prior to this patch notifications for instance
uses different format for datetime fields
This patch aligns that formating.

Co-Authored-By: Nadya Shakhat <email address hidden>

Closes-bug: #1657133
Change-Id: I946a92601e4268bb224fc35b2052bca7436531f4

[Fuel Devops McRobotson (fuel-devops-robot)]

Reviewed: https://review.fuel-infra.org/33519
Submitter: Pkgs Jenkins <email address hidden>
Branch: mcp/newton

Commit: 4f4d04247d3799c20d07c2203a021cf4b1d5f161
Author: Nadya Shakhat <email address hidden>
Date: Wed May 3 09:35:32 2017

Make all datastamps formats equal

Prior to this patch notifications for instance
uses different format for datetime fields
This patch aligns that formating.

Co-Authored-By: Nadya Shakhat <email address hidden>

Closes-bug: #1657133
Change-Id: I946a92601e4268bb224fc35b2052bca7436531f4