[Ceilometer] ES driver incompatible with ES version >=2

Bug #1623015 reported by Nadya Privalova
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Mirantis OpenStack
Fix Committed
Critical
Ilya Tyaptin

Bug Description

Detailed bug description:

Elasticsearch driver will be our primary backend for events in MOS 9.*.
Currently we have issues with elasticsearch storage driver because ElasticSearch >= 2.0 has a different mapping scheme for service variable _timestamp. Also, version changing affects string queries by nested fields.

Steps to reproduce:
use ES as a backend foe events with ES version >=2

Expected results:
ceilometer event-list return the list of events

Actual results:
root@node-13:~# ceilometer event-list
TransportError(400, u'search_phase_execution_exception', u'[nested] nested object under path [traits] is not of nested type') (HTTP 500) (Request-ID: req-96e870f8-3544-4be1-a408-58a02b5d3e4e)

Impact:
Ceilometer Event API is not supported with ES driver

Changed in mos:
assignee: nobody → Ilya Tyaptin (ityaptin)
importance: Undecided → Critical
status: New → Confirmed
Changed in mos:
milestone: none → 9.1
Revision history for this message
Nadya Privalova (nprivalova) wrote :
tags: added: blocker-for-qa
Changed in mos:
status: Confirmed → Fix Committed
Revision history for this message
Timur Nurlygayanov (tnurlygayanov) wrote :

The status changed to Won't Fix because in the default deployments with Ceilometer we don't use Elastic Search. The proposed fix partially fixed the initial issue, but it is not a final fix.

We don't want to fix it in MOS 9.1 because for Elastic Search and StackLight we have a workaround inside the plugin for this issue.

Changed in mos:
status: Fix Committed → Won't Fix
Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix proposed to openstack/ceilometer (mcp/newton)

Fix proposed to branch: mcp/newton
Change author: Ilya Tyaptin <email address hidden>
Review: https://review.fuel-infra.org/33186

Changed in mos:
status: Won't Fix → In Progress
Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix proposed to openstack/ceilometer (11.0/ocata)

Fix proposed to branch: 11.0/ocata
Change author: Ilya Tyaptin <email address hidden>
Review: https://review.fuel-infra.org/33737

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix proposed to openstack/ceilometer (mcp/ocata)

Fix proposed to branch: mcp/ocata
Change author: Ilya Tyaptin <email address hidden>
Review: https://review.fuel-infra.org/34473

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Change abandoned on openstack/ceilometer (mcp/ocata)

Change abandoned by Ilya Tyaptin <email address hidden> on branch: mcp/ocata
Review: https://review.fuel-infra.org/34473

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Change abandoned on openstack/ceilometer (11.0/ocata)

Change abandoned by Roman Podoliaka <email address hidden> on branch: 11.0/ocata
Review: https://review.fuel-infra.org/33737
Reason: we don't use 11.0/ocata anymore - mcp/ocata is the correct branch name

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Change abandoned on openstack/ceilometer (mcp/newton)

Change abandoned by Ilya Tyaptin <email address hidden> on branch: mcp/newton
Review: https://review.fuel-infra.org/33186

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Change restored on openstack/ceilometer (mcp/newton)

Change restored by Ildar Svetlov <email address hidden> on branch: mcp/newton
Review: https://review.fuel-infra.org/33186

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Change restored on openstack/ceilometer (mcp/ocata)

Change restored by Ildar Svetlov <email address hidden> on branch: mcp/ocata
Review: https://review.fuel-infra.org/34473

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Change abandoned on openstack/ceilometer (mcp/ocata)

Change abandoned by Ildar Svetlov <email address hidden> on branch: mcp/ocata
Review: https://review.fuel-infra.org/34473

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix merged to openstack/ceilometer (mcp/newton)

Reviewed: https://review.fuel-infra.org/33186
Submitter: Pkgs Jenkins <email address hidden>
Branch: mcp/newton

Commit: 511c0ffab8dd887dbb235b386856a20d64b54546
Author: Ilya Tyaptin <email address hidden>
Date: Tue Oct 10 08:16:16 2017

Fix elasticsearch-dsl for ElasticSearch 2 support

Currently we have issues with elasticsearch storage driver because
ElasticSearch >= 2.0 has a different mapping scheme for service
variable _timestamp. Also, version changing affects string queries
by nested fields.

Closes-bug: #1623015
Change-Id: I433e1d026328a677ee1d1df86e033f1a8c10af1c

Changed in mos:
status: In Progress → Fix Committed
Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Change restored on openstack/ceilometer (mcp/ocata)

Change restored by Ildar Svetlov <email address hidden> on branch: mcp/ocata
Review: https://review.fuel-infra.org/34473

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix merged to openstack/ceilometer (mcp/ocata)

Reviewed: https://review.fuel-infra.org/34473
Submitter: Pkgs Jenkins <email address hidden>
Branch: mcp/ocata

Commit: 3f831fda82ed670da8bf2676b98ad31dd4cfc1c4
Author: Ilya Tyaptin <email address hidden>
Date: Wed Oct 11 12:34:15 2017

Fix elasticsearch-dsl for ElasticSearch 2 support

Currently we have issues with elasticsearch storage driver because
ElasticSearch >= 2.0 has a different mapping scheme for service
variable _timestamp. Also, version changing affects string queries
by nested fields.

Closes-bug: #1623015
Change-Id: I433e1d026328a677ee1d1df86e033f1a8c10af1c

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.