Wallaby deploy with monasca enabled causes license error with elasticsearch / logstash

Bug #1941754 reported by Chris
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
kolla
Fix Released
Medium
Mark Goddard

Bug Description

I deploy kibana for my private openstack cloud and I am seeing licensing issues with the API on the open source version.

{"level":"ERROR","loggerName":"logstash.outputs.elasticsearch","timeMillis":1629936010246,"thread":"Ruby-0-Thread-9: :1","logEvent":{"message":"Unable to get license information","url":"http://10.0.200.21:9200/","exception":{"metaClass":{"metaClass":{"exception":"LogStash::Outputs::ElasticSearch::HttpClient::Pool::BadResponseCodeError","message":"Got response code '400' contacting Elasticsearch at URL 'http://10.0.200.21:9200/_license'"}}}}}
{"level":"ERROR","loggerName":"logstash.outputs.elasticsearch","timeMillis":1629936010246,"thread":"Ruby-0-Thread-9: :1","logEvent":{"message":"Could not connect to a compatible version of Elasticsearch","url":"http://10.0.200.21:9200/"}}

Here is my elasticsearch version:

{
"name" : "10.0.200.20",
"cluster_name" : "kolla_logging",
"cluster_uuid" : "MAinUYsrS-evlWA35ro3dg",
"version" : {
"number" : "7.10.2",
"build_flavor" : "oss",
"build_type" : "rpm",
"build_hash" : "747e1cc71def077253878a59143c1f785afa92b9",
"build_date" : "2021-01-13T00:42:12.435326Z",
"build_snapshot" : false,
"lucene_version" : "8.7.0",
"minimum_wire_compatibility_version" : "6.8.0",
"minimum_index_compatibility_version" : "6.0.0-beta1"
},
"tagline" : "You Know, for Search"
}

How to reproduce:

OS : Centos 8.3.2011
Kernel : Linux 4.18.0-305.12.1.el8_4.x86_64 #1 SMP Wed Aug 11 01:59:55 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

Kolla version : Wallaby

From IRC: I had monasca enabled which was mentioned uses the ELK stack, it was suggested to disable monasca and use the EFK stack.

Revision history for this message
Piotr Parczewski (parczewski) wrote :

Not exactly related to Kibana, it's Logstash vs. Elasticsearch versions mismatch.

Changed in kolla:
status: New → Triaged
importance: Undecided → Medium
assignee: nobody → Piotr Parczewski (parczewski)
Mark Goddard (mgoddard)
Changed in kolla:
assignee: Piotr Parczewski (parczewski) → Mark Goddard (mgoddard)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla (master)

Fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/kolla/+/811977

Changed in kolla:
status: Triaged → In Progress
summary: - Openstack Kolla Wallaby deploy with monasca enabled causes license error
- with elasticsearch / logstash / kibana
+ Wallaby deploy with monasca enabled causes license error with
+ elasticsearch / logstash
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla (master)

Reviewed: https://review.opendev.org/c/openstack/kolla/+/811977
Committed: https://opendev.org/openstack/kolla/commit/b32cf27cc93878bcc124bcc387749829b0997a66
Submitter: "Zuul (22348)"
Branch: master

commit b32cf27cc93878bcc124bcc387749829b0997a66
Author: Mark Goddard <email address hidden>
Date: Thu Sep 30 13:42:18 2021 +0100

    logstash: pin to 7.9.* for Elasticsearch OSS compatibility

    The latest versions of logstash 7.x do not support using the OSS version
    of Elasticsearch, and fail to push logs if an OSS version is used. This
    prevents Monasca log API from working correctly.

    This change fixes the issue by pinning logstash-oss to 7.9.x, the most
    recent available package in the repo that still supports Elasticsearch
    OSS.

    NOTE: logstash 7.11 introduced the breaking change, however 7.10 is
    unavailable in the package repos.

    Change-Id: I4ec4eb837c98f57964488769ab82ba8213ad582c
    Closes-Bug: #1941754

Changed in kolla:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla (stable/wallaby)

Fix proposed to branch: stable/wallaby
Review: https://review.opendev.org/c/openstack/kolla/+/812203

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla (stable/wallaby)

Reviewed: https://review.opendev.org/c/openstack/kolla/+/812203
Committed: https://opendev.org/openstack/kolla/commit/0366a31d268800c2f153c3d28cd84bea2119b505
Submitter: "Zuul (22348)"
Branch: stable/wallaby

commit 0366a31d268800c2f153c3d28cd84bea2119b505
Author: Mark Goddard <email address hidden>
Date: Thu Sep 30 13:42:18 2021 +0100

    logstash: pin to 7.9.* for Elasticsearch OSS compatibility

    The latest versions of logstash 7.x do not support using the OSS version
    of Elasticsearch, and fail to push logs if an OSS version is used. This
    prevents Monasca log API from working correctly.

    This change fixes the issue by pinning logstash-oss to 7.9.x, the most
    recent available package in the repo that still supports Elasticsearch
    OSS.

    NOTE: logstash 7.11 introduced the breaking change, however 7.10 is
    unavailable in the package repos.

    Change-Id: I4ec4eb837c98f57964488769ab82ba8213ad582c
    Closes-Bug: #1941754
    (cherry picked from commit b32cf27cc93878bcc124bcc387749829b0997a66)

tags: added: in-stable-wallaby
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla 13.0.0.0rc1

This issue was fixed in the openstack/kolla 13.0.0.0rc1 release candidate.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla 12.1.0

This issue was fixed in the openstack/kolla 12.1.0 release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.