StackLight provides reduced list of metrics.

Bug #1611156 reported by Dmitry Kabanov
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
StackLight
Fix Released
Undecided
Unassigned
0.10
Fix Released
Undecided
Unassigned

Bug Description

MOS 8.0. StackLight Version 0.10-0.10.0-1.

Steps to reproduce:
1. Deploy a cloud without LMA (3 controllers, 2 computes).
2. Install LMA plugins. Configure LMA plugins.
3. Add 1(3) node(s) and assign LMA roles.
4. Deploy changes.
5. Check Grafana, Kibana and Nagios.

Actual result:
Metrics for OpenStack services was not provided in Grafana and Kibana. Almost all services were in UNKNOWN state in Nagios.

Expected result:
All metrics for all OpensStack services are present.

Revision history for this message
Simon Pasquier (simon-pasquier) wrote :

Please attach the Fuel diagnostic snapshot + the output of the LMA diagnostic command [1].

[1] http://fuel-plugin-lma-collector.readthedocs.io/en/latest/configure_plugin.html#diagnostic-tool

Changed in lma-toolchain:
status: New → Incomplete
Revision history for this message
Dmitry Kabanov (dkabanov) wrote :

Added Fuel diagnostic snapshot (fuel-snapshot-2016-08-09_23-45-44.tar.xz).

Revision history for this message
Dmitry Kabanov (dkabanov) wrote :

But I have a problem with LMA diagnostic tool. The LMA diagnostic seems to be stuck (I executed the command from fuel master node):

"[root@nailgun ~]# bash /var/www/nailgun/plugins/lma_collector-0.10/contrib/tools/diagnostic.sh
Running lma_diagnostic tool on all nodes which are ready and online (this can take several minutes)

"

I decided to run diagnostic on all nodes. And I see the same output on all non-LMA nodes:

"root@node-1:~# lma_diagnostics
lma_diagnostics: command not found"

You can find the output of the lma_diagnostics command from LMA node(s) in lma_diagnostic.log file.

Revision history for this message
Swann Croiset (swann-w) wrote :

for other nodes (controllers, computes, .) , the command should be there: /usr/local/bin/lma_diagnostics
can you check it exists and run it please.

Revision history for this message
Swann Croiset (swann-w) wrote :

the lma_diagnostics store diagnostic information in this directory:

/var/lma_diagnostics/

Revision history for this message
Dmitry Kabanov (dkabanov) wrote :

Thank you for your response. Unfortunately, I was not able to run the command. I can't find it:

root@node-1:~# find /usr/. -name 'lma_diagnostics'
root@node-1:~#

Revision history for this message
Simon Pasquier (simon-pasquier) wrote :

There's a limitation for post-deployment with MOS 8 that I forgot to mention although it's described in the documentation [1]:

> The StackLight Collector Plugin is a hot-pluggable plugin. Therefore, it is possible to install and
> deploy the collector in an environment that is already deployed. After the installation of the
> StackLight Collector Plugin, define the settings of the plugin and run the command shown below from
> the Fuel master node for every node of your deployment starting with the controller node(s):
>
> [root@nailgun ~]# fuel nodes --env <env_id> --node <node_id> --start \
> post_deployment_start --tasks hiera

Please run the command above and tell us if it fixes your issue.

[1] http://fuel-plugin-lma-collector.readthedocs.io/en/latest/configure_plugin.html#plugin-configuration

Revision history for this message
Dmitry Kabanov (dkabanov) wrote :

The command was run on all nodes except nodes with LMA. Unfortunately, the command finished unsuccessfully. And the cluster is in error state right now.

You can find the error message below:
"Could not find data item lma::collector::node_profiles in any Hiera data file and no default supplied at /etc/fuel/plugins/lma_collector-0.10/puppet/manifests/configure_apt.pp:33 on node node-1.test.domain.local"

Revision history for this message
Simon Pasquier (simon-pasquier) wrote :

The documentation has been updated to address this issue: https://review.openstack.org/#/c/353560/

Changed in lma-toolchain:
status: Incomplete → Fix Committed
milestone: none → 1.0.0
Changed in lma-toolchain:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.