Data is missing for Openstack services in StackLight Dashbords after the adding a new compute node

Bug #1644749 reported by Nadezhda Kabanova
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Confirmed
Critical
Fuel Sustaining
StackLight
Invalid
Undecided
LMA-Toolchain Fuel Plugins

Bug Description

Description of the environment:
StackLight 0.10.1
MOS: 8.0
OS: Ubuntu 14.04
Reference architecture: HA
Networking: Neutron + OVS
Tenant Network Isolation: VxLAN

Detailed bug description:
After the adding a new node StackLight Dashboards (Grafana, ES, Nagios) dont report metrics about OpenStack services.

We can guess that the root cause in the wrong sequence of puppet manifests
The correct sequence is:
2016-11-22 22:31:52 +0000 Scope(Class[main]) (notice): fuel-plugin-lma-collector: hiera_override.pp
2016-11-22 22:32:32 +0000 Scope(Class[main]) (notice): fuel-plugin-lma-collector: configure_apt.pp
2016-11-22 22:32:42 +0000 Scope(Class[main]) (notice): fuel-plugin-lma-collector: base.pp
2016-11-22 22:33:56 +0000 Scope(Class[main]) (notice): fuel-plugin-lma-collector: controller.pp
2016-11-22 22:34:16 +0000 Scope(Class[main]) (notice): fuel-plugin-lma-collector: aggregator.pp
2016-11-22 22:34:28 +0000 Scope(Class[main]) (notice): fuel-plugin-lma-collector: configure_afd_filters.pp
2016-11-22 22:34:41 +0000 Scope(Class[main]) (notice): fuel-plugin-lma-collector: cleanup_apt_config.pp
The actual order is:
2016-11-22 23:33:47 +0000 Scope(Class[main]) (notice): fuel-plugin-lma-collector: hiera_override.pp
2016-11-22 23:37:07 +0000 Scope(Class[main]) (notice): fuel-plugin-lma-collector: controller.pp
2016-11-22 23:37:29 +0000 Scope(Class[main]) (notice): fuel-plugin-lma-collector: configure_apt.pp
2016-11-22 23:39:10 +0000 Scope(Class[main]) (notice): fuel-plugin-lma-collector: base.pp
2016-11-22 23:40:08 +0000 Scope(Class[main]) (notice): fuel-plugin-lma-collector: aggregator.pp
2016-11-22 23:40:21 +0000 Scope(Class[main]) (notice): fuel-plugin-lma-collector: configure_afd_filters.pp
2016-11-22 23:40:34 +0000 Scope(Class[main]) (notice): fuel-plugin-lma-collector: cleanup_apt_config.pp

Steps to reproduce:
1. Deploy the cloud (3 controllers + 3 MongoDB + 3 contrail + 1 StackLight + 1 Ceph OSD + 2 Compute)
2. Remove 1 compute node (apply-changes)
3. Add 1 compute node (apply-changes)

Expected results:
Deployment finished successfully.
StackLight provides all information about the cloud and nodes.

Actual result:
Deployment finished successfully. (The cloud is in "operational" state and all tasks are in "ready" state)
StackLight provides information about the nodes. All metrics for openstack services were not provided.

Workaround:
We found a workaround for the issue. The next commands should be executed on nodes:
Controllers -
puppet apply -vd --modulepath=/etc/fuel/plugins/lma_collector-0.10/puppet/modules/:/etc/puppet/modules /etc/fuel/plugins/lma_collector-0.10/puppet/manifests/controller.pp

Stacklight nodes -
puppet apply -vd --modulepath=/etc/fuel/plugins/lma_collector-0.10/puppet/modules/:/etc/puppet/modules /etc/fuel/plugins/lma_collector-0.10/puppet/manifests/lma_backends.pp

Changed in fuel:
milestone: none → 8.0-updates
Changed in fuel:
status: New → Confirmed
Roman Rufanov (rrufanov)
Changed in fuel:
importance: Undecided → Critical
Changed in lma-toolchain:
assignee: nobody → LMA-Toolchain Fuel Plugins (mos-lma-toolchain)
Changed in fuel:
status: Confirmed → Invalid
Changed in fuel:
assignee: nobody → Fuel Sustaining (fuel-sustaining-team)
Changed in fuel:
status: Invalid → Confirmed
Swann Croiset (swann-w)
Changed in lma-toolchain:
status: New → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.