Data is missing for Openstack services in StackLight Dashbords after the adding a new compute node
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Fuel for OpenStack |
Confirmed
|
Critical
|
Fuel Sustaining | ||
StackLight |
Invalid
|
Undecided
|
LMA-Toolchain Fuel Plugins |
Bug Description
Description of the environment:
StackLight 0.10.1
MOS: 8.0
OS: Ubuntu 14.04
Reference architecture: HA
Networking: Neutron + OVS
Tenant Network Isolation: VxLAN
Detailed bug description:
After the adding a new node StackLight Dashboards (Grafana, ES, Nagios) dont report metrics about OpenStack services.
We can guess that the root cause in the wrong sequence of puppet manifests
The correct sequence is:
2016-11-22 22:31:52 +0000 Scope(Class[main]) (notice): fuel-plugin-
2016-11-22 22:32:32 +0000 Scope(Class[main]) (notice): fuel-plugin-
2016-11-22 22:32:42 +0000 Scope(Class[main]) (notice): fuel-plugin-
2016-11-22 22:33:56 +0000 Scope(Class[main]) (notice): fuel-plugin-
2016-11-22 22:34:16 +0000 Scope(Class[main]) (notice): fuel-plugin-
2016-11-22 22:34:28 +0000 Scope(Class[main]) (notice): fuel-plugin-
2016-11-22 22:34:41 +0000 Scope(Class[main]) (notice): fuel-plugin-
The actual order is:
2016-11-22 23:33:47 +0000 Scope(Class[main]) (notice): fuel-plugin-
2016-11-22 23:37:07 +0000 Scope(Class[main]) (notice): fuel-plugin-
2016-11-22 23:37:29 +0000 Scope(Class[main]) (notice): fuel-plugin-
2016-11-22 23:39:10 +0000 Scope(Class[main]) (notice): fuel-plugin-
2016-11-22 23:40:08 +0000 Scope(Class[main]) (notice): fuel-plugin-
2016-11-22 23:40:21 +0000 Scope(Class[main]) (notice): fuel-plugin-
2016-11-22 23:40:34 +0000 Scope(Class[main]) (notice): fuel-plugin-
Steps to reproduce:
1. Deploy the cloud (3 controllers + 3 MongoDB + 3 contrail + 1 StackLight + 1 Ceph OSD + 2 Compute)
2. Remove 1 compute node (apply-changes)
3. Add 1 compute node (apply-changes)
Expected results:
Deployment finished successfully.
StackLight provides all information about the cloud and nodes.
Actual result:
Deployment finished successfully. (The cloud is in "operational" state and all tasks are in "ready" state)
StackLight provides information about the nodes. All metrics for openstack services were not provided.
Workaround:
We found a workaround for the issue. The next commands should be executed on nodes:
Controllers -
puppet apply -vd --modulepath=
Stacklight nodes -
puppet apply -vd --modulepath=
Changed in fuel: | |
milestone: | none → 8.0-updates |
Changed in fuel: | |
status: | New → Confirmed |
Changed in fuel: | |
importance: | Undecided → Critical |
Changed in lma-toolchain: | |
assignee: | nobody → LMA-Toolchain Fuel Plugins (mos-lma-toolchain) |
Changed in fuel: | |
status: | Confirmed → Invalid |
Changed in fuel: | |
assignee: | nobody → Fuel Sustaining (fuel-sustaining-team) |
Changed in fuel: | |
status: | Invalid → Confirmed |
Changed in lma-toolchain: | |
status: | New → Invalid |