Gnocchi statsd gets configured only on first controller in HA environment

Bug #1604708 reported by Marius Cornea on 2016-07-20
16
This bug affects 3 people
Affects Status Importance Assigned to Milestone
tripleo
High
Unassigned

Bug Description

Gnocchi statsd gets configured only on first controller in HA environment and it fails to start on the rest of 2 controllers:

Deploy command:

source ~/stackrc
export THT='/home/stack/tripleo-heat-templates'
openstack overcloud deploy --templates $THT \
-e $THT/environments/network-isolation.yaml \
-e $THT/environments/network-management.yaml \
-e ~/templates/network-environment.yaml \
-e $THT/environments/hyperconverged-ceph.yaml \
-e $THT/environments/puppet-ceph-devel.yaml \
-e $THT/environments/puppet-pacemaker.yaml \
-e ~/templates/disk-layout.yaml \
--control-scale 3 \
--control-flavor controller \
--compute-scale 3 \
--compute-flavor compute \
--ntp-server clock.redhat.com \
--libvirt-type qemu

on overcloud-controller-0:

[root@overcloud-controller-0 ~]# grep -v ^# /etc/gnocchi/gnocchi.conf | grep -v ^$
[DEFAULT]
log_dir = /var/log/gnocchi
[api]
max_limit = 1000
host=10.0.0.11
workers=4
port=8041
[archive_policy]
[cors]
[cors.subdomain]
[database]
[indexer]
url = mysql+pymysql://gnocchi:qjwaGYdYh9gtPfBTsW7QC2pgn@10.0.0.12/gnocchi
[metricd]
[oslo_middleware]
[oslo_policy]
policy_file = /etc/gnocchi/policy.json
[statsd]
resource_id = 0a8b55df-f90f-491c-8cb9-7cdecec6fc26
user_id = 27c0d3f8-e7ee-42f0-8317-72237d1c5ae3
project_id = 6c38cd8d-099a-4cb2-aecf-17be688e8616
archive_policy_name = low
flush_delay = 10
[storage]
driver = ceph
ceph_pool = metrics
ceph_username = openstack
ceph_keyring = /etc/ceph/ceph.client.openstack.keyring
ceph_conffile = /etc/ceph/ceph.conf
[keystone_authtoken]
auth_uri=http://10.0.0.12:5000/v2.0
identity_uri=http://192.168.0.15:35357
admin_user=gnocchi
admin_password=qjwaGYdYh9gtPfBTsW7QC2pgn
admin_tenant_name=service

On controller-1:

[root@overcloud-controller-1 ~]# grep -v ^# /etc/gnocchi/gnocchi.conf | grep -v ^$
[DEFAULT]
log_dir = /var/log/gnocchi
[api]
max_limit = 1000
host=10.0.0.10
workers=4
port=8041
[archive_policy]
[cors]
[cors.subdomain]
[database]
[indexer]
url = mysql+pymysql://gnocchi:qjwaGYdYh9gtPfBTsW7QC2pgn@10.0.0.12/gnocchi
[metricd]
[oslo_middleware]
[oslo_policy]
policy_file = /etc/gnocchi/policy.json
[statsd]
[storage]
driver = ceph
ceph_pool = metrics
ceph_username = openstack
ceph_keyring = /etc/ceph/ceph.client.openstack.keyring
ceph_conffile = /etc/ceph/ceph.conf
[keystone_authtoken]
auth_uri=http://10.0.0.12:5000/v2.0
identity_uri=http://192.168.0.15:35357
admin_user=gnocchi
admin_password=qjwaGYdYh9gtPfBTsW7QC2pgn
admin_tenant_name=service

The service fails to start on controller-1 and controller-2:

CRITICAL gnocchi [-] RequiredOptError: value required for option: statsd.resource_id
ERROR gnocchi Traceback (most recent call last):
ERROR gnocchi File "/usr/bin/gnocchi-statsd", line 10, in <module>
ERROR gnocchi sys.exit(statsd())
ERROR gnocchi File "/usr/lib/python2.7/site-packages/gnocchi/cli.py", line 70, in statsd
ERROR gnocchi statsd_service.start()
ERROR gnocchi File "/usr/lib/python2.7/site-packages/gnocchi/statsd.py", line 172, in start
ERROR gnocchi raise cfg.RequiredOptError(field, cfg.OptGroup("statsd"))
ERROR gnocchi RequiredOptError: value required for option: statsd.resource_id
ERROR gnocchi

Ben Nemec (bnemec) on 2016-07-20
Changed in tripleo:
status: New → Triaged
importance: Undecided → High
Ben Nemec (bnemec) wrote :

This is the patch that broke it: https://review.openstack.org/#/c/344513 It removed the gnocchi configuration completely from non-bootstrap nodes.

Pradeep Kilambi (pkilambi) wrote :
Changed in tripleo:
status: Triaged → Fix Committed

This issue was fixed in the openstack/puppet-tripleo 5.0.0.0b3 development milestone.

Ben Nemec (bnemec) on 2017-08-25
Changed in tripleo:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers