Gnocchi statsd gets configured only on first controller in HA environment

Bug #1604708 reported by Marius Cornea
16
This bug affects 3 people
Affects Status Importance Assigned to Milestone
tripleo
Fix Released
High
Unassigned

Bug Description

Gnocchi statsd gets configured only on first controller in HA environment and it fails to start on the rest of 2 controllers:

Deploy command:

source ~/stackrc
export THT='/home/stack/tripleo-heat-templates'
openstack overcloud deploy --templates $THT \
-e $THT/environments/network-isolation.yaml \
-e $THT/environments/network-management.yaml \
-e ~/templates/network-environment.yaml \
-e $THT/environments/hyperconverged-ceph.yaml \
-e $THT/environments/puppet-ceph-devel.yaml \
-e $THT/environments/puppet-pacemaker.yaml \
-e ~/templates/disk-layout.yaml \
--control-scale 3 \
--control-flavor controller \
--compute-scale 3 \
--compute-flavor compute \
--ntp-server clock.redhat.com \
--libvirt-type qemu

on overcloud-controller-0:

[root@overcloud-controller-0 ~]# grep -v ^# /etc/gnocchi/gnocchi.conf | grep -v ^$
[DEFAULT]
log_dir = /var/log/gnocchi
[api]
max_limit = 1000
host=10.0.0.11
workers=4
port=8041
[archive_policy]
[cors]
[cors.subdomain]
[database]
[indexer]
url = mysql+pymysql://gnocchi:qjwaGYdYh9gtPfBTsW7QC2pgn@10.0.0.12/gnocchi
[metricd]
[oslo_middleware]
[oslo_policy]
policy_file = /etc/gnocchi/policy.json
[statsd]
resource_id = 0a8b55df-f90f-491c-8cb9-7cdecec6fc26
user_id = 27c0d3f8-e7ee-42f0-8317-72237d1c5ae3
project_id = 6c38cd8d-099a-4cb2-aecf-17be688e8616
archive_policy_name = low
flush_delay = 10
[storage]
driver = ceph
ceph_pool = metrics
ceph_username = openstack
ceph_keyring = /etc/ceph/ceph.client.openstack.keyring
ceph_conffile = /etc/ceph/ceph.conf
[keystone_authtoken]
auth_uri=http://10.0.0.12:5000/v2.0
identity_uri=http://192.168.0.15:35357
admin_user=gnocchi
admin_password=qjwaGYdYh9gtPfBTsW7QC2pgn
admin_tenant_name=service

On controller-1:

[root@overcloud-controller-1 ~]# grep -v ^# /etc/gnocchi/gnocchi.conf | grep -v ^$
[DEFAULT]
log_dir = /var/log/gnocchi
[api]
max_limit = 1000
host=10.0.0.10
workers=4
port=8041
[archive_policy]
[cors]
[cors.subdomain]
[database]
[indexer]
url = mysql+pymysql://gnocchi:qjwaGYdYh9gtPfBTsW7QC2pgn@10.0.0.12/gnocchi
[metricd]
[oslo_middleware]
[oslo_policy]
policy_file = /etc/gnocchi/policy.json
[statsd]
[storage]
driver = ceph
ceph_pool = metrics
ceph_username = openstack
ceph_keyring = /etc/ceph/ceph.client.openstack.keyring
ceph_conffile = /etc/ceph/ceph.conf
[keystone_authtoken]
auth_uri=http://10.0.0.12:5000/v2.0
identity_uri=http://192.168.0.15:35357
admin_user=gnocchi
admin_password=qjwaGYdYh9gtPfBTsW7QC2pgn
admin_tenant_name=service

The service fails to start on controller-1 and controller-2:

CRITICAL gnocchi [-] RequiredOptError: value required for option: statsd.resource_id
ERROR gnocchi Traceback (most recent call last):
ERROR gnocchi File "/usr/bin/gnocchi-statsd", line 10, in <module>
ERROR gnocchi sys.exit(statsd())
ERROR gnocchi File "/usr/lib/python2.7/site-packages/gnocchi/cli.py", line 70, in statsd
ERROR gnocchi statsd_service.start()
ERROR gnocchi File "/usr/lib/python2.7/site-packages/gnocchi/statsd.py", line 172, in start
ERROR gnocchi raise cfg.RequiredOptError(field, cfg.OptGroup("statsd"))
ERROR gnocchi RequiredOptError: value required for option: statsd.resource_id
ERROR gnocchi

Ben Nemec (bnemec)
Changed in tripleo:
status: New → Triaged
importance: Undecided → High
Revision history for this message
Ben Nemec (bnemec) wrote :

This is the patch that broke it: https://review.openstack.org/#/c/344513 It removed the gnocchi configuration completely from non-bootstrap nodes.

Revision history for this message
Pradeep Kilambi (pkilambi) wrote :
Changed in tripleo:
status: Triaged → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/puppet-tripleo 5.0.0.0b3

This issue was fixed in the openstack/puppet-tripleo 5.0.0.0b3 development milestone.

Ben Nemec (bnemec)
Changed in tripleo:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.