ceilometer agents have authentication errors shen started up

[Richard Su]

Look at the logs for ceilometer-agent-compute and ceilometer-agent-central. You will see this error message

Jan 25 01:45:47 undercloud-undercloud-37gnp6n5lxsr ceilometer-agent-compute[2710]: 2014-01-25 01:45:47.394 2710 TRACE ceilometer.compute.manager File "/opt/stack/venvs/ceilometer/lib/python2.7/site-packages/novaclient/client.py", line 189, in request
Jan 25 01:45:47 undercloud-undercloud-37gnp6n5lxsr ceilometer-agent-compute[2710]: 2014-01-25 01:45:47.394 2710 TRACE ceilometer.compute.manager raise exceptions.from_response(resp, body, url, method)
Jan 25 01:45:47 undercloud-undercloud-37gnp6n5lxsr ceilometer-agent-compute[2710]: 2014-01-25 01:45:47.394 2710 TRACE ceilometer.compute.manager Unauthorized: The request you have made requires authentication. (HTTP 401)
Jan 25 01:45:47 undercloud-undercloud-37gnp6n5lxsr ceilometer-agent-compute[2710]: 2014-01-25 01:45:47.394 2710 TRACE ceilometer.compute.manager

The agents won't work until the authentication error is resolved.

To resolve the authentication error the ceilometer endpoint needs to be created which will create the ceilometer user. Then the ceilometer user needs to be granted the admin role for the admin tenant. All of this needs to happen before the agent-compute/central is started up.

The ceilometer-api may also log an error indicating a table is missing. Seems dbsync is not running correctly.

To work around these problems, run these commands:

keystone user-role-add --user ceilometer --role admin --tenant admin
ssh heat-admin@$IP_ADDRESS "sudo
/opt/stack/venvs/ceilometer/bin/ceilometer-dbsync"
ssh heat-admin@$IP_ADDRESS "sudo service ceilometer-api restart"
ssh heat-admin@$IP_ADDRESS "sudo service ceilometer-collector restart"
ssh heat-admin@$IP_ADDRESS "sudo service ceilometer-agent-compute restart"
ssh heat-admin@$IP_ADDRESS "sudo service ceilometer-agent-central restart"
ssh heat-admin@$IP_ADDRESS "sudo service ceilometer-agent-notification
restart"

Maybe we can add these commands to a setup script similar to setup-neutron after the instance is up.

[Openstack Gerrit (openstack-gerrit)]

Reviewed: https://review.openstack.org/90840
Committed: https://git.openstack.org/cgit/openstack/tripleo-incubator/commit/?id=e532198a4f2a8373727748e3ecb7b79eeee027f0
Submitter: Jenkins
Branch: master

commit e532198a4f2a8373727748e3ecb7b79eeee027f0
Author: Phil Neal <email address hidden>
Date: Mon Apr 28 14:16:58 2014 -0700

    Fix Ceilometer agent auth errors on overcloud control
    node

    Adding scripting to add admin role to Ceilometer user
    after the service is started.

    Change-Id: Ia4a688044314d4e93645d9cf37decca8a9969f83
    Closes-Bug: #1272605