CentOS 7 kilo,ceilometer meter-list with error:The service catalog is empty.

[Walter]

    I'm install ceilometer just follow the guide http://docs.openstack.org/kilo/install-guide/install/yum/content/.
    When I finish installing ceilometer and verify it with:ceilometer meter-list and it return: The service catalog is empty.
     cat central.log:
2015-05-15 22:53:14.873 25755 ERROR ceilometer.agent.base [-] Failed to import extension for rgw.usage: No module named awsauth
2015-05-15 22:53:14.877 25755 ERROR ceilometer.agent.base [-] Failed to import extension for rgw.containers.objects: No module named awsauth
2015-05-15 22:53:14.885 25755 ERROR ceilometer.agent.base [-] Failed to import extension for rgw.objects.size: No module named awsauth
2015-05-15 22:53:14.905 25755 ERROR ceilometer.agent.base [-] Failed to import extension for rgw.objects: No module named awsauth
2015-05-15 22:53:14.906 25755 ERROR ceilometer.agent.base [-] Failed to import extension for rgw.containers.objects.size: No module named awsauth
2015-05-15 22:53:14.911 25755 ERROR ceilometer.agent.base [-] Failed to import extension for rgw.objects.containers: No module named awsauth
2015-05-15 22:53:14.973 25755 INFO ceilometer.pipeline [-] Pipeline config: {'sources': [{'interval': 600, 'meters': ['*'], 'name': 'meter_source', 'sinks': ['meter_sink']}, {'interval': 600, 'meters': ['cpu'], 'name': 'cpu_source', 'sinks': ['cpu_sink']}, {'interval': 600, 'meters': ['disk.read.bytes', 'disk.read.requests', 'disk.write.bytes', 'disk.write.requests', 'disk.device.read.bytes', 'disk.device.read.requests', 'disk.device.write.bytes', 'disk.device.write.requests'], 'name': 'disk_source', 'sinks': ['disk_sink']}, {'interval': 600, 'meters': ['network.incoming.bytes', 'network.incoming.packets', 'network.outgoing.bytes', 'network.outgoing.packets'], 'name': 'network_source', 'sinks': ['network_sink']}], 'sinks': [{'publishers': ['notifier://'], 'transformers': None, 'name': 'meter_sink'}, {'publishers': ['notifier://'], 'transformers': [{'name': 'rate_of_change', 'parameters': {'target': {'scale': '100.0 / (10**9 * (resource_metadata.cpu_number or 1))', 'type': 'gauge', 'name': 'cpu_util', 'unit': '%'}}}], 'name': 'cpu_sink'}, {'publishers': ['notifier://'], 'transformers': [{'name': 'rate_of_change', 'parameters': {'source': {'map_from': {'name': '(disk\\.device|disk)\\.(read|write)\\.(bytes|requests)', 'unit': '(B|request)'}}, 'target': {'type': 'gauge', 'map_to': {'name': '\\1.\\2.\\3.rate', 'unit': '\\1/s'}}}}], 'name': 'disk_sink'}, {'publishers': ['notifier://'], 'transformers': [{'name': 'rate_of_change', 'parameters': {'source': {'map_from': {'name': 'network\\.(incoming|outgoing)\\.(bytes|packets)', 'unit': '(B|packet)'}}, 'target': {'type': 'gauge', 'map_to': {'name': 'network.\\1.\\2.rate', 'unit': '\\1/s'}}}}], 'name': 'network_sink'}]}
2015-05-15 22:53:14.977 25755 INFO ceilometer.pipeline [-] detected decoupled pipeline config format
2015-05-15 22:53:14.979 25755 INFO ceilometer.publisher.messaging [-] Publishing policy set to default
2015-05-15 22:53:14.997 25755 INFO ceilometer.publisher.messaging [-] Publishing policy set to default
2015-05-15 22:53:15.013 25755 INFO ceilometer.pipeline [-] Pipeline cpu_sink: Setup transformer instance rate_of_change with parameter {'target': {'scale': '100.0 / (10**9 * (resource_metadata.cpu_number or 1))', 'type': 'gauge', 'name': 'cpu_util', 'unit': '%'}}
2015-05-15 22:53:15.014 25755 INFO ceilometer.publisher.messaging [-] Publishing policy set to default
2015-05-15 22:53:15.028 25755 INFO ceilometer.pipeline [-] Pipeline disk_sink: Setup transformer instance rate_of_change with parameter {'source': {'map_from': {'name': '(disk\\.device|disk)\\.(read|write)\\.(bytes|requests)', 'unit': '(B|request)'}}, 'target': {'type': 'gauge', 'map_to': {'name': '\\1.\\2.\\3.rate', 'unit': '\\1/s'}}}
2015-05-15 22:53:15.029 25755 INFO ceilometer.publisher.messaging [-] Publishing policy set to default
2015-05-15 22:53:15.044 25755 INFO ceilometer.pipeline [-] Pipeline network_sink: Setup transformer instance rate_of_change with parameter {'source': {'map_from': {'name': 'network\\.(incoming|outgoing)\\.(bytes|packets)', 'unit': '(B|packet)'}}, 'target': {'type': 'gauge', 'map_to': {'name': 'network.\\1.\\2.rate', 'unit': '\\1/s'}}}
2015-05-15 22:53:15.207 25755 INFO ceilometer.agent.base [-] Polling pollster switch.table.active.entries in the context of meter_source
2015-05-15 22:53:15.208 25755 INFO ceilometer.agent.base [-] Skip polling pollster switch.table.active.entries, no resources found
2015-05-15 22:53:15.208 25755 INFO ceilometer.agent.base [-] Polling pollster switch.port.receive.crc_error in the context of meter_source
2015-05-15 22:53:15.209 25755 INFO ceilometer.agent.base [-] Skip polling pollster switch.port.receive.crc_error, no resources found
2015-05-15 22:53:15.209 25755 INFO ceilometer.agent.base [-] Polling pollster switch.port.receive.bytes in the context of meter_source
2015-05-15 22:53:15.210 25755 INFO ceilometer.agent.base [-] Skip polling pollster switch.port.receive.bytes, no resources found
2015-05-15 22:53:15.211 25755 INFO ceilometer.agent.base [-] Polling pollster storage.containers.objects.size in the context of meter_source
2015-05-15 22:53:15.256 25755 INFO ceilometer.agent.base [-] Polling pollster switch.port.receive.errors in the context of meter_source
2015-05-15 22:53:15.256 25755 INFO ceilometer.agent.base [-] Skip polling pollster switch.port.receive.errors, no resources found
2015-05-15 22:53:15.257 25755 INFO ceilometer.agent.base [-] Polling pollster hardware.cpu.load.5min in the context of meter_source
2015-05-15 22:53:15.794 25755 ERROR ceilometer.hardware.discovery [-] Couldn't obtain IP address of instance 02017109-2ae9-4f69-a5b2-7de1ad4a75fe
2015-05-15 22:53:15.794 25755 ERROR ceilometer.hardware.discovery [-] Couldn't obtain IP address of instance 8d5a3d8f-735b-4fe0-ad70-8b46671dd268
2015-05-15 22:53:15.795 25755 ERROR ceilometer.hardware.discovery [-] Couldn't obtain IP address of instance 00eaa119-d4a4-4706-aef6-cede6dd18ccd
2015-05-15 22:53:15.796 25755 INFO ceilometer.agent.base [-] Skip polling pollster hardware.cpu.load.5min, no resources found
2015-05-15 22:53:15.797 25755 INFO ceilometer.agent.base [-] Polling pollster energy in the context of meter_source
2015-05-15 22:53:15.798 25755 WARNING ceilometer.agent.discovery.endpoint [-] No endpoints found for service energy
2015-05-15 22:53:15.799 25755 INFO ceilometer.agent.base [-] Skip polling pollster energy, no resources found
2015-05-15 22:53:15.800 25755 INFO ceilometer.agent.base [-] Polling pollster hardware.network.ip.outgoing.datagrams in the context of meter_source
2015-05-15 22:53:15.800 25755 INFO ceilometer.agent.base [-] Skip polling pollster hardware.network.ip.outgoing.datagrams, no resources found
2015-05-15 22:53:15.801 25755 INFO ceilometer.agent.base [-] Polling pollster switch in the context of meter_source
2015-05-15 22:53:15.801 25755 INFO ceilometer.agent.base [-] Skip polling pollster switch, no resources found
2015-05-15 22:53:15.802 25755 INFO ceilometer.agent.base [-] Polling pollster hardware.network.ip.incoming.datagrams in the context of meter_source
2015-05-15 22:53:15.803 25755 INFO ceilometer.agent.base [-] Skip polling pollster hardware.network.ip.incoming.datagrams, no resources found
2015-05-15 22:53:15.803 25755 INFO ceilometer.agent.base [-] Polling pollster network.services.lb.member in the context of meter_source
2015-05-15 22:53:16.016 25755 WARNING ceilometer.neutron_client [-] 404 Not Found

The resource could not be found.

cat collector.log
2015-05-15 23:02:59.942 13491 ERROR oslo_messaging._drivers.impl_rabbit [-] Failed to consume message from queue:
2015-05-15 23:03:00.428 13491 ERROR oslo_messaging._drivers.impl_rabbit [-] Failed to consume message from queue:
2015-05-15 23:03:01.412 8613 INFO ceilometer.storage.mongo.utils [-] Connecting to mongodb on [('controllervip', 27017)]
2015-05-15 23:03:01.428 8613 INFO ceilometer.storage.mongo.utils [-] Connecting to mongodb on [('controllervip', 27017)]
2015-05-15 23:03:01.467 8613 INFO oslo_messaging._drivers.impl_rabbit [-] Connecting to AMQP server on controllervip:5672
2015-05-15 23:03:01.485 8613 INFO oslo_messaging._drivers.impl_rabbit [-] Connected to AMQP server on controllervip:5672
2015-05-15 23:03:01.494 8613 INFO oslo_messaging._drivers.impl_rabbit [-] Connecting to AMQP server on controllervip:5672
2015-05-15 23:03:01.511 8613 INFO oslo_messaging._drivers.impl_rabbit [-] Connected to AMQP server on controllervip:5672

cat alarm-evaluator.log
2015-05-15 23:03:00.635 8509 ERROR ceilometer.alarm.service [-] alarm evaluation cycle failed
2015-05-15 23:03:00.635 8509 TRACE ceilometer.alarm.service Traceback (most recent call last):
2015-05-15 23:03:00.635 8509 TRACE ceilometer.alarm.service File "/usr/lib/python2.7/site-packages/ceilometer/alarm/service.py", line 93, in _evaluate_assigned_alarms
2015-05-15 23:03:00.635 8509 TRACE ceilometer.alarm.service alarms = self._assigned_alarms()
2015-05-15 23:03:00.635 8509 TRACE ceilometer.alarm.service File "/usr/lib/python2.7/site-packages/ceilometer/alarm/service.py", line 151, in _assigned_alarms
2015-05-15 23:03:00.635 8509 TRACE ceilometer.alarm.service 'value': True}])
2015-05-15 23:03:00.635 8509 TRACE ceilometer.alarm.service File "/usr/lib/python2.7/site-packages/ceilometerclient/v2/alarms.py", line 77, in list
2015-05-15 23:03:00.635 8509 TRACE ceilometer.alarm.service return self._list(options.build_url(self._path(), q))
2015-05-15 23:03:00.635 8509 TRACE ceilometer.alarm.service File "/usr/lib/python2.7/site-packages/ceilometerclient/common/base.py", line 68, in _list
2015-05-15 23:03:00.635 8509 TRACE ceilometer.alarm.service resp = self.api.get(url)
2015-05-15 23:03:00.635 8509 TRACE ceilometer.alarm.service File "/usr/lib/python2.7/site-packages/ceilometerclient/openstack/common/apiclient/client.py", line 355, in get
2015-05-15 23:03:00.635 8509 TRACE ceilometer.alarm.service return self.client_request("GET", url, **kwargs)
2015-05-15 23:03:00.635 8509 TRACE ceilometer.alarm.service File "/usr/lib/python2.7/site-packages/ceilometerclient/openstack/common/apiclient/client.py", line 345, in client_request
2015-05-15 23:03:00.635 8509 TRACE ceilometer.alarm.service self, method, url, **kwargs)
2015-05-15 23:03:00.635 8509 TRACE ceilometer.alarm.service File "/usr/lib/python2.7/site-packages/ceilometerclient/openstack/common/apiclient/client.py", line 261, in client_request
2015-05-15 23:03:00.635 8509 TRACE ceilometer.alarm.service method, self.concat_url(endpoint, url), **kwargs)
2015-05-15 23:03:00.635 8509 TRACE ceilometer.alarm.service File "/usr/lib/python2.7/site-packages/ceilometerclient/openstack/common/apiclient/client.py", line 189, in request
2015-05-15 23:03:00.635 8509 TRACE ceilometer.alarm.service resp = self.http.request(method, url, **kwargs)
2015-05-15 23:03:00.635 8509 TRACE ceilometer.alarm.service File "/usr/lib/python2.7/site-packages/requests/sessions.py", line 465, in request
2015-05-15 23:03:00.635 8509 TRACE ceilometer.alarm.service resp = self.send(prep, **send_kwargs)
2015-05-15 23:03:00.635 8509 TRACE ceilometer.alarm.service File "/usr/lib/python2.7/site-packages/requests/sessions.py", line 573, in send
2015-05-15 23:03:00.635 8509 TRACE ceilometer.alarm.service r = adapter.send(request, **kwargs)
2015-05-15 23:03:00.635 8509 TRACE ceilometer.alarm.service File "/usr/lib/python2.7/site-packages/requests/adapters.py", line 415, in send
2015-05-15 23:03:00.635 8509 TRACE ceilometer.alarm.service raise ConnectionError(err, request=request)
2015-05-15 23:03:00.635 8509 TRACE ceilometer.alarm.service ConnectionError: ('Connection aborted.', error(111, 'ECONNREFUSED'))
2015-05-15 23:03:00.635 8509 TRACE ceilometer.alarm.service
2015-05-15 23:04:00.555 8509 INFO ceilometer.alarm.service [-] initiating evaluation cycle on 0 alarms

  Any ideas? Thanks in advance!

[ZhiQiang Fan (aji-zqfan)]

try： keystone endpoint-list ?

and this bug should be reported to openstack-manuals.

[Walter (walterxj)]

openstack endpoint list
+----------------------------------+-----------+--------------+----------------+
| ID | Region | Service Name | Service Type |
+----------------------------------+-----------+--------------+----------------+
| c4daceb75d2d4a1bbcdfa82792068b78 | RegionOne | nova | compute |
| 15f6e3ee2530414a83b0ed17be18e179 | RegionOne | neutron | network |
| 241acae2f82147e8a5191ed870fd3e93 | RegionOne | ceilometer | metering |
| a28959e4bc234840b6e0a54a6740b186 | RegionOne | glance | image |
| c7d0de63a4fd41d786357fc1ce1f3291 | RegionOne | cinder | volume |
| 1488d49520e244ca8e9cde2d2dc52923 | RegionOne | heat | orchestration |
| 814df8b46086449c8c301fab131ef0b0 | RegionOne | heat-cfn | cloudformation |
| e877546d226d41f6b8e0a18ec1f00fbf | RegionOne | keystone | identity |
| 76c661a46cda4091897235596c77aa7b | RegionOne | cinderv2 | volumev2 |
+----------------------------------+-----------+--------------+----------------+

[gordon chung (chungg)]

changing to incomplete. let's debug this a bit.

[Walter (walterxj)]

     I solve the problem by Kris Snoeijs's help.the problem lies in admin-openrc.sh,OS_USER_DOMAIN_ID and OS_PROJECT_DOMAIN_ID should be unset and the OS_AUTH_URL should be change from OS_AUTH_URL=http://controller:35357/v3 to OS_AUTH_URL=http://controllervip:35357

[Walter (walterxj)]

   I have solved this problem by Kris Snoeijs's help,the problem lies in admin-openrc.sh, OS_USER_DOMAIN_ID and OS_PROJECT_DOMAIN_ID should be unset,and OS_AUTH_URL should be changed from http://controller:35357/v3 to OS_AUTH_URL=http://controller:35357.
   After that,ceilometer meter-list ruturn the right output.

[ZhiQiang Fan (aji-zqfan)]

@walter

can you run `ceilometer --version` to get the version of pyhton-ceilometerclient?

[Walter (walterxj)]

@ZhiQiang Fan
ceilometer --version
1.0.13

[ZhiQiang Fan (aji-zqfan)]

@walter

python-ceilometerclient 1.0.13 has bug which cannot deal with keystone v3, this has already been fixed, see:

https://github.com/openstack/python-ceilometerclient/blob/1.0.13/ceilometerclient/client.py#L148
https://github.com/openstack/python-ceilometerclient/blob/6786f01aa0616143b0c24355564a30b979ebc26d/ceilometerclient/client.py#L151

[Walter (walterxj)]

Yes I finally know that.
But I want to know if I can fix this problem by just replace the client.py with https://raw.githubusercontent.com/openstack/python-ceilometerclient/1.0.13/ceilometerclient/client.py ? I'm not familiar with git.
Thank you.

walter
 From: ZhiQiang FanDate: 2015-05-25 16:08To: walterxjSubject: [Bug 1455848] Re: CentOS 7 kilo, ceilometer meter-list with error:The service catalog is empty.@walter

python-ceilometerclient 1.0.13 has bug which cannot deal with keystone
v3, this has already been fixed, see:

https://github.com/openstack/python-ceilometerclient/blob/1.0.13/ceilometerclient/client.py#L148
https://github.com/openstack/python-ceilometerclient/blob/6786f01aa0616143b0c24355564a30b979ebc26d/ceilometerclient/client.py#L151

** Changed in: ceilometer
       Status: Incomplete => Invalid

--
You received this bug notification because you are subscribed to the bug
report.
https://bugs.launchpad.net/bugs/1455848

Title:
  CentOS 7 kilo,ceilometer meter-list with error:The service catalog is
  empty.

Status in OpenStack Telemetry (Ceilometer):
  Invalid
Status in OpenStack Manuals:
  New

Bug description:
      I'm install ceilometer just follow the guide http://docs.openstack.org/kilo/install-guide/install/yum/content/.
      When I finish installing ceilometer and verify it with:ceilometer meter-list and it return: The service catalog is empty.
       cat central.log:
  2015-05-15 22:53:14.873 25755 ERROR ceilometer.agent.base [-] Failed to import extension for rgw.usage: No module named awsauth
  2015-05-15 22:53:14.877 25755 ERROR ceilometer.agent.base [-] Failed to import extension for rgw.containers.objects: No module named awsauth
  2015-05-15 22:53:14.885 25755 ERROR ceilometer.agent.base [-] Failed to import extension for rgw.objects.size: No module named awsauth
  2015-05-15 22:53:14.905 25755 ERROR ceilometer.agent.base [-] Failed to import extension for rgw.objects: No module named awsauth
  2015-05-15 22:53:14.906 25755 ERROR ceilometer.agent.base [-] Failed to import extension for rgw.containers.objects.size: No module named awsauth
  2015-05-15 22:53:14.911 25755 ERROR ceilometer.agent.base [-] Failed to import extension for rgw.objects.containers: No module named awsauth
  2015-05-15 22:53:14.973 25755 INFO ceilometer.pipeline [-] Pipeline config: {'sources': [{'interval': 600, 'meters': ['*'], 'name': 'meter_source', 'sinks': ['meter_sink']}, {'interval': 600, 'meters': ['cpu'], 'name': 'cpu_source', 'sinks': ['cpu_sink']}, {'interval': 600, 'meters': ['disk.read.bytes', 'disk.read.requests', 'disk.write.bytes', 'disk.write.requests', 'disk.device.read.bytes', 'disk.device.read.requests', 'disk.device.write.bytes', 'disk.device.write.requests'], 'name': 'disk_source', 'sinks': ['disk_sink']}, {'interval': 600, 'meters': ['network.incoming.bytes', 'network.incoming.packets', 'network.outgoing.bytes', 'network.outgoing.packets'], 'name': 'network_source', 'sinks': ['network_sink']}], 'sinks': [{'publishers': ['notifier://'], 'transformers': None, 'name': 'meter_sink'}, {'publishers': ['notifier://'], 'transformers': [{'name': 'rate_of_change', 'parameters': {'target': {'scale': '100.0 / (10*...

[Walter (walterxj)]

   Further more :Or I can update by yum update python-ceilometerclient?

[ZhiQiang Fan (aji-zqfan)]

@Walter

I'm not familiar with yum repo management (which means I don;t know if 1.0.13 is the newest one or not)

Currently we have individual branches in python-ceilometerclient for openstack releases, so if there is an update, I think update it may solve this problem (support keystone v3 environment variables)

maybe gordon chung can provide more information :)

[gordon chung (chungg)]

you can check the version of client in the repo using: sudo yum list python-ceilometerclient

most of the fixes are in 1.0.14 so you might need to use pip to install the appropriate version: http://docs.openstack.org/user-guide/common/cli_install_openstack_command_line_clients.html

[Walter (walterxj)]

Thank you for your information~

walter
 From: gordon chungDate: 2015-05-26 03:03To: walterxjSubject: [Bug 1455848] Re: CentOS 7 kilo, ceilometer meter-list with error:The service catalog is empty.you can check the version of client in the repo using: sudo yum list
python-ceilometerclient

most of the fixes are in 1.0.14 so you might need to use pip to install
the appropriate version: http://docs.openstack.org/user-
guide/common/cli_install_openstack_command_line_clients.html

--
You received this bug notification because you are subscribed to the bug
report.
https://bugs.launchpad.net/bugs/1455848

Title:
  CentOS 7 kilo,ceilometer meter-list with error:The service catalog is
  empty.

Status in OpenStack Telemetry (Ceilometer):
  Invalid
Status in OpenStack Manuals:
  New

Bug description:
      I'm install ceilometer just follow the guide http://docs.openstack.org/kilo/install-guide/install/yum/content/.
      When I finish installing ceilometer and verify it with:ceilometer meter-list and it return: The service catalog is empty.
       cat central.log:
  2015-05-15 22:53:14.873 25755 ERROR ceilometer.agent.base [-] Failed to import extension for rgw.usage: No module named awsauth
  2015-05-15 22:53:14.877 25755 ERROR ceilometer.agent.base [-] Failed to import extension for rgw.containers.objects: No module named awsauth
  2015-05-15 22:53:14.885 25755 ERROR ceilometer.agent.base [-] Failed to import extension for rgw.objects.size: No module named awsauth
  2015-05-15 22:53:14.905 25755 ERROR ceilometer.agent.base [-] Failed to import extension for rgw.objects: No module named awsauth
  2015-05-15 22:53:14.906 25755 ERROR ceilometer.agent.base [-] Failed to import extension for rgw.containers.objects.size: No module named awsauth
  2015-05-15 22:53:14.911 25755 ERROR ceilometer.agent.base [-] Failed to import extension for rgw.objects.containers: No module named awsauth
  2015-05-15 22:53:14.973 25755 INFO ceilometer.pipeline [-] Pipeline config: {'sources': [{'interval': 600, 'meters': ['*'], 'name': 'meter_source', 'sinks': ['meter_sink']}, {'interval': 600, 'meters': ['cpu'], 'name': 'cpu_source', 'sinks': ['cpu_sink']}, {'interval': 600, 'meters': ['disk.read.bytes', 'disk.read.requests', 'disk.write.bytes', 'disk.write.requests', 'disk.device.read.bytes', 'disk.device.read.requests', 'disk.device.write.bytes', 'disk.device.write.requests'], 'name': 'disk_source', 'sinks': ['disk_sink']}, {'interval': 600, 'meters': ['network.incoming.bytes', 'network.incoming.packets', 'network.outgoing.bytes', 'network.outgoing.packets'], 'name': 'network_source', 'sinks': ['network_sink']}], 'sinks': [{'publishers': ['notifier://'], 'transformers': None, 'name': 'meter_sink'}, {'publishers': ['notifier://'], 'transformers': [{'name': 'rate_of_change', 'parameters': {'target': {'scale': '100.0 / (10**9 * (resource_metadata.cpu_number or 1))', 'type': 'gauge', 'name': 'cpu_util', 'unit': '%'}}}], 'name': 'cpu_sink'}, {'publishers': ['notifier://'], 'transformers': [{'name': 'rate_of_change', 'parameters': {'source': {'map_from': {'name': '(disk\\.device|disk)\\.(read|write)\\.(bytes|requests)', 'unit': '(B|request)'}}, 'target': {'type': ...

[tung nguyen (nstung108)]

@ZhiQiang Fan
You saved my life! It works like a charm!