Lianhao lu,

That will be a great and elegant solution to this issue, ading a new
resource type in gnocchi to register snmp metrics, with the possibility to
add metadata like hostname.

Just let us know how it goes and how can we help.
On Dec 15, 2015 9:06 PM, "Lianhao Lu" <email address hidden> wrote:

> I'm looking at this kind of things, i'll write up an email to discuss in
> details. Basically speaking,  the snmp related metrics encounter the
> same problem as the instance metric disk.device.*, as both of these adds
> 'suffix' to its resource_id.
>
> Maybe we should create new types of resource in gnocchi here for snmp
> metrics.
>
> As for using the same resource_id for all metrics for different
> disk/interface within an VM instance/machine,  I'll write up an email to
> discuss this
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1518338
>
> Title:
>   Ceilometer doesn't build the data correclty for Gnocchi when you send
>   hypervisors HW metrics using snmpd and agent-central
>
> Status in Ceilometer:
>   In Progress
>
> Bug description:
>
>   If you are pushing data from the hypervisors using snmpd and the
> ceilometer agent-central to gnocchi, ceilometer does not append the real ID
> of the hypervisor to the metric, instead ceilometer assign a random UUID to
> each metric that does not correspond to any existent compute-node.
>   The hypervisor ID in nova is an integer as you can see here :
>
>   root@cetz-sm01:~# nova hypervisor-list
>   +----+---------------------+-------+---------+
>   | ID | Hypervisor hostname | State | Status  |
>   +----+---------------------+-------+---------+
>   | 2  | cetz-sm01           | up    | enabled |
>   | 5  | cetz-sm02           | up    | enabled |
>   +----+---------------------+-------+---------+
>
>   This is my snmpd config in the ceilometer collector server  (
>   /etc/ceilometer/pipeline.yaml ) :
>
>       - name: meter_snmp
>         interval: 60
>         resources:
>             - snmp://192.168.90.11
>             - snmp://192.168.90.10
>         meters:
>             - "hardware.cpu*"
>             - "hardware.memory*"
>             - "hardware.disk*"
>             - "hardware.network*"
>             - "hardware.system_stats*"
>         sinks:
>             - meter_sink
>
>   And This is the resource mapping to push metrics to gnocchi (
>   /etc/ceilometer/gnocchi_resources.yaml ):
>
>     - resource_type: generic
>       metrics:
>         - 'hardware.cpu.load.15min'
>         - 'hardware.cpu.load.1min'
>         - 'hardware.cpu.load.5min'
>         - 'hardware.disk.size.total'
>         - 'hardware.disk.size.used'
>         - 'hardware.memory.swap.avail'
>         - 'hardware.memory.swap.total'
>         - 'hardware.memory.total'
>         - 'hardware.memory.used'
>         - 'hardware.network.incoming.bytes'
>         - 'hardware.network.ip.incoming.datagrams'
>         - 'hardware.network.ip.outgoing.datagrams'
>         - 'hardware.network.outgoing.bytes'
>         - 'hardware.network.outgoing.errors'
>
>
>    ceilometer creates different resources for each metric in gnocchi, and
> not just only one for all metrics belonging the same hypervisor. Another
> issue is the hypervisor ID does not correspond to any hypervisor in NOVA.
>
>
>   root@cetz-sm01:~# gnocchi resource list
>
>
>   | d8fc1dc0-27d6-534d-bff8-f6c9e1939781 | generic                    |
> None                                 | None
>  | 2015-11-19T12:34:38.531331+00:00 | None     |
> 2015-11-19T12:34:38.531366+00:00 | None         |
>   | d7806bbf-0fbb-558e-8aea-37473214ade5 | generic                    |
> None                                 | None
>  | 2015-11-19T20:59:56.762264+00:00 | None     |
> 2015-11-19T20:59:56.762314+00:00 | None         |
>   | 4075ed44-31d7-57be-a6af-1910877f279e | generic                    |
> None                                 | None
>  | 2015-11-19T20:59:57.832450+00:00 | None     |
> 2015-11-19T20:59:57.832495+00:00 | None         |
>   | a1fdc527-8346-5a9b-a6b1-59be2fd9f218 | generic                    |
> None                                 | None
>  | 2015-11-19T21:00:18.218477+00:00 | None     |
> 2015-11-19T21:00:18.218518+00:00 | None         |
>   | bdc61097-b675-55cd-a17e-ff00b756fa06 | generic                    |
> None                                 | None
>  | 2015-11-19T21:00:28.795618+00:00 | None     |
> 2015-11-19T21:00:28.795659+00:00 | None         |
>   | 229d4c12-790b-5b6f-90f4-415b74b64cbb | generic                    |
> None                                 | None
>  | 2015-11-19T21:00:36.456317+00:00 | None     |
> 2015-11-19T21:00:36.456362+00:00 | None         |
>   | 3a9f405e-e830-527e-8f20-063c03935144 | generic                    |
> None                                 | None
>  | 2015-11-19T21:00:53.059079+00:00 | None     |
> 2015-11-19T21:00:53.059130+00:00 | None         |
>   | c73295ca-ad91-5441-b8ee-b80bac3a58ed | generic                    |
> None                                 | None
>  | 2015-11-19T21:00:56.299878+00:00 | None     |
> 2015-11-19T21:00:56.299920+00:00 | None         |
>   | 1c167117-1d84-55c0-9b86-3f1c2f061e06 | generic                    |
> None                                 | None
>  | 2015-11-19T21:01:13.712577+00:00 | None     |
> 2015-11-19T21:01:13.712621+00:00 | None         |
>   | 8bd2c2e1-036a-52da-91c8-5a9607c385d7 | generic                    |
> None                                 | None
>  | 2015-11-19T21:01:37.317445+00:00 | None     |
> 2015-11-19T21:01:37.317489+00:00 | None         |
>   | f0d16401-4f49-50f0-b362-33f9aa39fd0e | generic                    |
> None                                 | None
>  | 2015-11-19T21:01:56.931716+00:00 | None     |
> 2015-11-19T21:01:56.931757+00:00 | None         |
>   | 41628f39-562b-5788-b338-5676e9323ba5 | generic                    |
> None                                 | None
>  | 2015-11-19T21:02:19.302406+00:00 | None     |
> 2015-11-19T21:02:19.302448+00:00 | None         |
>   | 16758503-4e1f-5a50-87e4-ef47f22cd245 | generic                    |
> None                                 | None
>  | 2015-11-19T21:02:40.522154+00:00 | None     |
> 2015-11-19T21:02:40.522197+00:00 | None         |
>   | 85140a9c-a85f-5bed-aa8a-4ca6ff4cd880 | generic                    |
> None                                 | None
>  | 2015-11-19T21:02:59.574454+00:00 | None     |
> 2015-11-19T21:02:59.574496+00:00 | None         |
>   | d5c8c604-b876-54f8-9812-c00512c0d0ce | generic                    |
> None                                 | None
>  | 2015-11-19T21:03:23.725890+00:00 | None     |
> 2015-11-19T21:03:23.725933+00:00 | None         |
>   | b3592e92-026c-5c92-a592-b934d8d6510b | generic                    |
> None                                 | None
>  | 2015-11-19T21:03:44.441289+00:00 | None     |
> 2015-11-19T21:03:44.441332+00:00 | None         |
>   | bd4739ef-7703-507a-ad52-286172241196 | generic                    |
> None                                 | None
>  | 2015-11-19T21:04:09.852800+00:00 | None     |
> 2015-11-19T21:04:09.852842+00:00 | None         |
>   | c744633a-dd04-5e71-9bc0-288b4bb15b49 | generic                    |
> None                                 | None
>  | 2015-11-19T21:04:28.709258+00:00 | None     |
> 2015-11-19T21:04:28.709300+00:00 | None         |
>   | 808b6254-8653-51eb-aa67-12da9fc20046 | generic                    |
> None                                 | None
>  | 2015-11-19T21:04:50.606866+00:00 | None     |
> 2015-11-19T21:04:50.606912+00:00 | None         |
>   | 3b92b037-1819-5bb5-b9af-43b6ac96cb7b | generic                    |
> None                                 | None
>  | 2015-11-19T21:05:09.402143+00:00 | None     |
> 2015-11-19T21:05:09.402187+00:00 | None         |
>   | 2e96c8f8-5cd5-597a-9b53-a6494c63b269 | generic                    |
> None                                 | None
>  | 2015-11-19T21:05:27.180785+00:00 | None     |
> 2015-11-19T21:05:27.180828+00:00 | None         |
>   | a3116803-fbaa-5d1e-8bce-766b97077664 | generic                    |
> None                                 | None
>  | 2015-11-19T21:05:46.993115+00:00 | None     |
> 2015-11-19T21:05:46.993160+00:00 | None         |
>   | f31c60bb-31e9-5dc6-98e4-64e78564bddb | generic                    |
> None                                 | None
>  | 2015-11-19T21:06:07.460520+00:00 | None     |
> 2015-11-19T21:06:07.460563+00:00 | None         |
>   | 27be2c09-d5af-577a-b570-31313cafd64d | generic                    |
> None                                 | None
>  | 2015-11-19T21:06:25.608790+00:00 | None     |
> 2015-11-19T21:06:25.608834+00:00 | None         |
>   | c2d359e6-d3ea-5673-a2d4-be0f6c5c20bf | generic                    |
> None                                 | None
>  | 2015-11-19T21:06:46.411939+00:00 | None     |
> 2015-11-19T21:06:46.411982+00:00 | None         |
>   | 31d35ec0-4d89-5961-8b01-5a91c19b30a1 | generic                    |
> None                                 | None
>  | 2015-11-19T21:07:08.202977+00:00 | None     |
> 2015-11-19T21:07:08.203020+00:00 | None         |
>   | 50fb847e-ebeb-55a2-a155-44564231ea1d | generic                    |
> None                                 | None
>  | 2015-11-19T21:07:26.167399+00:00 | None     |
> 2015-11-19T21:07:26.167441+00:00 | None         |
>   | 43a165ee-242f-536c-b835-68b8c6c12d78 | generic                    |
> None                                 | None
>  | 2015-11-19T21:07:47.795845+00:00 | None     |
> 2015-11-19T21:07:47.795888+00:00 | None         |
>   | 01bd97ac-eb63-5d48-8fff-a5848097bb2e | generic                    |
> None                                 | None
>  | 2015-11-19T21:08:09.342526+00:00 | None     |
> 2015-11-19T21:08:09.342569+00:00 | None         |
>   | 2bfdb1ab-bb57-5b3a-b47e-689bc2907db3 | generic                    |
> None                                 | None
>  | 2015-11-19T21:08:30.230004+00:00 | None     |
> 2015-11-19T21:08:30.230046+00:00 | None         |
>   | 9b492c78-5a9e-5ce0-9392-9724299e0b53 | generic                    |
> None                                 | None
>  | 2015-11-19T21:08:51.576571+00:00 | None     |
> 2015-11-19T21:08:51.576617+00:00 | None         |
>   | 483bb688-4ea3-56a5-8271-88a6392693a0 | generic                    |
> None                                 | None
>  | 2015-11-19T21:09:12.032914+00:00 | None     |
> 2015-11-19T21:09:12.032958+00:00 | None         |
>   | bad3f034-83c7-5c78-89a4-f643bb44fbd1 | generic                    |
> None                                 | None
>  | 2015-11-19T21:09:28.005918+00:00 | None     |
> 2015-11-19T21:09:28.005960+00:00 | None         |
>   | 9e5946fd-73ff-5e3c-a889-d6081a74fc63 | generic                    |
> None                                 | None
>  | 2015-11-19T21:09:49.952618+00:00 | None     |
> 2015-11-19T21:09:49.952662+00:00 | None         |
>   | 5b417143-2e3a-5b8d-b7b1-36e697ac9392 | generic                    |
> None                                 | None
>  | 2015-11-19T21:10:15.150349+00:00 | None     |
> 2015-11-19T21:10:15.150392+00:00 | None         |
>
> +--------------------------------------+----------------------------+--------
>
>
>   it seems like Ceilometer doesn't build the data correclty for Gnocchi
>   when push HW metrics.
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/ceilometer/+bug/1518338/+subscriptions
>