I use Openstack Swift (train) with Ceilometer + Gnocchi as telemetry service for billing.
json messages from swift proxy server to rabbitmq have no "project_id" and gnocchi creates new resource (named as filename instead of project_id) for every new file uploaded by S3. It means it creates directory structure on its storage and new row in mysql database.
Amount of space used by gnocchi highly increasing and there is no way to use these measures for billing, as they not attached to one project.
Message for swift api traffic:
{"message_id": "d2f54d0d-1ebe-48a6-9cfe-9aae7a01b407", "publisher_id": "ceilometermiddleware", "event_type": "objectstore.http.request", "priority": "INFO", "payload": {"typeURI": "http://schemas.dmtf.org/cloud/audit/1.0/event", "eventType": "activity", "id": "ef4a85f0-aed7-5909-8547-165139082c80", "eventTime": "2020-11-05T12:44:00.549474", "action": "update", "outcome": "success", "observer": {"id": "target"}, "initiator": {"id": "edf7a98ce8b54bb9844dbd8c41c3ba6a", "typeURI": "service/security/account/user", "project_id": "490a32b56ce94d71af7e3621b2034141"}, "target": {"id": "490a32b56ce94d71af7e3621b2034141", "typeURI": "service/storage/object", "metadata": {"path": "v1/AUTH_490a32b56ce94d71af7e3621b2034141/cont01/receipts/16816830/5fa3f38e0691a5fa3f38e06958.pdf", "version": "v1", "container": "cont01", "object": "receipts/16816830/5fa3f38e0691a5fa3f38e06958.pdf"}, "action": "put"}, "measurements": [{"result": 932311, "metric": {"metricId": "a7a13df1-bca6-5e2a-8a55-03949534a60c", "unit": "B", "name": "storage.objects.incoming.bytes"}}]}, "timestamp": "2020-11-05 12:44:00.550097", "_unique_id": "77e88300ba504b6ea178f236e2b119b5"}
I use Openstack Swift (train) with Ceilometer + Gnocchi as telemetry service for billing. 1ebe-48a6- 9cfe-9aae7a01b4 07", "publisher_id": "ceilometermidd leware" , "event_type": "objectstore. http.request" , "priority": "INFO", "payload": {"typeURI": "http:// schemas. dmtf.org/ cloud/audit/ 1.0/event", "eventType": "activity", "id": "ef4a85f0- aed7-5909- 8547-165139082c 80", "eventTime": "2020-11- 05T12:44: 00.549474" , "action": "update", "outcome": "success", "observer": {"id": "target"}, "initiator": {"id": "edf7a98ce8b54b b9844dbd8c41c3b a6a", "typeURI": "service/ security/ account/ user", "project_id": "490a32b56ce94d 71af7e3621b2034 141"}, "target": {"id": "490a32b56ce94d 71af7e3621b2034 141", "typeURI": "service/ storage/ object" , "metadata": {"path": "v1/AUTH_ 490a32b56ce94d7 1af7e3621b20341 41/cont01/ receipts/ 16816830/ 5fa3f38e0691a5f a3f38e06958. pdf", "version": "v1", "container": "cont01", "object": "receipts/ 16816830/ 5fa3f38e0691a5f a3f38e06958. pdf"}, "action": "put"}, "measurements": [{"result": 932311, "metric": {"metricId": "a7a13df1- bca6-5e2a- 8a55-03949534a6 0c", "unit": "B", "name": "storage. objects. incoming. bytes"} }]}, "timestamp": "2020-11-05 12:44:00.550097", "_unique_id": "77e88300ba504b 6ea178f236e2b11 9b5"}
json messages from swift proxy server to rabbitmq have no "project_id" and gnocchi creates new resource (named as filename instead of project_id) for every new file uploaded by S3. It means it creates directory structure on its storage and new row in mysql database.
Amount of space used by gnocchi highly increasing and there is no way to use these measures for billing, as they not attached to one project.
Message for swift api traffic:
{"message_id": "d2f54d0d-
Message for S3api traffic: 4204-4e03- ae85-3ba103276f a8", "publisher_id": "ceilometermidd leware" , "event_type": "objectstore. http.request" , "priority": "INFO", "payload": {"typeURI": "http:// schemas. dmtf.org/ cloud/audit/ 1.0/event", "eventType": "activity", "id": "0a07d96a- 0b7c-53d5- b499-8c912b6fdf e2", "eventTime": "2020-11- 05T13:07: 00.613230" , "action": "read", "outcome": "success", "observer": {"id": "target"}, "initiator": {"id": "354ca9fc- 446a-5b6e- a5c6-1d278fa4d6 c5", "typeURI": "service/ security/ account/ user", "project_id": null}, "target": {"id": "cont2/ greatoldones. jpg", "typeURI": "service/ storage/ object" , "metadata": {"path": "cont2/ greatoldones. jpg", "version": "cont2", "container": null, "object": null}, "action": "get"}, "measurements": [{"result": 216, "metric": {"metricId": "ec8f9a04- 2f38-5522- bba4-654292a86f ef", "unit": "B", "name": "storage. objects. outgoing. bytes"} }]}, "timestamp": "2020-11-05 13:07:00.614358", "_unique_id": "c096567ca9924b a89fa27eb818ecb 390"}
{"message_id": "13bf7e10-