Comment 22 for bug 2002902

Revision history for this message
Oskar (oxyash) wrote : Re: [Bug 2002902] Re: Prometheus integration - maping matrics and services - endpoint

Thank you
I'll check it all in new version and let you know how the things looks for me
Best

Oskar Korzeniecki

> On 31 Mar 2023, at 12:19, Boxiang Zhu <email address hidden> wrote:
>
> https://review.opendev.org/c/openstack/skyline-apiserver/+/868152
>
> I think the issue has been fixed by this commit. If possible, you can
> try to use the latest skyline images/codes.
>
> ** Changed in: skyline-apiserver
> Status: New => Fix Released
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/2002902
>
> Title:
> Prometheus integration - maping matrics and services - endpoint
>
> Status in skyline apiserver:
> Fix Released
>
> Bug description:
> Hi all
>
> i cant find any info how to setup all promehteus monitoring servies.
>
> What i find and succefully mange to do is:
>
> Hope this info will save some time to otheres :)
>
>
> 1. You need to install prometheus and then some srvices
>
> 2. Openstack Exporter - ttps://github.com/openstack-exporter - to get
> info about servies via system -
>
> 3. mysqld_exporter - https://github.com/prometheus/mysqld_exporter -
> sql stats
>
> 4. rabbitmq-plugins enable rabbitmq_prometheus -
> https://www.rabbitmq.com/prometheus.html
>
> 5. memcached_exporter -
> https://github.com/prometheus/memcached_exporter
>
> 6. openstack_sd_configs -
> https://prometheus.io/docs/prometheus/latest/configuration/configuration/
> - for instances or hypervisor graf
>
> 7. Get Gnocchi and Telemetry Service (Ceilometer) working for example
> https://www.server-
> world.info/en/note?os=Ubuntu_22.04&p=openstack_zed4&f=5
>
> 8. Install Prometheus Pushgateway - https://acloudguru.com/hands-on-
> labs/installing-prometheus-pushgateway
>
> 9. Send mertics to ptomehtrus form ceilometer
> https://docs.openstack.org/ceilometer/rocky/api/ceilometer.publisher.prometheus.html
>
>
> -------------------------------
> What is working fine till now and what not
>
>
> Other Services get all info about MySQL Memcache - RabbitMQ. !!!
>
> OpenStack Services - nova-scheduler Current StatusLast 24H Status
> - all sow fine
>
> Storage Clusters - Storage Cluster Status - Healthy - but its 0 ?
>
> Physical Nodes show only few info -
>
> CPU Cores
> 16
> Total Ram
> 78.45GiB
> System Running Time
> 8.37 min
> File System Free Space
> /dev/mapper/ubuntu--vg-ubuntu--lv/
> 75.89 GiB / 97.87 GiB
> 77.543%
> /dev/sda2/boot
> 1.66 GiB / 1.90 GiB
>
>
> Missing - empty
>
> CPU Usage(%)
> Memory Usage
> DISK IOPS
> DISK Usage(%)
>
>
>
>
> and i still cant get Monitor tab in instance to see cpu and memory resources
>
>
> What am i missing or what i nee to setup, map or enable to get it right.
>
>
> Below my prometheus confi
>
> global:
> scrape_interval: 15s
> scrape_timeout: 13s
> evaluation_interval: 15s
> external_labels:
> monitor: example
> alerting:
> alertmanagers:
> - follow_redirects: true
> scheme: http
> timeout: 10s
> api_version: v2
> static_configs:
> - targets:
> - localhost:9093
> scrape_configs:
> - job_name: prometheus
> honor_timestamps: true
> scrape_interval: 15s
> scrape_timeout: 13s
> metrics_path: /metrics
> scheme: https
> basic_auth:
> username: admin
> password: <secret>
> tls_config:
> cert_file: /etc/prometheus/fullchain.pem
> key_file: /etc/prometheus/server.key
> insecure_skip_verify: true
> follow_redirects: true
> static_configs:
> - targets:
> - localhost:9090
> - job_name: openstack_hypervisors
> honor_timestamps: true
> scrape_interval: 15s
> scrape_timeout: 13s
> metrics_path: /metrics
> scheme: http
> follow_redirects: true
> relabel_configs:
> - separator: ;
> regex: __meta_openstack_(.+)
> replacement: $1
> action: labelmap
> openstack_sd_configs:
> - identity_endpoint: https://xxxxxx:5000/v3/
> username: admin
> userid: ""
> password: <secret>
> project_name: admin
> project_id: ""
> domain_name: default
> domain_id: ""
> application_credential_name: ""
> application_credential_id: ""
> application_credential_secret: null
> role: hypervisor
> region: RegionOne
> refresh_interval: 1m
> port: 9100
> availability: public
> - job_name: openstack_instances
> honor_timestamps: true
> scrape_interval: 15s
> scrape_timeout: 13s
> metrics_path: /metrics
> scheme: http
> follow_redirects: true
> relabel_configs:
> - source_labels: [__meta_openstack_public_ip]
> separator: ;
> regex: (.*)
> target_label: __address__
> replacement: $1:9100
> action: replace
> - separator: ;
> regex: __meta_openstack_(.+)
> replacement: $1
> action: labelmap
> openstack_sd_configs:
> - identity_endpoint: https://xxxxx:5000/v3/
> username: admin
> userid: ""
> password: <secret>
> project_name: admin
> project_id: ""
> domain_name: default
> domain_id: ""
> application_credential_name: ""
> application_credential_id: ""
> application_credential_secret: null
> role: instance
> region: RegionOne
> refresh_interval: 1m
> port: 80
> availability: public
> - job_name: mysql
> honor_timestamps: true
> scrape_interval: 15s
> scrape_timeout: 13s
> metrics_path: /metrics
> scheme: http
> follow_redirects: true
> static_configs:
> - targets:
> - xxxxxh:9104
> - job_name: Pushgateway
> honor_labels: true
> honor_timestamps: true
> scrape_interval: 15s
> scrape_timeout: 13s
> metrics_path: /metrics
> scheme: http
> follow_redirects: true
> relabel_configs:
> - separator: ;
> regex: __meta_openstack_(.+)
> replacement: $1
> action: labelmap
> static_configs:
> - targets:
> - localhost:9091
> - job_name: memcached
> honor_timestamps: true
> scrape_interval: 15s
> scrape_timeout: 13s
> metrics_path: /metrics
> scheme: http
> follow_redirects: true
> static_configs:
> - targets:
> - xxxxx:9150
> - job_name: rabbitmq_exporter
> honor_timestamps: true
> scrape_interval: 15s
> scrape_timeout: 13s
> metrics_path: /metrics
> scheme: http
> follow_redirects: true
> static_configs:
> - targets:
> - pxxxx:15692
> - job_name: openstack_exporter
> honor_timestamps: true
> scrape_interval: 15s
> scrape_timeout: 13s
> metrics_path: /metrics
> scheme: http
> follow_redirects: true
> static_configs:
> - targets:
> - xxxxxh:9180
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/skyline-apiserver/+bug/2002902/+subscriptions
>
> Launchpad-Notification-Type: bug
> Launchpad-Bug: product=skyline-apiserver; status=Fix Released; importance=Undecided; assignee=xu.songfu@99cloud.net;
> Launchpad-Bug-Tags: monitor prometheus resources skyline
> Launchpad-Bug-Information-Type: Public
> Launchpad-Bug-Private: no
> Launchpad-Bug-Security-Vulnerability: no
> Launchpad-Bug-Commenters: bxzhu-5355 iauhsnaiq oxyash wangchen1 wu-wenxiang wuwu-wuwu
> Launchpad-Bug-Reporter: Oskar (oxyash)
> Launchpad-Bug-Modifier: Boxiang Zhu (bxzhu-5355)
> Launchpad-Message-Rationale: Subscriber
> Launchpad-Message-For: oxyash
>