Comment 19 for bug 2002902

Revision history for this message
Oskar (oxyash) wrote : Re: [Bug 2002902] Re: Prometheus integration - maping matrics and services - endpoint

Hi
yes i have the bug it in fiefox and in some cases got 500 internal error

GET
     https://api/openstack/skyline/api/v1/query_range?query=avg by
(mode)(irate(node_cpu_seconds_total{instance="p:9100",mode=~"idle|system|user|iowait"}[30m]))
* 100&start=1678020774&end=1678024374&step=10
Status
500
Internal Server Error
VersionHTTP/2
Transferred206 B (21 B size)
Referrer Policystrict-origin-when-cross-origin

i think its is problem of range of qurty
start=1678020774&end=1678024374&step=10

ther is no value in my system from 1678020774 to 1678024374

can i modify it via appi ?
docs#/Prometheus/prometheus_query_range_api_v1_query_range_get

how i can change this value ?

Inline image

Oskar Korzeniecki

Inline image

503 35 28 35
22 102 17 08

<email address hidden>
https://chmura.tech/

  Jeśli wiadomość ta nie jest przeznaczona dla Pani/Pana, proszę
zawiadomić o tym nadawcę, a następnie ją skasować.

This message may contain private data sent to a specified receiver and
should not be used by a third party. If you are not the intended
receiver, please inform the sender and delete this e-mail message.

------ Original Message ------
From: "Shuai Qian" <email address hidden>
To: <email address hidden>
Sent: 02.03.2023 09:56:59
Subject: [Bug 2002902] Re: Prometheus integration - maping matrics and
services - endpoint

>In fact you could not get more details from log.
>
>Now we clear that your promethus works normally, that's a good thing.
>Then we shall make sure if there are something wrong in skyline-console.
>Please supply the request and response of skyline calling in browser debug tool.
>
>--
>You received this bug notification because you are subscribed to the bug
>report.
>https://bugs.launchpad.net/bugs/2002902
>
>Title:
> Prometheus integration - maping matrics and services - endpoint
>
>Status in skyline apiserver:
> New
>
>Bug description:
> Hi all
>
> i cant find any info how to setup all promehteus monitoring servies.
>
> What i find and succefully mange to do is:
>
> Hope this info will save some time to otheres :)
>
>
> 1. You need to install prometheus and then some srvices
>
> 2. Openstack Exporter - ttps://github.com/openstack-exporter - to get
> info about servies via system -
>
> 3. mysqld_exporter - https://github.com/prometheus/mysqld_exporter -
> sql stats
>
> 4. rabbitmq-plugins enable rabbitmq_prometheus -
>https://www.rabbitmq.com/prometheus.html
>
> 5. memcached_exporter -
>https://github.com/prometheus/memcached_exporter
>
> 6. openstack_sd_configs -
>https://prometheus.io/docs/prometheus/latest/configuration/configuration/
> - for instances or hypervisor graf
>
> 7. Get Gnocchi and Telemetry Service (Ceilometer) working for example
>https://www.server-
> world.info/en/note?os=Ubuntu_22.04&p=openstack_zed4&f=5
>
> 8. Install Prometheus Pushgateway - https://acloudguru.com/hands-on-
> labs/installing-prometheus-pushgateway
>
> 9. Send mertics to ptomehtrus form ceilometer
>https://docs.openstack.org/ceilometer/rocky/api/ceilometer.publisher.prometheus.html
>
>
> -------------------------------
> What is working fine till now and what not
>
>
> Other Services get all info about MySQL Memcache - RabbitMQ. !!!
>
> OpenStack Services - nova-scheduler Current StatusLast 24H Status
> - all sow fine
>
> Storage Clusters - Storage Cluster Status - Healthy - but its 0 ?
>
> Physical Nodes show only few info -
>
> CPU Cores
> 16
> Total Ram
> 78.45GiB
> System Running Time
> 8.37 min
> File System Free Space
> /dev/mapper/ubuntu--vg-ubuntu--lv/
> 75.89 GiB / 97.87 GiB
> 77.543%
> /dev/sda2/boot
> 1.66 GiB / 1.90 GiB
>
>
> Missing - empty
>
> CPU Usage(%)
> Memory Usage
> DISK IOPS
> DISK Usage(%)
>
>
>
>
> and i still cant get Monitor tab in instance to see cpu and memory resources
>
>
> What am i missing or what i nee to setup, map or enable to get it right.
>
>
> Below my prometheus confi
>
> global:
> scrape_interval: 15s
> scrape_timeout: 13s
> evaluation_interval: 15s
> external_labels:
> monitor: example
> alerting:
> alertmanagers:
> - follow_redirects: true
> scheme: http
> timeout: 10s
> api_version: v2
> static_configs:
> - targets:
> - localhost:9093
> scrape_configs:
> - job_name: prometheus
> honor_timestamps: true
> scrape_interval: 15s
> scrape_timeout: 13s
> metrics_path: /metrics
> scheme: https
> basic_auth:
> username: admin
> password: <secret>
> tls_config:
> cert_file: /etc/prometheus/fullchain.pem
> key_file: /etc/prometheus/server.key
> insecure_skip_verify: true
> follow_redirects: true
> static_configs:
> - targets:
> - localhost:9090
> - job_name: openstack_hypervisors
> honor_timestamps: true
> scrape_interval: 15s
> scrape_timeout: 13s
> metrics_path: /metrics
> scheme: http
> follow_redirects: true
> relabel_configs:
> - separator: ;
> regex: __meta_openstack_(.+)
> replacement: $1
> action: labelmap
> openstack_sd_configs:
> - identity_endpoint: https://xxxxxx:5000/v3/
> username: admin
> userid: ""
> password: <secret>
> project_name: admin
> project_id: ""
> domain_name: default
> domain_id: ""
> application_credential_name: ""
> application_credential_id: ""
> application_credential_secret: null
> role: hypervisor
> region: RegionOne
> refresh_interval: 1m
> port: 9100
> availability: public
> - job_name: openstack_instances
> honor_timestamps: true
> scrape_interval: 15s
> scrape_timeout: 13s
> metrics_path: /metrics
> scheme: http
> follow_redirects: true
> relabel_configs:
> - source_labels: [__meta_openstack_public_ip]
> separator: ;
> regex: (.*)
> target_label: __address__
> replacement: $1:9100
> action: replace
> - separator: ;
> regex: __meta_openstack_(.+)
> replacement: $1
> action: labelmap
> openstack_sd_configs:
> - identity_endpoint: https://xxxxx:5000/v3/
> username: admin
> userid: ""
> password: <secret>
> project_name: admin
> project_id: ""
> domain_name: default
> domain_id: ""
> application_credential_name: ""
> application_credential_id: ""
> application_credential_secret: null
> role: instance
> region: RegionOne
> refresh_interval: 1m
> port: 80
> availability: public
> - job_name: mysql
> honor_timestamps: true
> scrape_interval: 15s
> scrape_timeout: 13s
> metrics_path: /metrics
> scheme: http
> follow_redirects: true
> static_configs:
> - targets:
> - xxxxxh:9104
> - job_name: Pushgateway
> honor_labels: true
> honor_timestamps: true
> scrape_interval: 15s
> scrape_timeout: 13s
> metrics_path: /metrics
> scheme: http
> follow_redirects: true
> relabel_configs:
> - separator: ;
> regex: __meta_openstack_(.+)
> replacement: $1
> action: labelmap
> static_configs:
> - targets:
> - localhost:9091
> - job_name: memcached
> honor_timestamps: true
> scrape_interval: 15s
> scrape_timeout: 13s
> metrics_path: /metrics
> scheme: http
> follow_redirects: true
> static_configs:
> - targets:
> - xxxxx:9150
> - job_name: rabbitmq_exporter
> honor_timestamps: true
> scrape_interval: 15s
> scrape_timeout: 13s
> metrics_path: /metrics
> scheme: http
> follow_redirects: true
> static_configs:
> - targets:
> - pxxxx:15692
> - job_name: openstack_exporter
> honor_timestamps: true
> scrape_interval: 15s
> scrape_timeout: 13s
> metrics_path: /metrics
> scheme: http
> follow_redirects: true
> static_configs:
> - targets:
> - xxxxxh:9180
>
>To manage notifications about this bug go to:
>https://bugs.launchpad.net/skyline-apiserver/+bug/2002902/+subscriptions
>
>Launchpad-Notification-Type: bug
>Launchpad-Bug: product=skyline-apiserver; status=New; importance=Undecided; assignee=xu.songfu@99cloud.net;
>Launchpad-Bug-Tags: monitor prometheus resources skyline
>Launchpad-Bug-Information-Type: Public
>Launchpad-Bug-Private: no
>Launchpad-Bug-Security-Vulnerability: no
>Launchpad-Bug-Commenters: bxzhu-5355 iauhsnaiq oxyash wangchen1 wu-wenxiang wuwu-wuwu
>Launchpad-Bug-Reporter: Oskar (oxyash)
>Launchpad-Bug-Modifier: Shuai Qian (iauhsnaiq)
>Launchpad-Message-Rationale: Subscriber
>Launchpad-Message-For: oxyash
>