Prometheus integration - maping matrics and services - endpoint

Bug #2002902 reported by Oskar
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
skyline apiserver
Fix Released
Undecided
xusongfu

Bug Description

Hi all

i cant find any info how to setup all promehteus monitoring servies.

What i find and succefully mange to do is:

Hope this info will save some time to otheres :)

1. You need to install prometheus and then some srvices

2. Openstack Exporter - ttps://github.com/openstack-exporter - to get info about servies via system -

3. mysqld_exporter - https://github.com/prometheus/mysqld_exporter - sql stats

4. rabbitmq-plugins enable rabbitmq_prometheus - https://www.rabbitmq.com/prometheus.html

5. memcached_exporter - https://github.com/prometheus/memcached_exporter

6. openstack_sd_configs - https://prometheus.io/docs/prometheus/latest/configuration/configuration/ - for instances or hypervisor graf

7. Get Gnocchi and Telemetry Service (Ceilometer) working for example https://www.server-world.info/en/note?os=Ubuntu_22.04&p=openstack_zed4&f=5

8. Install Prometheus Pushgateway - https://acloudguru.com/hands-on-labs/installing-prometheus-pushgateway

9. Send mertics to ptomehtrus form ceilometer https://docs.openstack.org/ceilometer/rocky/api/ceilometer.publisher.prometheus.html

-------------------------------
What is working fine till now and what not

Other Services get all info about MySQL Memcache - RabbitMQ. !!!

OpenStack Services - nova-scheduler Current StatusLast 24H Status - all sow fine

Storage Clusters - Storage Cluster Status - Healthy - but its 0 ?

Physical Nodes show only few info -

CPU Cores
16
Total Ram
78.45GiB
System Running Time
8.37 min
File System Free Space
/dev/mapper/ubuntu--vg-ubuntu--lv/
75.89 GiB / 97.87 GiB
77.543%
/dev/sda2/boot
1.66 GiB / 1.90 GiB

Missing - empty

CPU Usage(%)
Memory Usage
DISK IOPS
DISK Usage(%)

and i still cant get Monitor tab in instance to see cpu and memory resources

What am i missing or what i nee to setup, map or enable to get it right.

Below my prometheus confi

global:
  scrape_interval: 15s
  scrape_timeout: 13s
  evaluation_interval: 15s
  external_labels:
    monitor: example
alerting:
  alertmanagers:
  - follow_redirects: true
    scheme: http
    timeout: 10s
    api_version: v2
    static_configs:
    - targets:
      - localhost:9093
scrape_configs:
- job_name: prometheus
  honor_timestamps: true
  scrape_interval: 15s
  scrape_timeout: 13s
  metrics_path: /metrics
  scheme: https
  basic_auth:
    username: admin
    password: <secret>
  tls_config:
    cert_file: /etc/prometheus/fullchain.pem
    key_file: /etc/prometheus/server.key
    insecure_skip_verify: true
  follow_redirects: true
  static_configs:
  - targets:
    - localhost:9090
- job_name: openstack_hypervisors
  honor_timestamps: true
  scrape_interval: 15s
  scrape_timeout: 13s
  metrics_path: /metrics
  scheme: http
  follow_redirects: true
  relabel_configs:
  - separator: ;
    regex: __meta_openstack_(.+)
    replacement: $1
    action: labelmap
  openstack_sd_configs:
  - identity_endpoint: https://xxxxxx:5000/v3/
    username: admin
    userid: ""
    password: <secret>
    project_name: admin
    project_id: ""
    domain_name: default
    domain_id: ""
    application_credential_name: ""
    application_credential_id: ""
    application_credential_secret: null
    role: hypervisor
    region: RegionOne
    refresh_interval: 1m
    port: 9100
    availability: public
- job_name: openstack_instances
  honor_timestamps: true
  scrape_interval: 15s
  scrape_timeout: 13s
  metrics_path: /metrics
  scheme: http
  follow_redirects: true
  relabel_configs:
  - source_labels: [__meta_openstack_public_ip]
    separator: ;
    regex: (.*)
    target_label: __address__
    replacement: $1:9100
    action: replace
  - separator: ;
    regex: __meta_openstack_(.+)
    replacement: $1
    action: labelmap
  openstack_sd_configs:
  - identity_endpoint: https://xxxxx:5000/v3/
    username: admin
    userid: ""
    password: <secret>
    project_name: admin
    project_id: ""
    domain_name: default
    domain_id: ""
    application_credential_name: ""
    application_credential_id: ""
    application_credential_secret: null
    role: instance
    region: RegionOne
    refresh_interval: 1m
    port: 80
    availability: public
- job_name: mysql
  honor_timestamps: true
  scrape_interval: 15s
  scrape_timeout: 13s
  metrics_path: /metrics
  scheme: http
  follow_redirects: true
  static_configs:
  - targets:
    - xxxxxh:9104
- job_name: Pushgateway
  honor_labels: true
  honor_timestamps: true
  scrape_interval: 15s
  scrape_timeout: 13s
  metrics_path: /metrics
  scheme: http
  follow_redirects: true
  relabel_configs:
  - separator: ;
    regex: __meta_openstack_(.+)
    replacement: $1
    action: labelmap
  static_configs:
  - targets:
    - localhost:9091
- job_name: memcached
  honor_timestamps: true
  scrape_interval: 15s
  scrape_timeout: 13s
  metrics_path: /metrics
  scheme: http
  follow_redirects: true
  static_configs:
  - targets:
    - xxxxx:9150
- job_name: rabbitmq_exporter
  honor_timestamps: true
  scrape_interval: 15s
  scrape_timeout: 13s
  metrics_path: /metrics
  scheme: http
  follow_redirects: true
  static_configs:
  - targets:
    - pxxxx:15692
- job_name: openstack_exporter
  honor_timestamps: true
  scrape_interval: 15s
  scrape_timeout: 13s
  metrics_path: /metrics
  scheme: http
  follow_redirects: true
  static_configs:
  - targets:
    - xxxxxh:9180

Revision history for this message
Oskar (oxyash) wrote :
Changed in skyline-apiserver:
assignee: nobody → wang.chen (wangchen1)
Revision history for this message
wang.chen (wangchen1) wrote :

Hello,The configuration items that need to be modified to connect skyline to prometheus are as follows.The file address is /etc/skyline/skyline.yaml.

default:
  prometheus_basic_auth_password: ''
  prometheus_basic_auth_user: ''
  prometheus_enable_basic_auth: false
  prometheus_endpoint: http://localhost:9091

Revision history for this message
Oskar (oxyash) wrote :

thank for answer yes its true connection to Prometheus need to be setup in this file /etc/skyline/skyline.yaml

but nobody know what exporter and what metrics and what port need to be setup in Prometheus to get tis working with skyline

As i write above i find some services, what do you need to get some of the functionality but not all of them.

I think for sure everybody need info how to get monitor tab in instance section.

Thanks

Revision history for this message
Oskar (oxyash) wrote :

any news about it ?

Revision history for this message
Wu Wenxiang (wu-wenxiang) wrote :

This 2 week is Chinese New Year (Spring Festival), developers are on vacation.
Wang Chen will come back at Feb 1st. Reassign to Jinwei Zhang

Skyline API server will forward PromQL to Prometheus service according to the prometheus_endpoint var in skyline.yaml. Query & Query_Range https://opendev.org/openstack/skyline-apiserver/src/branch/master/skyline_apiserver/api/v1/prometheus.py#L97

According to your questions, you want to know how to show the "Monitor tab" about instances, right?

Changed in skyline-apiserver:
assignee: wang.chen (wangchen1) → Jingwei Zhang (iceboal)
Revision history for this message
Oskar (oxyash) wrote : Re: [Bug 2002902] Re: Prometheus integration - maping matrics and services - endpoint
Download full text (7.7 KiB)

Hi
Yes correct I want to enable this tab and don't know how to do it
Witch metrics need to be send
And do I need to create openstck endpoint for Prometheus ? Or it can get query form metrics via default link/ dashboard if Prometheus
Thanks for info

Oskar Korzeniecki

> On 28 Jan 2023, at 14:45, Wu Wenxiang <email address hidden> wrote:
>
> This 2 week is Chinese New Year (Spring Festival), developers are on vacation.
> Wang Chen will come back at Feb 1st. Reassign to Jinwei Zhang
>
> Skyline API server will forward PromQL to Prometheus service according
> to the prometheus_endpoint var in skyline.yaml. Query & Query_Range
> https://opendev.org/openstack/skyline-
> apiserver/src/branch/master/skyline_apiserver/api/v1/prometheus.py#L97
>
> According to your questions, you want to know how to show the "Monitor
> tab" about instances, right?
>
>
> ** Changed in: skyline-apiserver
> Assignee: wang.chen (wangchen1) => Jingwei Zhang (iceboal)
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/2002902
>
> Title:
> Prometheus integration - maping matrics and services - endpoint
>
> Status in skyline apiserver:
> New
>
> Bug description:
> Hi all
>
> i cant find any info how to setup all promehteus monitoring servies.
>
> What i find and succefully mange to do is:
>
> Hope this info will save some time to otheres :)
>
>
> 1. You need to install prometheus and then some srvices
>
> 2. Openstack Exporter - ttps://github.com/openstack-exporter - to get
> info about servies via system -
>
> 3. mysqld_exporter - https://github.com/prometheus/mysqld_exporter -
> sql stats
>
> 4. rabbitmq-plugins enable rabbitmq_prometheus -
> https://www.rabbitmq.com/prometheus.html
>
> 5. memcached_exporter -
> https://github.com/prometheus/memcached_exporter
>
> 6. openstack_sd_configs -
> https://prometheus.io/docs/prometheus/latest/configuration/configuration/
> - for instances or hypervisor graf
>
> 7. Get Gnocchi and Telemetry Service (Ceilometer) working for example
> https://www.server-
> world.info/en/note?os=Ubuntu_22.04&p=openstack_zed4&f=5
>
> 8. Install Prometheus Pushgateway - https://acloudguru.com/hands-on-
> labs/installing-prometheus-pushgateway
>
> 9. Send mertics to ptomehtrus form ceilometer
> https://docs.openstack.org/ceilometer/rocky/api/ceilometer.publisher.prometheus.html
>
>
> -------------------------------
> What is working fine till now and what not
>
>
> Other Services get all info about MySQL Memcache - RabbitMQ. !!!
>
> OpenStack Services - nova-scheduler Current StatusLast 24H Status
> - all sow fine
>
> Storage Clusters - Storage Cluster Status - Healthy - but its 0 ?
>
> Physical Nodes show only few info -
>
> CPU Cores
> 16
> Total Ram
> 78.45GiB
> System Running Time
> 8.37 min
> File System Free Space
> /dev/mapper/ubuntu--vg-ubuntu--lv/
> 75.89 GiB / 97.87 GiB
> 77.543%
> /dev/sda2/boot
> 1.66 GiB / 1.90 GiB
>
>
> Missing - empty
>
> CPU Usage(%)
> Memory Usage
> DISK IOPS
> DISK Usage(%)
>
>
>
>
> and i still cant get Monitor tab in instance to see cpu a...

Read more...

Revision history for this message
zhangjingwei (wuwu-wuwu) wrote :

@Oskar

Hello~

Skyline-Console does not provide instance monitoring for the moment, we will provide it later. If this feature requires additional operations on the deployment, it will also be documented.

Revision history for this message
Oskar (oxyash) wrote :

@ zhangjingwei (wuwu-wuwu)

ok thx for info what about:

1. Ticket system (Evoque) ? that was showed in presentation
2. Events and Crontab (Mistral ) ? that was showed in presentation
3. Alert center ? that was showed in presentation
4. Where is documentation how to configurate "Monitor overview" TAB (what to need to install and setup ?)
5. We can see on the demo Skyline use Panko (wich is depricated @ the moment)
6. Do we need prometheus_sidecar endpoiont (wich is depricated @ the moment)
7. What is Licnese in Platform Section - is sklyline is a demo product wich we ill can buy full version to get all this features working ?
8. What will be way to upgrade skilne to new version if you dont use docker?\

Thank for all you work and information

xusongfu (xusongfu)
Changed in skyline-apiserver:
assignee: Jingwei Zhang (iceboal) → xusongfu (xusongfu)
Revision history for this message
Boxiang Zhu (bxzhu-5355) wrote :

hi Oskar,

Now skyline is not integated with ceilometer(which is a data collection service). But we only use prometheus for skyline. And no exporters will supply the detailed info for vm(such as cpu, mem and so on).

So if we need these informations for vm, we need to do like:

- develop new exporter to collector metrics of vm
or
- integrated with ceilometer

Revision history for this message
Boxiang Zhu (bxzhu-5355) wrote (last edit ):

1. No Evoque, invalid codes, we will remove them
2. No mistral, invalid codes, we will remove them
3. invalid codes, we will remove them
4. all documents are here: https://docs.openstack.org/skyline-console/latest/
5. yes, we use panko as event audit
6. invalid code, we will remove them
7. the opensoure codes are all in opendev or github for openstack
8. we suggest to use docker to deploy the skyline.

Revision history for this message
Oskar (oxyash) wrote :

ok thank you for all information and clarification

one more if i install and integrate panko with my system ill automatically show i skyline ?
like it is working with vpn tab ( when i install vpnass its show up in skyline )

best

Revision history for this message
Boxiang Zhu (bxzhu-5355) wrote :

No, panko just supplies the API to query the event info. You need the ceilometer-notification service to report the events into panko.

Revision history for this message
Oskar (oxyash) wrote :

ok thank you so much for all you info Zhu :)

can You please tell me what do we need to setup in prometheus to get all available info in monitoring overview ?

as i mentioned above i can still get all info
i install nod exporter and all stuf but still get no data in some tabs

what open sack expoter did you use to get the data ?

/var/log/skyline/skyline-error.log

   raise validation_error
22375 pydantic.error_wrappers.ValidationError: 1 validation error for PrometheusQueryRangeResult
22376 value

for exaplme

CPU Usage(%)
Memory Usage

is missing in Phyical nodes

Monitor Center/Storage Clusters
is empty to

Revision history for this message
Shuai Qian (iauhsnaiq) wrote :

You can check if there are metrics which prefix is node in prometheus, verifying your node exporter is installed normally, otherwise you would get nothing.

Revision history for this message
Oskar (oxyash) wrote :
Download full text (7.3 KiB)

Thank you
Yes I know that but what prefix skyline is use ?
And what matric ? There is any documentation ?
And what ecpotrer ?
I'll I need is openstack Prometheus ecpotrer ? From author Niedbalski ?
Where it's information

Best

Oskar Korzeniecki

> On 20 Feb 2023, at 11:11, Shuai Qian <email address hidden> wrote:
>
> You can check if there are metrics which prefix is node in prometheus,
> verifying your node exporter is installed normally, otherwise you would
> get nothing.
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/2002902
>
> Title:
> Prometheus integration - maping matrics and services - endpoint
>
> Status in skyline apiserver:
> New
>
> Bug description:
> Hi all
>
> i cant find any info how to setup all promehteus monitoring servies.
>
> What i find and succefully mange to do is:
>
> Hope this info will save some time to otheres :)
>
>
> 1. You need to install prometheus and then some srvices
>
> 2. Openstack Exporter - ttps://github.com/openstack-exporter - to get
> info about servies via system -
>
> 3. mysqld_exporter - https://github.com/prometheus/mysqld_exporter -
> sql stats
>
> 4. rabbitmq-plugins enable rabbitmq_prometheus -
> https://www.rabbitmq.com/prometheus.html
>
> 5. memcached_exporter -
> https://github.com/prometheus/memcached_exporter
>
> 6. openstack_sd_configs -
> https://prometheus.io/docs/prometheus/latest/configuration/configuration/
> - for instances or hypervisor graf
>
> 7. Get Gnocchi and Telemetry Service (Ceilometer) working for example
> https://www.server-
> world.info/en/note?os=Ubuntu_22.04&p=openstack_zed4&f=5
>
> 8. Install Prometheus Pushgateway - https://acloudguru.com/hands-on-
> labs/installing-prometheus-pushgateway
>
> 9. Send mertics to ptomehtrus form ceilometer
> https://docs.openstack.org/ceilometer/rocky/api/ceilometer.publisher.prometheus.html
>
>
> -------------------------------
> What is working fine till now and what not
>
>
> Other Services get all info about MySQL Memcache - RabbitMQ. !!!
>
> OpenStack Services - nova-scheduler Current StatusLast 24H Status
> - all sow fine
>
> Storage Clusters - Storage Cluster Status - Healthy - but its 0 ?
>
> Physical Nodes show only few info -
>
> CPU Cores
> 16
> Total Ram
> 78.45GiB
> System Running Time
> 8.37 min
> File System Free Space
> /dev/mapper/ubuntu--vg-ubuntu--lv/
> 75.89 GiB / 97.87 GiB
> 77.543%
> /dev/sda2/boot
> 1.66 GiB / 1.90 GiB
>
>
> Missing - empty
>
> CPU Usage(%)
> Memory Usage
> DISK IOPS
> DISK Usage(%)
>
>
>
>
> and i still cant get Monitor tab in instance to see cpu and memory resources
>
>
> What am i missing or what i nee to setup, map or enable to get it right.
>
>
> Below my prometheus confi
>
> global:
> scrape_interval: 15s
> scrape_timeout: 13s
> evaluation_interval: 15s
> external_labels:
> monitor: example
> alerting:
> alertmanagers:
> - follow_redirects: true
> scheme: http
> timeout: 10s
> api_version: v2
> static_configs:
> - targets:
> - localhost:9093
> scrape_c...

Read more...

Revision history for this message
Shuai Qian (iauhsnaiq) wrote :

Hello,
maybe we should know the fact that
what skyline get the monitoring data is simplely get from prometheus by calling promethus api,
what data promethues have, skyline get that.
There is *no* any configuration about which promethues export or metrics to get in skyline.
Just connection info about promethues.

So you should check the following steps.
1. check promethus itself if there are any data in promethus, if thare are no data in promethus, that's the point, you should fix it.
2. if there are data in promethus, you can supply everything about api that skyline call, including request header body response header body and something. Then Our console developper would help.

Revision history for this message
Oskar (oxyash) wrote :
Download full text (8.2 KiB)

Thank for all info its more clear now .

Yes i have all i need in prometheus metrics all i can visualizate in grafana with no problem

Skyline don't show all I have in Prometheus
I think there is some hardcore information what is displayed what not
There need to be some syntax og metrics , prefix that is diistpayed

Why I get info in log file of skyline metrics don't found ?
So something is not found ?
But how can I found what I'm looking for?

2. So I can show in skyline all in need from any expoter if u only enable it via api ? So where it will be displayed ?i

Best

Oskar Korzeniecki

> On 24 Feb 2023, at 04:05, Shuai Qian <email address hidden> wrote:
>
> Hello,
> maybe we should know the fact that
> what skyline get the monitoring data is simplely get from prometheus by calling promethus api,
> what data promethues have, skyline get that.
> There is *no* any configuration about which promethues export or metrics to get in skyline.
> Just connection info about promethues.
>
> So you should check the following steps.
> 1. check promethus itself if there are any data in promethus, if thare are no data in promethus, that's the point, you should fix it.
> 2. if there are data in promethus, you can supply everything about api that skyline call, including request header body response header body and something. Then Our console developper would help.
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/2002902
>
> Title:
> Prometheus integration - maping matrics and services - endpoint
>
> Status in skyline apiserver:
> New
>
> Bug description:
> Hi all
>
> i cant find any info how to setup all promehteus monitoring servies.
>
> What i find and succefully mange to do is:
>
> Hope this info will save some time to otheres :)
>
>
> 1. You need to install prometheus and then some srvices
>
> 2. Openstack Exporter - ttps://github.com/openstack-exporter - to get
> info about servies via system -
>
> 3. mysqld_exporter - https://github.com/prometheus/mysqld_exporter -
> sql stats
>
> 4. rabbitmq-plugins enable rabbitmq_prometheus -
> https://www.rabbitmq.com/prometheus.html
>
> 5. memcached_exporter -
> https://github.com/prometheus/memcached_exporter
>
> 6. openstack_sd_configs -
> https://prometheus.io/docs/prometheus/latest/configuration/configuration/
> - for instances or hypervisor graf
>
> 7. Get Gnocchi and Telemetry Service (Ceilometer) working for example
> https://www.server-
> world.info/en/note?os=Ubuntu_22.04&p=openstack_zed4&f=5
>
> 8. Install Prometheus Pushgateway - https://acloudguru.com/hands-on-
> labs/installing-prometheus-pushgateway
>
> 9. Send mertics to ptomehtrus form ceilometer
> https://docs.openstack.org/ceilometer/rocky/api/ceilometer.publisher.prometheus.html
>
>
> -------------------------------
> What is working fine till now and what not
>
>
> Other Services get all info about MySQL Memcache - RabbitMQ. !!!
>
> OpenStack Services - nova-scheduler Current StatusLast 24H Status
> - all sow fine
>
> Storage Clusters - Storage Cluster Status - Healthy - but its 0 ?
>
> Physical...

Read more...

Revision history for this message
Shuai Qian (iauhsnaiq) wrote :

In fact you could not get more details from log.

Now we clear that your promethus works normally, that's a good thing.
Then we shall make sure if there are something wrong in skyline-console.
Please supply the request and response of skyline calling in browser debug tool.

Revision history for this message
Oskar (oxyash) wrote :
Download full text (8.5 KiB)

Hi
yes i have the bug it in fiefox and in some cases got 500 internal error

GET
     https://api/openstack/skyline/api/v1/query_range?query=avg by
(mode)(irate(node_cpu_seconds_total{instance="p:9100",mode=~"idle|system|user|iowait"}[30m]))
* 100&start=1678020774&end=1678024374&step=10
Status
500
Internal Server Error
VersionHTTP/2
Transferred206 B (21 B size)
Referrer Policystrict-origin-when-cross-origin

i think its is problem of range of qurty
start=1678020774&end=1678024374&step=10

ther is no value in my system from 1678020774 to 1678024374

can i modify it via appi ?
docs#/Prometheus/prometheus_query_range_api_v1_query_range_get

how i can change this value ?

Inline image

Oskar Korzeniecki

Inline image

503 35 28 35
22 102 17 08

<email address hidden>
https://chmura.tech/

  Jeśli wiadomość ta nie jest przeznaczona dla Pani/Pana, proszę
zawiadomić o tym nadawcę, a następnie ją skasować.

This message may contain private data sent to a specified receiver and
should not be used by a third party. If you are not the intended
receiver, please inform the sender and delete this e-mail message.

------ Original Message ------
From: "Shuai Qian" <email address hidden>
To: <email address hidden>
Sent: 02.03.2023 09:56:59
Subject: [Bug 2002902] Re: Prometheus integration - maping matrics and
services - endpoint

>In fact you could not get more details from log.
>
>Now we clear that your promethus works normally, that's a good thing.
>Then we shall make sure if there are something wrong in skyline-console.
>Please supply the request and response of skyline calling in browser debug tool.
>
>--
>You received this bug notification because you are subscribed to the bug
>report.
>https://bugs.launchpad.net/bugs/2002902
>
>Title:
> Prometheus integration - maping matrics and services - endpoint
>
>Status in skyline apiserver:
> New
>
>Bug description:
> Hi all
>
> i cant find any info how to setup all promehteus monitoring servies.
>
> What i find and succefully mange to do is:
>
> Hope this info will save some time to otheres :)
>
>
> 1. You need to install prometheus and then some srvices
>
> 2. Openstack Exporter - ttps://github.com/openstack-exporter - to get
> info about servies via system -
>
> 3. mysqld_exporter - https://github.com/prometheus/mysqld_exporter -
> sql stats
>
> 4. rabbitmq-plugins enable rabbitmq_prometheus -
>https://www.rabbitmq.com/prometheus.html
>
> 5. memcached_exporter -
>https://github.com/prometheus/memcached_exporter
>
> 6. openstack_sd_configs -
>https://prometheus.io/docs/prometheus/latest/configuration/configuration/
> - for instances or hypervisor graf
>
> 7. Get Gnocchi and Telemetry Service (Ceilometer) working for example
>https://www.server-
> world.info/en/note?os=Ubuntu_22.04&p=openstack_zed4&f=5
>
> 8. Install Prometheus Pushgateway - https://acloudguru.com/hands-on-
> labs/installing-prometheus-pushgateway
>
> 9. Send mertics to ptomehtrus form ceilometer
>https://docs.openstack.org/ceilometer/rocky/api/ceilometer.publisher.prometheus.html
>
>
> -------------------------------
> What is working fine till now and what not
>
>
> Other Services get all info ...

Read more...

Revision history for this message
Shuai Qian (iauhsnaiq) wrote :

It should also return 200 but 500, even if you have no data between these two timestamps.
So that there must be something wrong with skyline service. Have you found any error log in log file? in the dictionary of /var/log/skyline.

you can checking log while refreshing your page in skyline. let us knonw if you found any error log or useful info.

And the query range is would be set as last 1 hour defaultly, you can change it in the skyline monitor center page.

Revision history for this message
Boxiang Zhu (bxzhu-5355) wrote :

https://review.opendev.org/c/openstack/skyline-apiserver/+/868152

I think the issue has been fixed by this commit. If possible, you can try to use the latest skyline images/codes.

Changed in skyline-apiserver:
status: New → Fix Released
Revision history for this message
Oskar (oxyash) wrote :
Download full text (7.3 KiB)

Thank you
I'll check it all in new version and let you know how the things looks for me
Best

Oskar Korzeniecki

> On 31 Mar 2023, at 12:19, Boxiang Zhu <email address hidden> wrote:
>
> https://review.opendev.org/c/openstack/skyline-apiserver/+/868152
>
> I think the issue has been fixed by this commit. If possible, you can
> try to use the latest skyline images/codes.
>
> ** Changed in: skyline-apiserver
> Status: New => Fix Released
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/2002902
>
> Title:
> Prometheus integration - maping matrics and services - endpoint
>
> Status in skyline apiserver:
> Fix Released
>
> Bug description:
> Hi all
>
> i cant find any info how to setup all promehteus monitoring servies.
>
> What i find and succefully mange to do is:
>
> Hope this info will save some time to otheres :)
>
>
> 1. You need to install prometheus and then some srvices
>
> 2. Openstack Exporter - ttps://github.com/openstack-exporter - to get
> info about servies via system -
>
> 3. mysqld_exporter - https://github.com/prometheus/mysqld_exporter -
> sql stats
>
> 4. rabbitmq-plugins enable rabbitmq_prometheus -
> https://www.rabbitmq.com/prometheus.html
>
> 5. memcached_exporter -
> https://github.com/prometheus/memcached_exporter
>
> 6. openstack_sd_configs -
> https://prometheus.io/docs/prometheus/latest/configuration/configuration/
> - for instances or hypervisor graf
>
> 7. Get Gnocchi and Telemetry Service (Ceilometer) working for example
> https://www.server-
> world.info/en/note?os=Ubuntu_22.04&p=openstack_zed4&f=5
>
> 8. Install Prometheus Pushgateway - https://acloudguru.com/hands-on-
> labs/installing-prometheus-pushgateway
>
> 9. Send mertics to ptomehtrus form ceilometer
> https://docs.openstack.org/ceilometer/rocky/api/ceilometer.publisher.prometheus.html
>
>
> -------------------------------
> What is working fine till now and what not
>
>
> Other Services get all info about MySQL Memcache - RabbitMQ. !!!
>
> OpenStack Services - nova-scheduler Current StatusLast 24H Status
> - all sow fine
>
> Storage Clusters - Storage Cluster Status - Healthy - but its 0 ?
>
> Physical Nodes show only few info -
>
> CPU Cores
> 16
> Total Ram
> 78.45GiB
> System Running Time
> 8.37 min
> File System Free Space
> /dev/mapper/ubuntu--vg-ubuntu--lv/
> 75.89 GiB / 97.87 GiB
> 77.543%
> /dev/sda2/boot
> 1.66 GiB / 1.90 GiB
>
>
> Missing - empty
>
> CPU Usage(%)
> Memory Usage
> DISK IOPS
> DISK Usage(%)
>
>
>
>
> and i still cant get Monitor tab in instance to see cpu and memory resources
>
>
> What am i missing or what i nee to setup, map or enable to get it right.
>
>
> Below my prometheus confi
>
> global:
> scrape_interval: 15s
> scrape_timeout: 13s
> evaluation_interval: 15s
> external_labels:
> monitor: example
> alerting:
> alertmanagers:
> - follow_redirects: true
> scheme: http
> timeout: 10s
> api_version: v2
> static_configs:
> - targets:
> - localhost:9093
> scrape_configs:
> - job_name:...

Read more...

Revision history for this message
Johnsmith (cloudtraining) wrote :

Thanks for the post!

https://ekascloud.com/

Revision history for this message
Satish Patel (satish-txt) wrote :

Does this bug going to give instance monitoring data from prometheus or just openstack services?

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Bug attachments

Remote bug watches

Bug watches keep track of this bug in other bug trackers.