| 2023-08-07 12:36:01 |
Ivan Galben |
bug |
|
|
added bug |
| 2023-08-07 12:38:23 |
Ivan Galben |
description |
**Bug Report**
What happened:
Hi.
If I enter my request id as stated in the documentation https://docs.openstack.org/api-guide/compute/faults.html it doesn't show up in opensearch.
Requests without my requet id go well, I see an entry in opensearch
2023-08-06 03:51:31.951 35 INFO nova.api.openstack.requestlog [None req-bbcafeda-8d1a-4b80-948d-58c48c408060 b2098ef1f52a4451a8c9860708a118d4 8e0ea207eddd4960abaddd3c610640ba - - default default] 172.31.153.100 "GET /v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.93 time: 0.012029
But when i send my own tracking request id
curl --location 'http://172.31.168.100:9696/v2.0/networks' \
--header 'X-Auth-Token: $TOKEN' \
--header 'X-Openstack-Request-Id: req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae'
it is not in Opensearch, there is an entry in /var/log/kolla/nova/nova-api.log
2023-08-06 03:51:31.885 34 INFO nova.api.openstack.requestlog [req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae req-231c5129-eca9-41fd-8486-ccec69c978f9 b2098ef1f52a4451a8c9860708a118d4 8e0ea207eddd4960abaddd3c610640ba - - default default] 172.31.153.100 "GET /v2.1/limits?tenant_id=b1c3908d4a8342b18df522b6f53d6049" status: 200 len: 302 microversion: 2.93 time: 0.017379
The filter kolla-venv/share/kolla-ansible/ansible/roles/common/templates/conf/input/00-global.conf.j2 is missing an entry to handle the extra request id field.
What you expected to happen:
В конфигурации fluentd необходимо дополнительное поля для Request ID
How to reproduce it:
curl --location 'http://172.31.168.100:9696/v2.0/networks' \
--header 'X-Auth-Token: $TOKEN' \
--header 'X-Openstack-Request-Id: req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae'
**Environment**:
* OS (e.g. from /etc/os-release): Rocky Linux
* Kernel (e.g. `uname -a`): 5.14.0-162.12.1.el9_1.0.2.x86_64
* Docker version if applicable (e.g. `docker version`): Docker version 20.10.21, build baeda1f
* Kolla-Ansible version (e.g. `git head or tag or stable branch` or pip package version if using release): https://github.com/openstack/kolla-ansible/tree/stable/zed
* Docker image Install type (source/binary): binary
* Docker image distribution: zed
* Are you using official images from Docker Hub or self built?
* If self built - Kolla version and environment used to build:
* Share your inventory file, globals.yml and other configuration files if relevant
cat kolla-venv/share/kolla-ansible/ansible/roles/common/templates/conf/input/00-global.conf.j2
#jinja2: trim_blocks: False
{% if fluentd_enabled_input_openstack_services | length > 0 -%}
<source>
@type tail
path {% for service in fluentd_enabled_input_openstack_services %}/var/log/kolla/{{ service }}/*.log{% if not loop.last %},{% endif %}{% endfor %}
exclude_path ["/var/log/kolla/neutron/dnsmasq.log",
"/var/log/kolla/ironic/dnsmasq.log",
"/var/log/kolla/*/*-access.log",
"/var/log/kolla/*/*-error.log",
"/var/log/kolla/*/*_access.log",
"/var/log/kolla/*/*_error.log"]
pos_file /var/run/td-agent/kolla-openstack.pos
tag kolla.*
ignore_repeated_permission_error true
enable_watch_timer false
<parse>
@type multiline
format_firstline /^\d{4}-\d{2}-\d{2} \d{2}:\d{2}:\d{2}.\d{3} \d+ \S+ \S+ \[.*\]/
format1 /^(?<Timestamp>\S+ \S+) (?<Pid>\d+) (?<log_level>\S+) (?<python_module>\S+) \[(\S+ req-)?((?<x_request_id>\S+) (?<request_id>\S+) (?<user_id>\S+) (?<tenant_id>\S+) (?<domain_id>\S+) (?<system_scope>\S+) (?<user_domain>\S+) (?<project_domain>\S+)|-)\] (?<Payload>.*)?$/
time_key Timestamp
keep_time_key true
time_format %F %T.%L
</parse>
</source>
{%- endif %} |
**Bug Report**
What happened:
Hi.
If I enter my request id as stated in the documentation https://docs.openstack.org/api-guide/compute/faults.html it doesn't show up in opensearch.
Requests without my request id go well, I see an entry in opensearch
2023-08-06 03:51:31.951 35 INFO nova.api.openstack.requestlog [None req-bbcafeda-8d1a-4b80-948d-58c48c408060 b2098ef1f52a4451a8c9860708a118d4 8e0ea207eddd4960abaddd3c610640ba - - default default] 172.31.153.100 "GET /v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.93 time: 0.012029
But when i send my own tracking request id
curl --location 'http://172.31.168.100:9696/v2.0/networks' \
--header 'X-Auth-Token: $TOKEN' \
--header 'X-Openstack-Request-Id: req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae'
it is not in Opensearch, there is an entry in /var/log/kolla/nova/nova-api.log
2023-08-06 03:51:31.885 34 INFO nova.api.openstack.requestlog [req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae req-231c5129-eca9-41fd-8486-ccec69c978f9 b2098ef1f52a4451a8c9860708a118d4 8e0ea207eddd4960abaddd3c610640ba - - default default] 172.31.153.100 "GET /v2.1/limits?tenant_id=b1c3908d4a8342b18df522b6f53d6049" status: 200 len: 302 microversion: 2.93 time: 0.017379
The filter kolla-venv/share/kolla-ansible/ansible/roles/common/templates/conf/input/00-global.conf.j2 is missing an entry to handle the extra request id field.
What you expected to happen:
Fluentd config needs an extra field for Request ID
How to reproduce it:
curl --location 'http://172.31.168.100:9696/v2.0/networks' \
--header 'X-Auth-Token: $TOKEN' \
--header 'X-Openstack-Request-Id: req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae'
**Environment**:
* OS (e.g. from /etc/os-release): Rocky Linux
* Kernel (e.g. `uname -a`): 5.14.0-162.12.1.el9_1.0.2.x86_64
* Docker version if applicable (e.g. `docker version`): Docker version 20.10.21, build baeda1f
* Kolla-Ansible version (e.g. `git head or tag or stable branch` or pip package version if using release): https://github.com/openstack/kolla-ansible/tree/stable/zed
* Docker image Install type (source/binary): binary
* Docker image distribution: zed
* Are you using official images from Docker Hub or self built?
* If self built - Kolla version and environment used to build:
* Share your inventory file, globals.yml and other configuration files if relevant
cat kolla-venv/share/kolla-ansible/ansible/roles/common/templates/conf/input/00-global.conf.j2
#jinja2: trim_blocks: False
{% if fluentd_enabled_input_openstack_services | length > 0 -%}
<source>
@type tail
path {% for service in fluentd_enabled_input_openstack_services %}/var/log/kolla/{{ service }}/*.log{% if not loop.last %},{% endif %}{% endfor %}
exclude_path ["/var/log/kolla/neutron/dnsmasq.log",
"/var/log/kolla/ironic/dnsmasq.log",
"/var/log/kolla/*/*-access.log",
"/var/log/kolla/*/*-error.log",
"/var/log/kolla/*/*_access.log",
"/var/log/kolla/*/*_error.log"]
pos_file /var/run/td-agent/kolla-openstack.pos
tag kolla.*
ignore_repeated_permission_error true
enable_watch_timer false
<parse>
@type multiline
format_firstline /^\d{4}-\d{2}-\d{2} \d{2}:\d{2}:\d{2}.\d{3} \d+ \S+ \S+ \[.*\]/
format1 /^(?<Timestamp>\S+ \S+) (?<Pid>\d+) (?<log_level>\S+) (?<python_module>\S+) \[(\S+ req-)?((?<x_request_id>\S+) (?<request_id>\S+) (?<user_id>\S+) (?<tenant_id>\S+) (?<domain_id>\S+) (?<system_scope>\S+) (?<user_domain>\S+) (?<project_domain>\S+)|-)\] (?<Payload>.*)?$/
time_key Timestamp
keep_time_key true
time_format %F %T.%L
</parse>
</source>
{%- endif %} |
|
| 2023-08-07 12:42:23 |
Ivan Galben |
description |
**Bug Report**
What happened:
Hi.
If I enter my request id as stated in the documentation https://docs.openstack.org/api-guide/compute/faults.html it doesn't show up in opensearch.
Requests without my request id go well, I see an entry in opensearch
2023-08-06 03:51:31.951 35 INFO nova.api.openstack.requestlog [None req-bbcafeda-8d1a-4b80-948d-58c48c408060 b2098ef1f52a4451a8c9860708a118d4 8e0ea207eddd4960abaddd3c610640ba - - default default] 172.31.153.100 "GET /v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.93 time: 0.012029
But when i send my own tracking request id
curl --location 'http://172.31.168.100:9696/v2.0/networks' \
--header 'X-Auth-Token: $TOKEN' \
--header 'X-Openstack-Request-Id: req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae'
it is not in Opensearch, there is an entry in /var/log/kolla/nova/nova-api.log
2023-08-06 03:51:31.885 34 INFO nova.api.openstack.requestlog [req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae req-231c5129-eca9-41fd-8486-ccec69c978f9 b2098ef1f52a4451a8c9860708a118d4 8e0ea207eddd4960abaddd3c610640ba - - default default] 172.31.153.100 "GET /v2.1/limits?tenant_id=b1c3908d4a8342b18df522b6f53d6049" status: 200 len: 302 microversion: 2.93 time: 0.017379
The filter kolla-venv/share/kolla-ansible/ansible/roles/common/templates/conf/input/00-global.conf.j2 is missing an entry to handle the extra request id field.
What you expected to happen:
Fluentd config needs an extra field for Request ID
How to reproduce it:
curl --location 'http://172.31.168.100:9696/v2.0/networks' \
--header 'X-Auth-Token: $TOKEN' \
--header 'X-Openstack-Request-Id: req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae'
**Environment**:
* OS (e.g. from /etc/os-release): Rocky Linux
* Kernel (e.g. `uname -a`): 5.14.0-162.12.1.el9_1.0.2.x86_64
* Docker version if applicable (e.g. `docker version`): Docker version 20.10.21, build baeda1f
* Kolla-Ansible version (e.g. `git head or tag or stable branch` or pip package version if using release): https://github.com/openstack/kolla-ansible/tree/stable/zed
* Docker image Install type (source/binary): binary
* Docker image distribution: zed
* Are you using official images from Docker Hub or self built?
* If self built - Kolla version and environment used to build:
* Share your inventory file, globals.yml and other configuration files if relevant
cat kolla-venv/share/kolla-ansible/ansible/roles/common/templates/conf/input/00-global.conf.j2
#jinja2: trim_blocks: False
{% if fluentd_enabled_input_openstack_services | length > 0 -%}
<source>
@type tail
path {% for service in fluentd_enabled_input_openstack_services %}/var/log/kolla/{{ service }}/*.log{% if not loop.last %},{% endif %}{% endfor %}
exclude_path ["/var/log/kolla/neutron/dnsmasq.log",
"/var/log/kolla/ironic/dnsmasq.log",
"/var/log/kolla/*/*-access.log",
"/var/log/kolla/*/*-error.log",
"/var/log/kolla/*/*_access.log",
"/var/log/kolla/*/*_error.log"]
pos_file /var/run/td-agent/kolla-openstack.pos
tag kolla.*
ignore_repeated_permission_error true
enable_watch_timer false
<parse>
@type multiline
format_firstline /^\d{4}-\d{2}-\d{2} \d{2}:\d{2}:\d{2}.\d{3} \d+ \S+ \S+ \[.*\]/
format1 /^(?<Timestamp>\S+ \S+) (?<Pid>\d+) (?<log_level>\S+) (?<python_module>\S+) \[(\S+ req-)?((?<x_request_id>\S+) (?<request_id>\S+) (?<user_id>\S+) (?<tenant_id>\S+) (?<domain_id>\S+) (?<system_scope>\S+) (?<user_domain>\S+) (?<project_domain>\S+)|-)\] (?<Payload>.*)?$/
time_key Timestamp
keep_time_key true
time_format %F %T.%L
</parse>
</source>
{%- endif %} |
**Bug Report**
What happened:
Hi.
If I enter my request id as stated in the documentation https://docs.openstack.org/api-guide/compute/faults.html it doesn't show up in opensearch.
Requests without my request id go well, I see an entry in opensearch
2023-08-06 03:51:31.951 35 INFO nova.api.openstack.requestlog [None req-bbcafeda-8d1a-4b80-948d-58c48c408060 b2098ef1f52a4451a8c9860708a118d4 8e0ea207eddd4960abaddd3c610640ba - - default default] 172.31.153.100 "GET /v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.93 time: 0.012029
But when i send my own tracking request id
curl --location 'http://172.31.168.100:9696/v2.0/networks' \
--header 'X-Auth-Token: $TOKEN' \
--header 'X-Openstack-Request-Id: req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae'
it is not in Opensearch, there is an entry in /var/log/kolla/nova/nova-api.log
2023-08-06 03:51:31.885 34 INFO nova.api.openstack.requestlog [req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae req-231c5129-eca9-41fd-8486-ccec69c978f9 b2098ef1f52a4451a8c9860708a118d4 8e0ea207eddd4960abaddd3c610640ba - - default default] 172.31.153.100 "GET /v2.1/limits?tenant_id=b1c3908d4a8342b18df522b6f53d6049" status: 200 len: 302 microversion: 2.93 time: 0.017379
The filter kolla-venv/share/kolla-ansible/ansible/roles/common/templates/conf/input/00-global.conf.j2
(\S+ req-)?((?<x_request_id>\S+) (?<request_id>\S+) (?<user_id>\S+) (?<tenant_id>\S+) (?<domain_id>\S+) (?<system_scope>\S+) (?<user_domain>\S+) (?<project_domain>\S+)|-)
is missing an entry to handle the extra request id field.
What you expected to happen:
Fluentd config needs an extra field for Request ID
How to reproduce it:
curl --location 'http://172.31.168.100:9696/v2.0/networks' \
--header 'X-Auth-Token: $TOKEN' \
--header 'X-Openstack-Request-Id: req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae'
**Environment**:
* OS (e.g. from /etc/os-release): Rocky Linux
* Kernel (e.g. `uname -a`): 5.14.0-162.12.1.el9_1.0.2.x86_64
* Docker version if applicable (e.g. `docker version`): Docker version 20.10.21, build baeda1f
* Kolla-Ansible version (e.g. `git head or tag or stable branch` or pip package version if using release): https://github.com/openstack/kolla-ansible/tree/stable/zed
* Docker image Install type (source/binary): binary
* Docker image distribution: zed
* Are you using official images from Docker Hub or self built?
* If self built - Kolla version and environment used to build:
* Share your inventory file, globals.yml and other configuration files if relevant
cat kolla-venv/share/kolla-ansible/ansible/roles/common/templates/conf/input/00-global.conf.j2
#jinja2: trim_blocks: False
{% if fluentd_enabled_input_openstack_services | length > 0 -%}
<source>
@type tail
path {% for service in fluentd_enabled_input_openstack_services %}/var/log/kolla/{{ service }}/*.log{% if not loop.last %},{% endif %}{% endfor %}
exclude_path ["/var/log/kolla/neutron/dnsmasq.log",
"/var/log/kolla/ironic/dnsmasq.log",
"/var/log/kolla/*/*-access.log",
"/var/log/kolla/*/*-error.log",
"/var/log/kolla/*/*_access.log",
"/var/log/kolla/*/*_error.log"]
pos_file /var/run/td-agent/kolla-openstack.pos
tag kolla.*
ignore_repeated_permission_error true
enable_watch_timer false
<parse>
@type multiline
format_firstline /^\d{4}-\d{2}-\d{2} \d{2}:\d{2}:\d{2}.\d{3} \d+ \S+ \S+ \[.*\]/
format1 /^(?<Timestamp>\S+ \S+) (?<Pid>\d+) (?<log_level>\S+) (?<python_module>\S+) \[(\S+ req-)?((?<x_request_id>\S+) (?<request_id>\S+) (?<user_id>\S+) (?<tenant_id>\S+) (?<domain_id>\S+) (?<system_scope>\S+) (?<user_domain>\S+) (?<project_domain>\S+)|-)\] (?<Payload>.*)?$/
time_key Timestamp
keep_time_key true
time_format %F %T.%L
</parse>
</source>
{%- endif %} |
|
| 2023-08-07 12:43:49 |
Ivan Galben |
description |
**Bug Report**
What happened:
Hi.
If I enter my request id as stated in the documentation https://docs.openstack.org/api-guide/compute/faults.html it doesn't show up in opensearch.
Requests without my request id go well, I see an entry in opensearch
2023-08-06 03:51:31.951 35 INFO nova.api.openstack.requestlog [None req-bbcafeda-8d1a-4b80-948d-58c48c408060 b2098ef1f52a4451a8c9860708a118d4 8e0ea207eddd4960abaddd3c610640ba - - default default] 172.31.153.100 "GET /v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.93 time: 0.012029
But when i send my own tracking request id
curl --location 'http://172.31.168.100:9696/v2.0/networks' \
--header 'X-Auth-Token: $TOKEN' \
--header 'X-Openstack-Request-Id: req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae'
it is not in Opensearch, there is an entry in /var/log/kolla/nova/nova-api.log
2023-08-06 03:51:31.885 34 INFO nova.api.openstack.requestlog [req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae req-231c5129-eca9-41fd-8486-ccec69c978f9 b2098ef1f52a4451a8c9860708a118d4 8e0ea207eddd4960abaddd3c610640ba - - default default] 172.31.153.100 "GET /v2.1/limits?tenant_id=b1c3908d4a8342b18df522b6f53d6049" status: 200 len: 302 microversion: 2.93 time: 0.017379
The filter kolla-venv/share/kolla-ansible/ansible/roles/common/templates/conf/input/00-global.conf.j2
(\S+ req-)?((?<x_request_id>\S+) (?<request_id>\S+) (?<user_id>\S+) (?<tenant_id>\S+) (?<domain_id>\S+) (?<system_scope>\S+) (?<user_domain>\S+) (?<project_domain>\S+)|-)
is missing an entry to handle the extra request id field.
What you expected to happen:
Fluentd config needs an extra field for Request ID
How to reproduce it:
curl --location 'http://172.31.168.100:9696/v2.0/networks' \
--header 'X-Auth-Token: $TOKEN' \
--header 'X-Openstack-Request-Id: req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae'
**Environment**:
* OS (e.g. from /etc/os-release): Rocky Linux
* Kernel (e.g. `uname -a`): 5.14.0-162.12.1.el9_1.0.2.x86_64
* Docker version if applicable (e.g. `docker version`): Docker version 20.10.21, build baeda1f
* Kolla-Ansible version (e.g. `git head or tag or stable branch` or pip package version if using release): https://github.com/openstack/kolla-ansible/tree/stable/zed
* Docker image Install type (source/binary): binary
* Docker image distribution: zed
* Are you using official images from Docker Hub or self built?
* If self built - Kolla version and environment used to build:
* Share your inventory file, globals.yml and other configuration files if relevant
cat kolla-venv/share/kolla-ansible/ansible/roles/common/templates/conf/input/00-global.conf.j2
#jinja2: trim_blocks: False
{% if fluentd_enabled_input_openstack_services | length > 0 -%}
<source>
@type tail
path {% for service in fluentd_enabled_input_openstack_services %}/var/log/kolla/{{ service }}/*.log{% if not loop.last %},{% endif %}{% endfor %}
exclude_path ["/var/log/kolla/neutron/dnsmasq.log",
"/var/log/kolla/ironic/dnsmasq.log",
"/var/log/kolla/*/*-access.log",
"/var/log/kolla/*/*-error.log",
"/var/log/kolla/*/*_access.log",
"/var/log/kolla/*/*_error.log"]
pos_file /var/run/td-agent/kolla-openstack.pos
tag kolla.*
ignore_repeated_permission_error true
enable_watch_timer false
<parse>
@type multiline
format_firstline /^\d{4}-\d{2}-\d{2} \d{2}:\d{2}:\d{2}.\d{3} \d+ \S+ \S+ \[.*\]/
format1 /^(?<Timestamp>\S+ \S+) (?<Pid>\d+) (?<log_level>\S+) (?<python_module>\S+) \[(\S+ req-)?((?<x_request_id>\S+) (?<request_id>\S+) (?<user_id>\S+) (?<tenant_id>\S+) (?<domain_id>\S+) (?<system_scope>\S+) (?<user_domain>\S+) (?<project_domain>\S+)|-)\] (?<Payload>.*)?$/
time_key Timestamp
keep_time_key true
time_format %F %T.%L
</parse>
</source>
{%- endif %} |
**Bug Report**
What happened:
Hi.
If I enter my request id as stated in the documentation https://docs.openstack.org/api-guide/compute/faults.html it doesn't show up in opensearch.
Requests without my request id go well, I see an entry in opensearch
2023-08-06 03:51:31.951 35 INFO nova.api.openstack.requestlog [None req-bbcafeda-8d1a-4b80-948d-58c48c408060 b2098ef1f52a4451a8c9860708a118d4 8e0ea207eddd4960abaddd3c610640ba - - default default] 172.31.153.100 "GET /v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.93 time: 0.012029
But when i send my own tracking request id 'X-Openstack-Request-Id'
curl --location 'http://172.31.168.100:9696/v2.0/networks' \
--header 'X-Auth-Token: $TOKEN' \
--header 'X-Openstack-Request-Id: req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae'
it is not in Opensearch, there is an entry in /var/log/kolla/nova/nova-api.log
2023-08-06 03:51:31.885 34 INFO nova.api.openstack.requestlog [req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae req-231c5129-eca9-41fd-8486-ccec69c978f9 b2098ef1f52a4451a8c9860708a118d4 8e0ea207eddd4960abaddd3c610640ba - - default default] 172.31.153.100 "GET /v2.1/limits?tenant_id=b1c3908d4a8342b18df522b6f53d6049" status: 200 len: 302 microversion: 2.93 time: 0.017379
The filter kolla-venv/share/kolla-ansible/ansible/roles/common/templates/conf/input/00-global.conf.j2
(\S+ req-)?((?<x_request_id>\S+) (?<request_id>\S+) (?<user_id>\S+) (?<tenant_id>\S+) (?<domain_id>\S+) (?<system_scope>\S+) (?<user_domain>\S+) (?<project_domain>\S+)|-)
is missing an entry to handle the extra request id field.
What you expected to happen:
Fluentd config needs an extra field for Request ID
How to reproduce it:
curl --location 'http://172.31.168.100:9696/v2.0/networks' \
--header 'X-Auth-Token: $TOKEN' \
--header 'X-Openstack-Request-Id: req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae'
**Environment**:
* OS (e.g. from /etc/os-release): Rocky Linux
* Kernel (e.g. `uname -a`): 5.14.0-162.12.1.el9_1.0.2.x86_64
* Docker version if applicable (e.g. `docker version`): Docker version 20.10.21, build baeda1f
* Kolla-Ansible version (e.g. `git head or tag or stable branch` or pip package version if using release): https://github.com/openstack/kolla-ansible/tree/stable/zed
* Docker image Install type (source/binary): binary
* Docker image distribution: zed
* Are you using official images from Docker Hub or self built?
* If self built - Kolla version and environment used to build:
* Share your inventory file, globals.yml and other configuration files if relevant
cat kolla-venv/share/kolla-ansible/ansible/roles/common/templates/conf/input/00-global.conf.j2
#jinja2: trim_blocks: False
{% if fluentd_enabled_input_openstack_services | length > 0 -%}
<source>
@type tail
path {% for service in fluentd_enabled_input_openstack_services %}/var/log/kolla/{{ service }}/*.log{% if not loop.last %},{% endif %}{% endfor %}
exclude_path ["/var/log/kolla/neutron/dnsmasq.log",
"/var/log/kolla/ironic/dnsmasq.log",
"/var/log/kolla/*/*-access.log",
"/var/log/kolla/*/*-error.log",
"/var/log/kolla/*/*_access.log",
"/var/log/kolla/*/*_error.log"]
pos_file /var/run/td-agent/kolla-openstack.pos
tag kolla.*
ignore_repeated_permission_error true
enable_watch_timer false
<parse>
@type multiline
format_firstline /^\d{4}-\d{2}-\d{2} \d{2}:\d{2}:\d{2}.\d{3} \d+ \S+ \S+ \[.*\]/
format1 /^(?<Timestamp>\S+ \S+) (?<Pid>\d+) (?<log_level>\S+) (?<python_module>\S+) \[(\S+ req-)?((?<x_request_id>\S+) (?<request_id>\S+) (?<user_id>\S+) (?<tenant_id>\S+) (?<domain_id>\S+) (?<system_scope>\S+) (?<user_domain>\S+) (?<project_domain>\S+)|-)\] (?<Payload>.*)?$/
time_key Timestamp
keep_time_key true
time_format %F %T.%L
</parse>
</source>
{%- endif %} |
|
| 2023-08-07 12:45:33 |
Ivan Galben |
description |
**Bug Report**
What happened:
Hi.
If I enter my request id as stated in the documentation https://docs.openstack.org/api-guide/compute/faults.html it doesn't show up in opensearch.
Requests without my request id go well, I see an entry in opensearch
2023-08-06 03:51:31.951 35 INFO nova.api.openstack.requestlog [None req-bbcafeda-8d1a-4b80-948d-58c48c408060 b2098ef1f52a4451a8c9860708a118d4 8e0ea207eddd4960abaddd3c610640ba - - default default] 172.31.153.100 "GET /v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.93 time: 0.012029
But when i send my own tracking request id 'X-Openstack-Request-Id'
curl --location 'http://172.31.168.100:9696/v2.0/networks' \
--header 'X-Auth-Token: $TOKEN' \
--header 'X-Openstack-Request-Id: req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae'
it is not in Opensearch, there is an entry in /var/log/kolla/nova/nova-api.log
2023-08-06 03:51:31.885 34 INFO nova.api.openstack.requestlog [req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae req-231c5129-eca9-41fd-8486-ccec69c978f9 b2098ef1f52a4451a8c9860708a118d4 8e0ea207eddd4960abaddd3c610640ba - - default default] 172.31.153.100 "GET /v2.1/limits?tenant_id=b1c3908d4a8342b18df522b6f53d6049" status: 200 len: 302 microversion: 2.93 time: 0.017379
The filter kolla-venv/share/kolla-ansible/ansible/roles/common/templates/conf/input/00-global.conf.j2
(\S+ req-)?((?<x_request_id>\S+) (?<request_id>\S+) (?<user_id>\S+) (?<tenant_id>\S+) (?<domain_id>\S+) (?<system_scope>\S+) (?<user_domain>\S+) (?<project_domain>\S+)|-)
is missing an entry to handle the extra request id field.
What you expected to happen:
Fluentd config needs an extra field for Request ID
How to reproduce it:
curl --location 'http://172.31.168.100:9696/v2.0/networks' \
--header 'X-Auth-Token: $TOKEN' \
--header 'X-Openstack-Request-Id: req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae'
**Environment**:
* OS (e.g. from /etc/os-release): Rocky Linux
* Kernel (e.g. `uname -a`): 5.14.0-162.12.1.el9_1.0.2.x86_64
* Docker version if applicable (e.g. `docker version`): Docker version 20.10.21, build baeda1f
* Kolla-Ansible version (e.g. `git head or tag or stable branch` or pip package version if using release): https://github.com/openstack/kolla-ansible/tree/stable/zed
* Docker image Install type (source/binary): binary
* Docker image distribution: zed
* Are you using official images from Docker Hub or self built?
* If self built - Kolla version and environment used to build:
* Share your inventory file, globals.yml and other configuration files if relevant
cat kolla-venv/share/kolla-ansible/ansible/roles/common/templates/conf/input/00-global.conf.j2
#jinja2: trim_blocks: False
{% if fluentd_enabled_input_openstack_services | length > 0 -%}
<source>
@type tail
path {% for service in fluentd_enabled_input_openstack_services %}/var/log/kolla/{{ service }}/*.log{% if not loop.last %},{% endif %}{% endfor %}
exclude_path ["/var/log/kolla/neutron/dnsmasq.log",
"/var/log/kolla/ironic/dnsmasq.log",
"/var/log/kolla/*/*-access.log",
"/var/log/kolla/*/*-error.log",
"/var/log/kolla/*/*_access.log",
"/var/log/kolla/*/*_error.log"]
pos_file /var/run/td-agent/kolla-openstack.pos
tag kolla.*
ignore_repeated_permission_error true
enable_watch_timer false
<parse>
@type multiline
format_firstline /^\d{4}-\d{2}-\d{2} \d{2}:\d{2}:\d{2}.\d{3} \d+ \S+ \S+ \[.*\]/
format1 /^(?<Timestamp>\S+ \S+) (?<Pid>\d+) (?<log_level>\S+) (?<python_module>\S+) \[(\S+ req-)?((?<x_request_id>\S+) (?<request_id>\S+) (?<user_id>\S+) (?<tenant_id>\S+) (?<domain_id>\S+) (?<system_scope>\S+) (?<user_domain>\S+) (?<project_domain>\S+)|-)\] (?<Payload>.*)?$/
time_key Timestamp
keep_time_key true
time_format %F %T.%L
</parse>
</source>
{%- endif %} |
**Bug Report**
What happened:
Hi.
If I enter my request id as stated in the documentation https://docs.openstack.org/api-guide/compute/faults.html it doesn't show up in opensearch.
Requests without my request id go well, I see an entry in opensearch
2023-08-06 03:51:31.951 35 INFO nova.api.openstack.requestlog [None req-bbcafeda-8d1a-4b80-948d-58c48c408060 b2098ef1f52a4451a8c9860708a118d4 8e0ea207eddd4960abaddd3c610640ba - - default default] 172.31.153.100 "GET /v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.93 time: 0.012029
But when i send my own tracking request id 'X-Openstack-Request-Id'
curl --location 'http://172.31.168.100:9696/v2.0/networks' \
--header 'X-Auth-Token: $TOKEN' \
--header 'X-Openstack-Request-Id: req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae'
it is not in Opensearch, there is an entry in /var/log/kolla/nova/nova-api.log
2023-08-06 03:51:31.885 34 INFO nova.api.openstack.requestlog [req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae req-231c5129-eca9-41fd-8486-ccec69c978f9 b2098ef1f52a4451a8c9860708a118d4 8e0ea207eddd4960abaddd3c610640ba - - default default] 172.31.153.100 "GET /v2.1/limits?tenant_id=b1c3908d4a8342b18df522b6f53d6049" status: 200 len: 302 microversion: 2.93 time: 0.017379
The filter kolla-venv/share/kolla-ansible/ansible/roles/common/templates/conf/input/00-global.conf.j2
(\S+ req-)?((?<request_id>\S+) (?<user_id>\S+) (?<tenant_id>\S+) (?<domain_id>\S+) (?<system_scope>\S+) (?<user_domain>\S+) (?<project_domain>\S+)|-)
is missing an entry to handle the extra request id field.
What you expected to happen:
Fluentd config needs an extra field for Request ID
How to reproduce it:
curl --location 'http://172.31.168.100:9696/v2.0/networks' \
--header 'X-Auth-Token: $TOKEN' \
--header 'X-Openstack-Request-Id: req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae'
**Environment**:
* OS (e.g. from /etc/os-release): Rocky Linux
* Kernel (e.g. `uname -a`): 5.14.0-162.12.1.el9_1.0.2.x86_64
* Docker version if applicable (e.g. `docker version`): Docker version 20.10.21, build baeda1f
* Kolla-Ansible version (e.g. `git head or tag or stable branch` or pip package version if using release): https://github.com/openstack/kolla-ansible/tree/stable/zed
* Docker image Install type (source/binary): binary
* Docker image distribution: zed
* Are you using official images from Docker Hub or self built?
* If self built - Kolla version and environment used to build:
* Share your inventory file, globals.yml and other configuration files if relevant
cat kolla-venv/share/kolla-ansible/ansible/roles/common/templates/conf/input/00-global.conf.j2
#jinja2: trim_blocks: False
{% if fluentd_enabled_input_openstack_services | length > 0 -%}
<source>
@type tail
path {% for service in fluentd_enabled_input_openstack_services %}/var/log/kolla/{{ service }}/*.log{% if not loop.last %},{% endif %}{% endfor %}
exclude_path ["/var/log/kolla/neutron/dnsmasq.log",
"/var/log/kolla/ironic/dnsmasq.log",
"/var/log/kolla/*/*-access.log",
"/var/log/kolla/*/*-error.log",
"/var/log/kolla/*/*_access.log",
"/var/log/kolla/*/*_error.log"]
pos_file /var/run/td-agent/kolla-openstack.pos
tag kolla.*
ignore_repeated_permission_error true
enable_watch_timer false
<parse>
@type multiline
format_firstline /^\d{4}-\d{2}-\d{2} \d{2}:\d{2}:\d{2}.\d{3} \d+ \S+ \S+ \[.*\]/
format1 /^(?<Timestamp>\S+ \S+) (?<Pid>\d+) (?<log_level>\S+) (?<python_module>\S+) \[(\S+ req-)?((?<x_request_id>\S+) (?<request_id>\S+) (?<user_id>\S+) (?<tenant_id>\S+) (?<domain_id>\S+) (?<system_scope>\S+) (?<user_domain>\S+) (?<project_domain>\S+)|-)\] (?<Payload>.*)?$/
time_key Timestamp
keep_time_key true
time_format %F %T.%L
</parse>
</source>
{%- endif %} |
|
| 2023-08-07 12:45:57 |
Ivan Galben |
description |
**Bug Report**
What happened:
Hi.
If I enter my request id as stated in the documentation https://docs.openstack.org/api-guide/compute/faults.html it doesn't show up in opensearch.
Requests without my request id go well, I see an entry in opensearch
2023-08-06 03:51:31.951 35 INFO nova.api.openstack.requestlog [None req-bbcafeda-8d1a-4b80-948d-58c48c408060 b2098ef1f52a4451a8c9860708a118d4 8e0ea207eddd4960abaddd3c610640ba - - default default] 172.31.153.100 "GET /v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.93 time: 0.012029
But when i send my own tracking request id 'X-Openstack-Request-Id'
curl --location 'http://172.31.168.100:9696/v2.0/networks' \
--header 'X-Auth-Token: $TOKEN' \
--header 'X-Openstack-Request-Id: req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae'
it is not in Opensearch, there is an entry in /var/log/kolla/nova/nova-api.log
2023-08-06 03:51:31.885 34 INFO nova.api.openstack.requestlog [req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae req-231c5129-eca9-41fd-8486-ccec69c978f9 b2098ef1f52a4451a8c9860708a118d4 8e0ea207eddd4960abaddd3c610640ba - - default default] 172.31.153.100 "GET /v2.1/limits?tenant_id=b1c3908d4a8342b18df522b6f53d6049" status: 200 len: 302 microversion: 2.93 time: 0.017379
The filter kolla-venv/share/kolla-ansible/ansible/roles/common/templates/conf/input/00-global.conf.j2
(\S+ req-)?((?<request_id>\S+) (?<user_id>\S+) (?<tenant_id>\S+) (?<domain_id>\S+) (?<system_scope>\S+) (?<user_domain>\S+) (?<project_domain>\S+)|-)
is missing an entry to handle the extra request id field.
What you expected to happen:
Fluentd config needs an extra field for Request ID
How to reproduce it:
curl --location 'http://172.31.168.100:9696/v2.0/networks' \
--header 'X-Auth-Token: $TOKEN' \
--header 'X-Openstack-Request-Id: req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae'
**Environment**:
* OS (e.g. from /etc/os-release): Rocky Linux
* Kernel (e.g. `uname -a`): 5.14.0-162.12.1.el9_1.0.2.x86_64
* Docker version if applicable (e.g. `docker version`): Docker version 20.10.21, build baeda1f
* Kolla-Ansible version (e.g. `git head or tag or stable branch` or pip package version if using release): https://github.com/openstack/kolla-ansible/tree/stable/zed
* Docker image Install type (source/binary): binary
* Docker image distribution: zed
* Are you using official images from Docker Hub or self built?
* If self built - Kolla version and environment used to build:
* Share your inventory file, globals.yml and other configuration files if relevant
cat kolla-venv/share/kolla-ansible/ansible/roles/common/templates/conf/input/00-global.conf.j2
#jinja2: trim_blocks: False
{% if fluentd_enabled_input_openstack_services | length > 0 -%}
<source>
@type tail
path {% for service in fluentd_enabled_input_openstack_services %}/var/log/kolla/{{ service }}/*.log{% if not loop.last %},{% endif %}{% endfor %}
exclude_path ["/var/log/kolla/neutron/dnsmasq.log",
"/var/log/kolla/ironic/dnsmasq.log",
"/var/log/kolla/*/*-access.log",
"/var/log/kolla/*/*-error.log",
"/var/log/kolla/*/*_access.log",
"/var/log/kolla/*/*_error.log"]
pos_file /var/run/td-agent/kolla-openstack.pos
tag kolla.*
ignore_repeated_permission_error true
enable_watch_timer false
<parse>
@type multiline
format_firstline /^\d{4}-\d{2}-\d{2} \d{2}:\d{2}:\d{2}.\d{3} \d+ \S+ \S+ \[.*\]/
format1 /^(?<Timestamp>\S+ \S+) (?<Pid>\d+) (?<log_level>\S+) (?<python_module>\S+) \[(\S+ req-)?((?<x_request_id>\S+) (?<request_id>\S+) (?<user_id>\S+) (?<tenant_id>\S+) (?<domain_id>\S+) (?<system_scope>\S+) (?<user_domain>\S+) (?<project_domain>\S+)|-)\] (?<Payload>.*)?$/
time_key Timestamp
keep_time_key true
time_format %F %T.%L
</parse>
</source>
{%- endif %} |
**Bug Report**
What happened:
Hi.
If I enter my request id as stated in the documentation https://docs.openstack.org/api-guide/compute/faults.html it doesn't show up in opensearch.
Requests without my request id go well, I see an entry in opensearch
2023-08-06 03:51:31.951 35 INFO nova.api.openstack.requestlog [None req-bbcafeda-8d1a-4b80-948d-58c48c408060 b2098ef1f52a4451a8c9860708a118d4 8e0ea207eddd4960abaddd3c610640ba - - default default] 172.31.153.100 "GET /v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.93 time: 0.012029
But when i send my own tracking request id 'X-Openstack-Request-Id'
curl --location 'http://172.31.168.100:9696/v2.0/networks' \
--header 'X-Auth-Token: $TOKEN' \
--header 'X-Openstack-Request-Id: req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae'
it is not in Opensearch, there is an entry in /var/log/kolla/nova/nova-api.log
2023-08-06 03:51:31.885 34 INFO nova.api.openstack.requestlog [req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae req-231c5129-eca9-41fd-8486-ccec69c978f9 b2098ef1f52a4451a8c9860708a118d4 8e0ea207eddd4960abaddd3c610640ba - - default default] 172.31.153.100 "GET /v2.1/limits?tenant_id=b1c3908d4a8342b18df522b6f53d6049" status: 200 len: 302 microversion: 2.93 time: 0.017379
The filter kolla-venv/share/kolla-ansible/ansible/roles/common/templates/conf/input/00-global.conf.j2
(\S+ req-)?((?<request_id>\S+) (?<user_id>\S+) (?<tenant_id>\S+) (?<domain_id>\S+) (?<system_scope>\S+) (?<user_domain>\S+) (?<project_domain>\S+)|-)
is missing an entry to handle the extra request id field.
What you expected to happen:
Fluentd config needs an extra field for Request ID
How to reproduce it:
curl --location 'http://172.31.168.100:9696/v2.0/networks' \
--header 'X-Auth-Token: $TOKEN' \
--header 'X-Openstack-Request-Id: req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae'
**Environment**:
* OS (e.g. from /etc/os-release): Rocky Linux
* Kernel (e.g. `uname -a`): 5.14.0-162.12.1.el9_1.0.2.x86_64
* Docker version if applicable (e.g. `docker version`): Docker version 20.10.21, build baeda1f
* Kolla-Ansible version (e.g. `git head or tag or stable branch` or pip package version if using release): https://github.com/openstack/kolla-ansible/tree/stable/zed
* Docker image Install type (source/binary): binary
* Docker image distribution: zed
* Are you using official images from Docker Hub or self built?
* If self built - Kolla version and environment used to build:
* Share your inventory file, globals.yml and other configuration files if relevant
cat kolla-venv/share/kolla-ansible/ansible/roles/common/templates/conf/input/00-global.conf.j2
#jinja2: trim_blocks: False
{% if fluentd_enabled_input_openstack_services | length > 0 -%}
<source>
@type tail
path {% for service in fluentd_enabled_input_openstack_services %}/var/log/kolla/{{ service }}/*.log{% if not loop.last %},{% endif %}{% endfor %}
exclude_path ["/var/log/kolla/neutron/dnsmasq.log",
"/var/log/kolla/ironic/dnsmasq.log",
"/var/log/kolla/*/*-access.log",
"/var/log/kolla/*/*-error.log",
"/var/log/kolla/*/*_access.log",
"/var/log/kolla/*/*_error.log"]
pos_file /var/run/td-agent/kolla-openstack.pos
tag kolla.*
ignore_repeated_permission_error true
enable_watch_timer false
<parse>
@type multiline
format_firstline /^\d{4}-\d{2}-\d{2} \d{2}:\d{2}:\d{2}.\d{3} \d+ \S+ \S+ \[.*\]/
format1 /^(?<Timestamp>\S+ \S+) (?<Pid>\d+) (?<log_level>\S+) (?<python_module>\S+) \[(\S+ req-)?((?<request_id>\S+) (?<user_id>\S+) (?<tenant_id>\S+) (?<domain_id>\S+) (?<system_scope>\S+) (?<user_domain>\S+) (?<project_domain>\S+)|-)\] (?<Payload>.*)?$/
time_key Timestamp
keep_time_key true
time_format %F %T.%L
</parse>
</source>
{%- endif %} |
|
| 2023-08-07 12:47:48 |
Ivan Galben |
description |
**Bug Report**
What happened:
Hi.
If I enter my request id as stated in the documentation https://docs.openstack.org/api-guide/compute/faults.html it doesn't show up in opensearch.
Requests without my request id go well, I see an entry in opensearch
2023-08-06 03:51:31.951 35 INFO nova.api.openstack.requestlog [None req-bbcafeda-8d1a-4b80-948d-58c48c408060 b2098ef1f52a4451a8c9860708a118d4 8e0ea207eddd4960abaddd3c610640ba - - default default] 172.31.153.100 "GET /v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.93 time: 0.012029
But when i send my own tracking request id 'X-Openstack-Request-Id'
curl --location 'http://172.31.168.100:9696/v2.0/networks' \
--header 'X-Auth-Token: $TOKEN' \
--header 'X-Openstack-Request-Id: req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae'
it is not in Opensearch, there is an entry in /var/log/kolla/nova/nova-api.log
2023-08-06 03:51:31.885 34 INFO nova.api.openstack.requestlog [req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae req-231c5129-eca9-41fd-8486-ccec69c978f9 b2098ef1f52a4451a8c9860708a118d4 8e0ea207eddd4960abaddd3c610640ba - - default default] 172.31.153.100 "GET /v2.1/limits?tenant_id=b1c3908d4a8342b18df522b6f53d6049" status: 200 len: 302 microversion: 2.93 time: 0.017379
The filter kolla-venv/share/kolla-ansible/ansible/roles/common/templates/conf/input/00-global.conf.j2
(\S+ req-)?((?<request_id>\S+) (?<user_id>\S+) (?<tenant_id>\S+) (?<domain_id>\S+) (?<system_scope>\S+) (?<user_domain>\S+) (?<project_domain>\S+)|-)
is missing an entry to handle the extra request id field.
What you expected to happen:
Fluentd config needs an extra field for Request ID
How to reproduce it:
curl --location 'http://172.31.168.100:9696/v2.0/networks' \
--header 'X-Auth-Token: $TOKEN' \
--header 'X-Openstack-Request-Id: req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae'
**Environment**:
* OS (e.g. from /etc/os-release): Rocky Linux
* Kernel (e.g. `uname -a`): 5.14.0-162.12.1.el9_1.0.2.x86_64
* Docker version if applicable (e.g. `docker version`): Docker version 20.10.21, build baeda1f
* Kolla-Ansible version (e.g. `git head or tag or stable branch` or pip package version if using release): https://github.com/openstack/kolla-ansible/tree/stable/zed
* Docker image Install type (source/binary): binary
* Docker image distribution: zed
* Are you using official images from Docker Hub or self built?
* If self built - Kolla version and environment used to build:
* Share your inventory file, globals.yml and other configuration files if relevant
cat kolla-venv/share/kolla-ansible/ansible/roles/common/templates/conf/input/00-global.conf.j2
#jinja2: trim_blocks: False
{% if fluentd_enabled_input_openstack_services | length > 0 -%}
<source>
@type tail
path {% for service in fluentd_enabled_input_openstack_services %}/var/log/kolla/{{ service }}/*.log{% if not loop.last %},{% endif %}{% endfor %}
exclude_path ["/var/log/kolla/neutron/dnsmasq.log",
"/var/log/kolla/ironic/dnsmasq.log",
"/var/log/kolla/*/*-access.log",
"/var/log/kolla/*/*-error.log",
"/var/log/kolla/*/*_access.log",
"/var/log/kolla/*/*_error.log"]
pos_file /var/run/td-agent/kolla-openstack.pos
tag kolla.*
ignore_repeated_permission_error true
enable_watch_timer false
<parse>
@type multiline
format_firstline /^\d{4}-\d{2}-\d{2} \d{2}:\d{2}:\d{2}.\d{3} \d+ \S+ \S+ \[.*\]/
format1 /^(?<Timestamp>\S+ \S+) (?<Pid>\d+) (?<log_level>\S+) (?<python_module>\S+) \[(\S+ req-)?((?<request_id>\S+) (?<user_id>\S+) (?<tenant_id>\S+) (?<domain_id>\S+) (?<system_scope>\S+) (?<user_domain>\S+) (?<project_domain>\S+)|-)\] (?<Payload>.*)?$/
time_key Timestamp
keep_time_key true
time_format %F %T.%L
</parse>
</source>
{%- endif %} |
**Bug Report**
What happened:
Hi.
If I enter my request id as stated in the documentation https://docs.openstack.org/api-guide/compute/faults.html it doesn't show up in opensearch.
Requests without my request id go well, I see an entry in opensearch
2023-08-06 03:51:31.951 35 INFO nova.api.openstack.requestlog [None req-bbcafeda-8d1a-4b80-948d-58c48c408060 b2098ef1f52a4451a8c9860708a118d4 8e0ea207eddd4960abaddd3c610640ba - - default default] 172.31.153.100 "GET /v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.93 time: 0.012029
But when i send my own tracking request id 'X-Openstack-Request-Id'
curl --location 'http://172.31.168.100:9696/v2.0/networks' \
--header 'X-Auth-Token: $TOKEN' \
--header 'X-Openstack-Request-Id: req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae'
it is not in Opensearch, there is an entry in /var/log/kolla/nova/nova-api.log
2023-08-06 03:51:31.885 34 INFO nova.api.openstack.requestlog [req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae req-231c5129-eca9-41fd-8486-ccec69c978f9 b2098ef1f52a4451a8c9860708a118d4 8e0ea207eddd4960abaddd3c610640ba - - default default] 172.31.153.100 "GET /v2.1/limits?tenant_id=b1c3908d4a8342b18df522b6f53d6049" status: 200 len: 302 microversion: 2.93 time: 0.017379
The parser kolla-venv/share/kolla-ansible/ansible/roles/common/templates/conf/input/00-global.conf.j2
(\S+ req-)?((?<request_id>\S+) (?<user_id>\S+) (?<tenant_id>\S+) (?<domain_id>\S+) (?<system_scope>\S+) (?<user_domain>\S+) (?<project_domain>\S+)|-)
is missing an entry to handle the extra request id field.
What you expected to happen:
Fluentd config needs an extra field for Request ID
How to reproduce it:
curl --location 'http://172.31.168.100:9696/v2.0/networks' \
--header 'X-Auth-Token: $TOKEN' \
--header 'X-Openstack-Request-Id: req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae'
**Environment**:
* OS (e.g. from /etc/os-release): Rocky Linux
* Kernel (e.g. `uname -a`): 5.14.0-162.12.1.el9_1.0.2.x86_64
* Docker version if applicable (e.g. `docker version`): Docker version 20.10.21, build baeda1f
* Kolla-Ansible version (e.g. `git head or tag or stable branch` or pip package version if using release): https://github.com/openstack/kolla-ansible/tree/stable/zed
* Docker image Install type (source/binary): binary
* Docker image distribution: zed
* Are you using official images from Docker Hub or self built?
* If self built - Kolla version and environment used to build:
* Share your inventory file, globals.yml and other configuration files if relevant
cat kolla-venv/share/kolla-ansible/ansible/roles/common/templates/conf/input/00-global.conf.j2
#jinja2: trim_blocks: False
{% if fluentd_enabled_input_openstack_services | length > 0 -%}
<source>
@type tail
path {% for service in fluentd_enabled_input_openstack_services %}/var/log/kolla/{{ service }}/*.log{% if not loop.last %},{% endif %}{% endfor %}
exclude_path ["/var/log/kolla/neutron/dnsmasq.log",
"/var/log/kolla/ironic/dnsmasq.log",
"/var/log/kolla/*/*-access.log",
"/var/log/kolla/*/*-error.log",
"/var/log/kolla/*/*_access.log",
"/var/log/kolla/*/*_error.log"]
pos_file /var/run/td-agent/kolla-openstack.pos
tag kolla.*
ignore_repeated_permission_error true
enable_watch_timer false
<parse>
@type multiline
format_firstline /^\d{4}-\d{2}-\d{2} \d{2}:\d{2}:\d{2}.\d{3} \d+ \S+ \S+ \[.*\]/
format1 /^(?<Timestamp>\S+ \S+) (?<Pid>\d+) (?<log_level>\S+) (?<python_module>\S+) \[(\S+ req-)?((?<request_id>\S+) (?<user_id>\S+) (?<tenant_id>\S+) (?<domain_id>\S+) (?<system_scope>\S+) (?<user_domain>\S+) (?<project_domain>\S+)|-)\] (?<Payload>.*)?$/
time_key Timestamp
keep_time_key true
time_format %F %T.%L
</parse>
</source>
{%- endif %} |
|
| 2023-08-07 12:56:15 |
Ivan Galben |
description |
**Bug Report**
What happened:
Hi.
If I enter my request id as stated in the documentation https://docs.openstack.org/api-guide/compute/faults.html it doesn't show up in opensearch.
Requests without my request id go well, I see an entry in opensearch
2023-08-06 03:51:31.951 35 INFO nova.api.openstack.requestlog [None req-bbcafeda-8d1a-4b80-948d-58c48c408060 b2098ef1f52a4451a8c9860708a118d4 8e0ea207eddd4960abaddd3c610640ba - - default default] 172.31.153.100 "GET /v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.93 time: 0.012029
But when i send my own tracking request id 'X-Openstack-Request-Id'
curl --location 'http://172.31.168.100:9696/v2.0/networks' \
--header 'X-Auth-Token: $TOKEN' \
--header 'X-Openstack-Request-Id: req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae'
it is not in Opensearch, there is an entry in /var/log/kolla/nova/nova-api.log
2023-08-06 03:51:31.885 34 INFO nova.api.openstack.requestlog [req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae req-231c5129-eca9-41fd-8486-ccec69c978f9 b2098ef1f52a4451a8c9860708a118d4 8e0ea207eddd4960abaddd3c610640ba - - default default] 172.31.153.100 "GET /v2.1/limits?tenant_id=b1c3908d4a8342b18df522b6f53d6049" status: 200 len: 302 microversion: 2.93 time: 0.017379
The parser kolla-venv/share/kolla-ansible/ansible/roles/common/templates/conf/input/00-global.conf.j2
(\S+ req-)?((?<request_id>\S+) (?<user_id>\S+) (?<tenant_id>\S+) (?<domain_id>\S+) (?<system_scope>\S+) (?<user_domain>\S+) (?<project_domain>\S+)|-)
is missing an entry to handle the extra request id field.
What you expected to happen:
Fluentd config needs an extra field for Request ID
How to reproduce it:
curl --location 'http://172.31.168.100:9696/v2.0/networks' \
--header 'X-Auth-Token: $TOKEN' \
--header 'X-Openstack-Request-Id: req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae'
**Environment**:
* OS (e.g. from /etc/os-release): Rocky Linux
* Kernel (e.g. `uname -a`): 5.14.0-162.12.1.el9_1.0.2.x86_64
* Docker version if applicable (e.g. `docker version`): Docker version 20.10.21, build baeda1f
* Kolla-Ansible version (e.g. `git head or tag or stable branch` or pip package version if using release): https://github.com/openstack/kolla-ansible/tree/stable/zed
* Docker image Install type (source/binary): binary
* Docker image distribution: zed
* Are you using official images from Docker Hub or self built?
* If self built - Kolla version and environment used to build:
* Share your inventory file, globals.yml and other configuration files if relevant
cat kolla-venv/share/kolla-ansible/ansible/roles/common/templates/conf/input/00-global.conf.j2
#jinja2: trim_blocks: False
{% if fluentd_enabled_input_openstack_services | length > 0 -%}
<source>
@type tail
path {% for service in fluentd_enabled_input_openstack_services %}/var/log/kolla/{{ service }}/*.log{% if not loop.last %},{% endif %}{% endfor %}
exclude_path ["/var/log/kolla/neutron/dnsmasq.log",
"/var/log/kolla/ironic/dnsmasq.log",
"/var/log/kolla/*/*-access.log",
"/var/log/kolla/*/*-error.log",
"/var/log/kolla/*/*_access.log",
"/var/log/kolla/*/*_error.log"]
pos_file /var/run/td-agent/kolla-openstack.pos
tag kolla.*
ignore_repeated_permission_error true
enable_watch_timer false
<parse>
@type multiline
format_firstline /^\d{4}-\d{2}-\d{2} \d{2}:\d{2}:\d{2}.\d{3} \d+ \S+ \S+ \[.*\]/
format1 /^(?<Timestamp>\S+ \S+) (?<Pid>\d+) (?<log_level>\S+) (?<python_module>\S+) \[(\S+ req-)?((?<request_id>\S+) (?<user_id>\S+) (?<tenant_id>\S+) (?<domain_id>\S+) (?<system_scope>\S+) (?<user_domain>\S+) (?<project_domain>\S+)|-)\] (?<Payload>.*)?$/
time_key Timestamp
keep_time_key true
time_format %F %T.%L
</parse>
</source>
{%- endif %} |
**Bug Report**
What happened:
Hi.
If I enter my request id as stated in the documentation https://docs.openstack.org/api-guide/compute/faults.html it doesn't show up in opensearch.
Requests without my request id go well, I see an entry in opensearch
2023-08-06 03:51:31.951 35 INFO nova.api.openstack.requestlog [None req-bbcafeda-8d1a-4b80-948d-58c48c408060 b2098ef1f52a4451a8c9860708a118d4 8e0ea207eddd4960abaddd3c610640ba - - default default] 172.31.153.100 "GET /v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.93 time: 0.012029
But when i send my own tracking request id 'X-Openstack-Request-Id'
curl --location 'http://172.31.168.100:9696/v2.0/networks' \
--header 'X-Auth-Token: $TOKEN' \
--header 'X-Openstack-Request-Id: req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae'
it is not in Opensearch, there is an entry in /var/log/kolla/nova/nova-api.log
2023-08-06 03:51:31.885 34 INFO nova.api.openstack.requestlog [req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae req-231c5129-eca9-41fd-8486-ccec69c978f9 b2098ef1f52a4451a8c9860708a118d4 8e0ea207eddd4960abaddd3c610640ba - - default default] 172.31.153.100 "GET /v2.1/limits?tenant_id=b1c3908d4a8342b18df522b6f53d6049" status: 200 len: 302 microversion: 2.93 time: 0.017379
The parser kolla-venv/share/kolla-ansible/ansible/roles/common/templates/conf/input/00-global.conf.j2
(\S+ req-)?((?<request_id>\S+) (?<user_id>\S+) (?<tenant_id>\S+) (?<domain_id>\S+) (?<system_scope>\S+) (?<user_domain>\S+) (?<project_domain>\S+)|-)
is missing an entry to handle the extra request id field.
What you expected to happen:
Fluentd config needs an extra field for Request ID
How to reproduce it:
curl --location 'http://172.31.168.100:9696/v2.0/networks' \
--header 'X-Auth-Token: $TOKEN' \
--header 'X-Openstack-Request-Id: req-3dccb8c4-08fe-4706-a91d-aeaeaeaeaeae'
Regex is available at: https://rubular.com/r/cdLiZTuautF8Zz
**Environment**:
* OS (e.g. from /etc/os-release): Rocky Linux
* Kernel (e.g. `uname -a`): 5.14.0-162.12.1.el9_1.0.2.x86_64
* Docker version if applicable (e.g. `docker version`): Docker version 20.10.21, build baeda1f
* Kolla-Ansible version (e.g. `git head or tag or stable branch` or pip package version if using release): https://github.com/openstack/kolla-ansible/tree/stable/zed
* Docker image Install type (source/binary): binary
* Docker image distribution: zed
* Are you using official images from Docker Hub or self built?
* If self built - Kolla version and environment used to build:
* Share your inventory file, globals.yml and other configuration files if relevant
cat kolla-venv/share/kolla-ansible/ansible/roles/common/templates/conf/input/00-global.conf.j2
#jinja2: trim_blocks: False
{% if fluentd_enabled_input_openstack_services | length > 0 -%}
<source>
@type tail
path {% for service in fluentd_enabled_input_openstack_services %}/var/log/kolla/{{ service }}/*.log{% if not loop.last %},{% endif %}{% endfor %}
exclude_path ["/var/log/kolla/neutron/dnsmasq.log",
"/var/log/kolla/ironic/dnsmasq.log",
"/var/log/kolla/*/*-access.log",
"/var/log/kolla/*/*-error.log",
"/var/log/kolla/*/*_access.log",
"/var/log/kolla/*/*_error.log"]
pos_file /var/run/td-agent/kolla-openstack.pos
tag kolla.*
ignore_repeated_permission_error true
enable_watch_timer false
<parse>
@type multiline
format_firstline /^\d{4}-\d{2}-\d{2} \d{2}:\d{2}:\d{2}.\d{3} \d+ \S+ \S+ \[.*\]/
format1 /^(?<Timestamp>\S+ \S+) (?<Pid>\d+) (?<log_level>\S+) (?<python_module>\S+) \[(\S+ req-)?((?<request_id>\S+) (?<user_id>\S+) (?<tenant_id>\S+) (?<domain_id>\S+) (?<system_scope>\S+) (?<user_domain>\S+) (?<project_domain>\S+)|-)\] (?<Payload>.*)?$/
time_key Timestamp
keep_time_key true
time_format %F %T.%L
</parse>
</source>
{%- endif %} |
|
