kolla-ansible

neutron and glance pls proxy fluent parsing errors

Bug #2029128 reported by Michal Nasiadka on 2023-07-31

This bug affects 2 people

	Status	Importance	Assigned to
kolla-ansible	Fix Released	Undecided	Unassigned
Antelope	Fix Released	Undecided	Unassigned
Bobcat	Fix Released	Undecided	Unassigned
Yoga	Fix Released	Undecided	Unassigned
Zed	Fix Released	Undecided	Unassigned

Bug Description

2023-07-31 10:46:40 +0000 [warn]: #0 got incomplete line before first line from /var/log/kolla/neutron-tls-proxy/neutron-tls-proxy.log: "{\"Payload\":\"Jul 31 10:45:36 haproxy[952]: Connect from 192.0.2.1:54388 to 192.0.2.1:9697 (stats/HTTP)\",\"log_level\":\"info\",\"Hostname\":\"primary\",\"programname\":\"neutron-tls-proxy\"}\n"
2023-07-31 10:46:40 +0000 [warn]: #0 got incomplete line before first line from /var/log/kolla/neutron-tls-proxy/neutron-tls-proxy.log: "{\"Payload\":\"Jul 31 10:45:36 haproxy[952]: Connect from 192.0.2.1:32900 to 192.0.2.1:9696 (neutron_backend_tls/TCP)\",\"log_level\":\"info\",\"Hostname\":\"primary\",\"programname\":\"neutron-tls-proxy\"}\n"
2023-07-31 10:46:40 +0000 [warn]: #0 got incomplete line before first line from /var/log/kolla/neutron-tls-proxy/neutron-tls-proxy.log: "{\"Payload\":\"Jul 31 10:45:39 haproxy[952]: Connect from 192.0.2.1:42776 to 192.0.2.1:9696 (neutron_backend_tls/TCP)\",\"log_level\":\"info\",\"Hostname\":\"primary\",\"programname\":\"neutron-tls-proxy\"}\n"
2023-07-31 10:46:40 +0000 [warn]: #0 got incomplete line before first line from /var/log/kolla/neutron-tls-proxy/neutron-tls-proxy.log: "{\"Payload\":\"Jul 31 10:45:41 haproxy[952]: Connect from 192.0.2.1:42808 to 192.0.2.1:9696 (neutron_backend_tls/TCP)\",\"log_level\":\"info\",\"Hostname\":\"primary\",\"programname\":\"neutron-tls-proxy\"}\n"
2023-07-31 10:46:40 +0000 [warn]: #0 got incomplete line before first line from /var/log/kolla/neutron-tls-proxy/neutron-tls-proxy.log: "{\"Payload\":\"Jul 31 10:45:42 haproxy[952]: Connect from 192.0.2.1:42820 to 192.0.2.1:9696 (neutron_backend_tls/TCP)\",\"log_level\":\"info\",\"Hostname\":\"primary\",\"programname\":\"neutron-tls-proxy\"}\n"
2023-07-31 10:46:40 +0000 [warn]: #0 got incomplete line before first line from /var/log/kolla/neutron-tls-proxy/neutron-tls-proxy.log: "{\"Payload\":\"Jul 31 10:45:44 haproxy[952]: Connect from 192.0.2.1:42840 to 192.0.2.1:9696 (neutron_backend_tls/TCP)\",\"log_level\":\"info\",\"Hostname\":\"primary\",\"programname\":\"neutron-tls-proxy\"}\n"
2023-07-31 10:46:40 +0000 [warn]: #0 got incomplete line before first line from /var/log/kolla/neutron-tls-proxy/neutron-tls-proxy.log: "{\"Payload\":\"Jul 31 10:45:49 haproxy[952]: Connect from 192.0.2.1:37436 to 192.0.2.1:9696 (neutron_backend_tls/TCP)\",\"log_level\":\"info\",\"Hostname\":\"primary\",\"programname\":\"neutron-tls-proxy\"}\n"
2023-07-31 10:46:40 +0000 [warn]: #0 got incomplete line before first line from /var/log/kolla/neutron-tls-proxy/neutron-tls-proxy.log: "{\"Payload\":\"Jul 31 10:45:57 haproxy[952]: Connect from 192.0.2.1:37464 to 192.0.2.1:9696 (neutron_backend_tls/TCP)\",\"log_level\":\"info\",\"Hostname\":\"primary\",\"programname\":\"neutron-tls-proxy\"}\n"
2023-07-31 10:46:40 +0000 [warn]: #0 got incomplete line before first line from /var/log/kolla/neutron-tls-proxy/neutron-tls-proxy.log: "{\"Payload\":\"Jul 31 10:45:58 haproxy[952]: Connect from 192.0.2.1:37478 to 192.0.2.1:9696 (neutron_backend_tls/TCP)\",\"log_level\":\"info\",\"Hostname\":\"primary\",\"programname\":\"neutron-tls-proxy\"}\n"
2023-07-31 10:46:40 +0000 [warn]: #0 got incomplete line before first line from /var/log/kolla/neutron-tls-proxy/neutron-tls-proxy.log: "{\"Payload\":\"Jul 31 10:46:00 haproxy[952]: Connect from 192.0.2.1:37962 to 192.0.2.1:9696 (neutron_backend_tls/TCP)\",\"log_level\":\"info\",\"Hostname\":\"primary\",\"programname\":\"neutron-tls-proxy\"}\n"
2023-07-31 10:46:40 +0000 [warn]: #0 got incomplete line before first line from /var/log/kolla/neutron-tls-proxy/neutron-tls-proxy.log: "{\"Payload\":\"Jul 31 10:46:02 haproxy[952]: Connect from 192.0.2.1:37976 to 192.0.2.1:9696 (neutron_backend_tls/TCP)\",\"log_level\":\"info\",\"Hostname\":\"primary\",\"programname\":\"neutron-tls-proxy\"}\n"
2023-07-31 10:46:40 +0000 [warn]: #0 got incomplete line before first line from /var/log/kolla/neutron-tls-proxy/neutron-tls-proxy.log: "{\"Payload\":\"Jul 31 10:46:06 haproxy[952]: Connect from 192.0.2.1:41514 to 192.0.2.1:9697 (stats/HTTP)\",\"log_level\":\"info\",\"Hostname\":\"primary\",\"programname\":\"neutron-tls-proxy\"}\n"
2023-07-31 10:46:40 +0000 [warn]: #0 got incomplete line before first line from /var/log/kolla/neutron-tls-proxy/neutron-tls-proxy.log: "{\"Payload\":\"Jul 31 10:46:19 haproxy[952]: Connect from 192.0.2.1:44182 to 192.0.2.1:9696 (neutron_backend_tls/TCP)\",\"log_level\":\"info\",\"Hostname\":\"primary\",\"programname\":\"neutron-tls-proxy\"}\n"
2023-07-31 10:46:40 +0000 [warn]: #0 got incomplete line before first line from /var/log/kolla/neutron-tls-proxy/neutron-tls-proxy.log: "{\"Payload\":\"Jul 31 10:46:36 haproxy[952]: Connect from 192.0.2.1:36796 to 192.0.2.1:9697 (stats/HTTP)\",\"log_level\":\"info\",\"Hostname\":\"primary\",\"programname\":\"neutron-tls-proxy\"}\n"
2023-07-31 10:46:40 +0000 [warn]: #0 got incomplete line before first line from /var/log/kolla/neutron-tls-proxy/neutron-tls-proxy.log: "{\"Payload\":\"Jul 31 10:46:39 haproxy[952]: Connect from 192.0.2.1:59824 to 192.0.2.1:9696 (neutron_backend_tls/TCP)\",\"log_level\":\"info\",\"Hostname\":\"primary\",\"programname\":\"neutron-tls-proxy\"}\n"

Tags:

Michal Nasiadka (mnasiadka) on 2023-07-31

Changed in kolla-ansible:
status:	New → Triaged

OpenStack Infra (hudson-openstack) on 2023-09-22

Changed in kolla-ansible:
status:	Triaged → In Progress

Revision history for this message

Maksim Malchuk (mmalchuk) wrote on 2023-09-22:

Fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/kolla-ansible/+/890085

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2023-11-21: Fix merged to kolla-ansible (master)

Reviewed: https://review.opendev.org/c/openstack/kolla-ansible/+/890085
Committed: https://opendev.org/openstack/kolla-ansible/commit/4c82809127b2944f487aa86d198c8da123fc72ab
Submitter: "Zuul (22348)"
Branch: master

commit 4c82809127b2944f487aa86d198c8da123fc72ab
Author: Michal Nasiadka <email address hidden>
Date: Mon Jul 31 13:39:52 2023 +0200

Remove Glance and Neutron TLS proxies from fluentd input config

    Those logs are haproxy logs which are pushed through fluentd
    syslog input (just like ,,normal'' haproxy logs) and we don't
    parse them at all.

Closes-Bug: #2029128
Change-Id: Ic2529e905ebbec6180179b89568f9bd5a0581035

Changed in kolla-ansible:
status:	In Progress → Fix Released

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2023-11-28: Fix proposed to kolla-ansible (stable/2023.1)

Fix proposed to branch: stable/2023.1
Review: https://review.opendev.org/c/openstack/kolla-ansible/+/902035

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2023-11-28: Fix proposed to kolla-ansible (stable/zed)

Fix proposed to branch: stable/zed
Review: https://review.opendev.org/c/openstack/kolla-ansible/+/902036

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2023-11-28: Fix proposed to kolla-ansible (stable/yoga)

Fix proposed to branch: stable/yoga
Review: https://review.opendev.org/c/openstack/kolla-ansible/+/902037

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2023-11-28: Fix merged to kolla-ansible (stable/yoga)

Reviewed: https://review.opendev.org/c/openstack/kolla-ansible/+/902037
Committed: https://opendev.org/openstack/kolla-ansible/commit/0cedba5191710ce80003b72046480ad95b53744a
Submitter: "Zuul (22348)"
Branch: stable/yoga

commit 0cedba5191710ce80003b72046480ad95b53744a
Author: Michal Nasiadka <email address hidden>
Date: Mon Jul 31 13:39:52 2023 +0200

Remove Glance and Neutron TLS proxies from fluentd input config

    Those logs are haproxy logs which are pushed through fluentd
    syslog input (just like ,,normal'' haproxy logs) and we don't
    parse them at all.

    Closes-Bug: #2029128
    Change-Id: Ic2529e905ebbec6180179b89568f9bd5a0581035
    (cherry picked from commit 4c82809127b2944f487aa86d198c8da123fc72ab)

tags:

added: in-stable-yoga

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2023-11-28: Fix merged to kolla-ansible (stable/2023.1)

Reviewed: https://review.opendev.org/c/openstack/kolla-ansible/+/902035
Committed: https://opendev.org/openstack/kolla-ansible/commit/37652912485e9d7a7021acb6d9386edbdc701af0
Submitter: "Zuul (22348)"
Branch: stable/2023.1

commit 37652912485e9d7a7021acb6d9386edbdc701af0
Author: Michal Nasiadka <email address hidden>
Date: Mon Jul 31 13:39:52 2023 +0200

Remove Glance and Neutron TLS proxies from fluentd input config

    Those logs are haproxy logs which are pushed through fluentd
    syslog input (just like ,,normal'' haproxy logs) and we don't
    parse them at all.

    Closes-Bug: #2029128
    Change-Id: Ic2529e905ebbec6180179b89568f9bd5a0581035
    (cherry picked from commit 4c82809127b2944f487aa86d198c8da123fc72ab)

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2023-11-28: Fix merged to kolla-ansible (stable/zed)

Reviewed: https://review.opendev.org/c/openstack/kolla-ansible/+/902036
Committed: https://opendev.org/openstack/kolla-ansible/commit/8782e73c7b2c65a784a7821d966a0318d6b1647f
Submitter: "Zuul (22348)"
Branch: stable/zed

commit 8782e73c7b2c65a784a7821d966a0318d6b1647f
Author: Michal Nasiadka <email address hidden>
Date: Mon Jul 31 13:39:52 2023 +0200

Remove Glance and Neutron TLS proxies from fluentd input config

    Those logs are haproxy logs which are pushed through fluentd
    syslog input (just like ,,normal'' haproxy logs) and we don't
    parse them at all.

    Closes-Bug: #2029128
    Change-Id: Ic2529e905ebbec6180179b89568f9bd5a0581035
    (cherry picked from commit 4c82809127b2944f487aa86d198c8da123fc72ab)

tags:

added: in-stable-zed

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2023-12-01: Fix included in openstack/kolla-ansible 17.0.0.0rc1

This issue was fixed in the openstack/kolla-ansible 17.0.0.0rc1 release candidate.

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2024-01-25: Fix included in openstack/kolla-ansible 16.3.0

#10

This issue was fixed in the openstack/kolla-ansible 16.3.0 release.

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2024-01-25: Fix included in openstack/kolla-ansible 14.11.0

#11

This issue was fixed in the openstack/kolla-ansible 14.11.0 release.

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2024-01-25: Fix included in openstack/kolla-ansible 15.4.0

#12

This issue was fixed in the openstack/kolla-ansible 15.4.0 release.

Report a bug

This report contains Public information

Everyone can see this information.

You are

Subscribing...

Edit bug mail

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.