Support of haproxy log aggregation capabilites

Bug #1665069 reported by Santhosh Fernandes
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
octavia
Invalid
Wishlist
Unassigned

Bug Description

We need to collect haproxy logs of amphora instance to a centralized location for our monitoring and analysis. Can we add hooks to achieve log aggregation, so that we can integrate with splunk, graylog,logstash/kibana and others.

Changed in octavia:
status: New → Triaged
importance: Undecided → Wishlist
Changed in octavia:
assignee: nobody → Ganpat Agarwal (gans-developer)
Revision history for this message
Ganpat Agarwal (gans-developer) wrote :

steps did:

Added variable "log_server" in "haproxy_amphora" section in octavia.conf
Passed it as parameter while creating instance for JinjaTemplater
Added log_server to common/config.py

haproxy does not allow to configure FQDN as log address.
 ( http://cbonte.github.io/haproxy-dconv/1.8/configuration.html#log )

When provided FQDN, config file check is failing.

Will have to pass on data in IP(:PORT) format.

Revision history for this message
Michael Johnson (johnsom) wrote :

Yes, we also disable DNS inside the amp for performance reasons.

Revision history for this message
Michael Johnson (johnsom) wrote :

Also note, there are two sets of logs with HAProxy, the administrative logs and then the connection tracking logs. This bug is tracking the connection tracking logs and not the administrative logs.

They should be handled separately.

Changed in octavia:
status: Triaged → In Progress
Revision history for this message
Adam Harwell (adam-harwell) wrote :

I believe in our meeting topic about this, there was general consensus around using a syslog related method to capture logs, for a variety of reasons.
http://eavesdrop.openstack.org/meetings/octavia/2017/octavia.2017-06-14-20.00.log.html#l-181

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on octavia (master)

Change abandoned by Michael Johnson (<email address hidden>) on branch: master
Review: https://review.opendev.org/471682
Reason: This is no longer needed as log offloading has replaced this idea.

Revision history for this message
Gregory Thiemonge (gthiemonge) wrote : auto-abandon-script

Abandoned after re-enabling the Octavia launchpad.

Changed in octavia:
assignee: Ganpat Agarwal (gans-developer) → nobody
status: In Progress → Invalid
tags: added: auto-abandon
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.