Add charm options to configure guages for ovn-controller

Bug #1961933 reported by Hemanth Nakkina
12
This bug affects 2 people
Affects Status Importance Assigned to Milestone
charm-ovn-chassis
New
Undecided
Unassigned

Bug Description

Add a new configuration option ovn-remote-probe-interval

ovn-controller might have the following logs due to scaling issues when the processing of logical flows takes > 5s

Following logs can be observed on ovn-controller

2022-02-17T04:37:50.941Z|368641|timeval|WARN|Unreasonably long 27886ms poll interval (27242ms user, 616ms system)

Command to set the ovn-remote-probe-interval
ovs-vsctl set open . external_ids:ovn-remote-probe-interval=<value>

EDIT: Modified the bug subject line to add 2 more new params
ovn-monitor-all and ovn-openflow-probe-interval

Revision history for this message
Frode Nordahl (fnordahl) wrote :

Thank you for your bug report, Hemanth.

While I can agree with the need for configuring the probe interval for the connection between the ``ovn-controller`` and the OVN Southbound Database, I question the connection with the "Unreasonably long poll interval" log message.

This message is logged whenever any ovn-controller main loop operation takes too long regardless of cause.

If the probe interval timer is in fact hit, would you not see SB DB re-connections?

Revision history for this message
Hemanth Nakkina (hemanth-n) wrote :

Hi Frode

yes, i see the re-connections happening

2022-02-17T04:45:43.581Z|368807|reconnect|WARN|ssl:<IP>:6642: connection dropped (Broken pipe)
2022-02-17T04:45:44.582Z|368808|poll_loop|INFO|wakeup due to 1001-ms timeout at lib/reconnect.c:664 (100% CPU usage)
2022-02-17T04:45:44.583Z|368809|reconnect|INFO|ssl:<IP>:6642: connecting...
2022-02-17T04:45:44.587Z|368811|reconnect|INFO|ssl:<IP>:6642: connected
2022-02-17T04:50:29.333Z|368897|reconnect|WARN|ssl:<IP>:6642: connection dropped (Broken pipe)
2022-02-17T04:50:30.333Z|368899|poll_loop|INFO|wakeup due to 984-ms timeout at lib/reconnect.c:664 (100% CPU usage)
2022-02-17T04:50:30.333Z|368900|reconnect|INFO|ssl:<IP>:6642: connecting...
2022-02-17T04:50:30.346Z|368902|reconnect|INFO|ssl:<IP>:6642: connected

summary: - Add charm option to configure ovn-remote-probe-interval
+ Add charm options to configure guages for ovn-controller
description: updated
Revision history for this message
Alin-Gabriel Serdean (alin-serdean) wrote :

Hi,

It would be also nice to have the following two options as gauges:
ovn-monitor-all (1)
ovn-openflow-probe-interval (2)

(1) https://github.com/ovn-org/ovn/blob/branch-20.03/controller/ovn-controller.8.xml#L106
(2) https://github.com/ovn-org/ovn/blob/branch-20.03/controller/ovn-controller.8.xml#L141

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.