I have discovered something. I wonder this might actually end up being an OVN issue? I found these logs in the ovn-controller.log on the unit, and have noticed similar logs on compute chassis previously. Restarting OVN clears it and has done so in this case too;
routergod@juju:~$ juju ssh octavia/3 -- sudo tail /var/log/ovn/ovn-controller.log
2021-04-20T18:51:14.704Z|00010|rconn|INFO|unix:/var/run/openvswitch/br-int.mgmt: connected
2021-04-20T18:51:14.705Z|00001|pinctrl(ovn_pinctrl0)|INFO|unix:/var/run/openvswitch/br-int.mgmt: connecting to switch
2021-04-20T18:51:14.706Z|00002|rconn(ovn_pinctrl0)|INFO|unix:/var/run/openvswitch/br-int.mgmt: connecting...
2021-04-20T18:51:14.706Z|00003|rconn(ovn_pinctrl0)|INFO|unix:/var/run/openvswitch/br-int.mgmt: connected
2021-04-20T18:51:14.720Z|00011|binding|INFO|Not claiming lport 8a28d5fc-a5ef-4e08-91c2-796a130953a7, chassis juju-dd7be7-2-lxd-9 requested-chassis juju-dd7be7-2-lxd-9.maas
2021-04-20T18:51:31.489Z|00012|binding|INFO|Dropped 1 log messages in last 16 seconds (most recently, 16 seconds ago) due to excessive rate
2021-04-20T18:51:31.489Z|00013|binding|INFO|Not claiming lport 8a28d5fc-a5ef-4e08-91c2-796a130953a7, chassis juju-dd7be7-2-lxd-9 requested-chassis juju-dd7be7-2-lxd-9.maas
2021-04-20T18:51:31.966Z|00014|binding|INFO|Claiming lport 8a28d5fc-a5ef-4e08-91c2-796a130953a7 for this chassis.
2021-04-20T18:51:31.966Z|00015|binding|INFO|8a28d5fc-a5ef-4e08-91c2-796a130953a7: Claiming fa:16:3e:ce:0a:2f fc00:9a48:3a7d:4d21:f816:3eff:fece:a2f
2021-04-20T18:51:31.966Z|00016|binding|INFO|8a28d5fc-a5ef-4e08-91c2-796a130953a7: Claiming unknown
Connection to 10.23.129.104 closed.
routergod@juju:~$ juju run --unit=octavia/3 -- sudo systemctl restart ovn-host
routergod@juju:~$ juju run --unit=octavia/3 -- sudo systemctl restart ovn-controller
routergod@juju:~$ juju run --unit=octavia/3 -- sudo systemctl restart ovsdb-server
Thanks @Alex
I have discovered something. I wonder this might actually end up being an OVN issue? I found these logs in the ovn-controller.log on the unit, and have noticed similar logs on compute chassis previously. Restarting OVN clears it and has done so in this case too;
routergod@juju:~$ juju ssh octavia/3 -- sudo tail /var/log/ ovn/ovn- controller. log 20T18:51: 14.704Z| 00010|rconn| INFO|unix: /var/run/ openvswitch/ br-int. mgmt: connected 20T18:51: 14.705Z| 00001|pinctrl( ovn_pinctrl0) |INFO|unix: /var/run/ openvswitch/ br-int. mgmt: connecting to switch 20T18:51: 14.706Z| 00002|rconn( ovn_pinctrl0) |INFO|unix: /var/run/ openvswitch/ br-int. mgmt: connecting... 20T18:51: 14.706Z| 00003|rconn( ovn_pinctrl0) |INFO|unix: /var/run/ openvswitch/ br-int. mgmt: connected 20T18:51: 14.720Z| 00011|binding| INFO|Not claiming lport 8a28d5fc- a5ef-4e08- 91c2-796a130953 a7, chassis juju-dd7be7-2-lxd-9 requested-chassis juju-dd7be7- 2-lxd-9. maas 20T18:51: 31.489Z| 00012|binding| INFO|Dropped 1 log messages in last 16 seconds (most recently, 16 seconds ago) due to excessive rate 20T18:51: 31.489Z| 00013|binding| INFO|Not claiming lport 8a28d5fc- a5ef-4e08- 91c2-796a130953 a7, chassis juju-dd7be7-2-lxd-9 requested-chassis juju-dd7be7- 2-lxd-9. maas 20T18:51: 31.966Z| 00014|binding| INFO|Claiming lport 8a28d5fc- a5ef-4e08- 91c2-796a130953 a7 for this chassis. 20T18:51: 31.966Z| 00015|binding| INFO|8a28d5fc- a5ef-4e08- 91c2-796a130953 a7: Claiming fa:16:3e:ce:0a:2f fc00:9a48: 3a7d:4d21: f816:3eff: fece:a2f 20T18:51: 31.966Z| 00016|binding| INFO|8a28d5fc- a5ef-4e08- 91c2-796a130953 a7: Claiming unknown
2021-04-
2021-04-
2021-04-
2021-04-
2021-04-
2021-04-
2021-04-
2021-04-
2021-04-
2021-04-
Connection to 10.23.129.104 closed.
routergod@juju:~$ juju run --unit=octavia/3 -- sudo systemctl restart ovn-host
routergod@juju:~$ juju run --unit=octavia/3 -- sudo systemctl restart ovn-controller
routergod@juju:~$ juju run --unit=octavia/3 -- sudo systemctl restart ovsdb-server
routergod@juju:~$ juju ssh octavia/3 -- sudo tail /var/log/ ovn/ovn- controller. log 20T18:55: 28.103Z| 00004|rconn( ovn_pinctrl0) |INFO|unix: /var/run/ openvswitch/ br-int. mgmt: connection closed by peer 20T18:55: 28.103Z| 00014|rconn| INFO|unix: /var/run/ openvswitch/ br-int. mgmt: connection closed by peer 20T18:55: 28.198Z| 00015|jsonrpc| WARN|unix: /var/run/ openvswitch/ db.sock: send error: Broken pipe 20T18:55: 28.198Z| 00016|reconnect |WARN|unix: /var/run/ openvswitch/ db.sock: connection dropped (Broken pipe) 20T18:55: 29.104Z| 00005|rconn( ovn_pinctrl0) |INFO|unix: /var/run/ openvswitch/ br-int. mgmt: connecting... 20T18:55: 29.105Z| 00006|rconn( ovn_pinctrl0) |INFO|unix: /var/run/ openvswitch/ br-int. mgmt: connected 20T18:55: 29.105Z| 00017|rconn| INFO|unix: /var/run/ openvswitch/ br-int. mgmt: connecting... 20T18:55: 29.105Z| 00018|rconn| INFO|unix: /var/run/ openvswitch/ br-int. mgmt: connected 20T18:55: 29.198Z| 00019|reconnect |INFO|unix: /var/run/ openvswitch/ db.sock: connecting... 20T18:55: 29.199Z| 00020|reconnect |INFO|unix: /var/run/ openvswitch/ db.sock: connected
2021-04-
2021-04-
2021-04-
2021-04-
2021-04-
2021-04-
2021-04-
2021-04-
2021-04-
2021-04-
Connection to 10.23.129.104 closed.