[2.2] MAAS racks connect to too many region endpoints

Bug #1695339 reported by Mike Pontillo
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
MAAS
Won't Fix
High
Unassigned
2.2
Won't Fix
High
Unassigned

Bug Description

When a rack controller registers, it makes a connection to every single region process endpoint. This means one connection for every region controller IP address, multiplied by the number of region processes listening on that IP address.

It's not clear that this many connections are needed; one per process is likely sufficient, though multiple IP addresses may need to be attempted due to reachability concerns.

MAAS racks should only hold open one connection per region process, rotating through the IP addresses as-needed.

no longer affects: maas/2.3
Changed in maas:
milestone: none → 2.3.0
Revision history for this message
Greg Lutostanski (lutostag) wrote :
Download full text (5.0 KiB)

Is this why in an HA setup I would see a rack controller spewing:
2017-09-21 15:27:29 provisioningserver.rpc.clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5575).
2017-09-21 15:27:29 provisioningserver.rpc.clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5612).
2017-09-21 15:27:30 provisioningserver.rpc.clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5612).
2017-09-21 15:27:30 provisioningserver.rpc.clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5328).
2017-09-21 15:27:31 provisioningserver.rpc.clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5328).
2017-09-21 15:27:31 provisioningserver.rpc.clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5328).
2017-09-21 15:27:31 provisioningserver.rpc.clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5328).
2017-09-21 15:27:31 provisioningserver.rpc.clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5328).
2017-09-21 15:27:31 provisioningserver.rpc.clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5328).
2017-09-21 15:27:31 provisioningserver.rpc.clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5328).
2017-09-21 15:27:31 provisioningserver.rpc.clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5612).
2017-09-21 15:27:32 provisioningserver.rpc.clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5328).
2017-09-21 15:27:32 provisioningserver.rpc.clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5328).
2017-09-21 15:27:32 provisioningserver.rpc.clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5575).
2017-09-21 15:27:33 provisioningserver.rpc.clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5612).
2017-09-21 15:27:33 provisioningserver.rpc.clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5328).
2017-09-21 15:27:33 provisioningserver.rpc.clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5612).
2017-09-21 15:27:33 provisioningserver.rpc.clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5328).
2017-09-21 15:27:34 provisioningserver.rpc.clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5328).
2017-09-21 15:27:34 provisioningserver.rpc.clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5328).
2017-09-21 15:27:34 provisioningserver.rpc.clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5328).

And the corresponding region:
2017-09-21 15:27:34 maasserver.rpc.regionservice: [info] Process [5328] - registered rack controller 'sfyeaw'.
2017-09-21 15:27:34 maasserver.rpc.regionservice: [info] Process [5328] - registered rack controller 'sfyeaw'.
2017-09-21 15:27:34 maasserver.rpc.regionservice: [info] Process [5328] - registered rack controller 'sfyeaw'.
2017-09-21 15:27:34 maasserver.rpc.regionservice: [info] Process [5328] - registered rack controller 'sfyeaw'.
2017-09-21 15:27:34 maasserver.r...

Read more...

Changed in maas:
milestone: 2.3.0 → 2.3.x
Changed in maas:
status: Triaged → Won't Fix
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.