[2.2] MAAS racks connect to too many region endpoints
Bug #1695339 reported by
Mike Pontillo
This bug affects 1 person
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
MAAS |
Won't Fix
|
High
|
Unassigned | ||
2.2 |
Won't Fix
|
High
|
Unassigned |
Bug Description
When a rack controller registers, it makes a connection to every single region process endpoint. This means one connection for every region controller IP address, multiplied by the number of region processes listening on that IP address.
It's not clear that this many connections are needed; one per process is likely sufficient, though multiple IP addresses may need to be attempted due to reachability concerns.
MAAS racks should only hold open one connection per region process, rotating through the IP addresses as-needed.
no longer affects: | maas/2.3 |
Changed in maas: | |
milestone: | none → 2.3.0 |
Changed in maas: | |
milestone: | 2.3.0 → 2.3.x |
Changed in maas: | |
status: | Triaged → Won't Fix |
To post a comment you must log in.
Is this why in an HA setup I would see a rack controller spewing: ver.rpc. clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5575). ver.rpc. clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5612). ver.rpc. clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5612). ver.rpc. clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5328). ver.rpc. clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5328). ver.rpc. clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5328). ver.rpc. clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5328). ver.rpc. clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5328). ver.rpc. clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5328). ver.rpc. clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5328). ver.rpc. clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5612). ver.rpc. clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5328). ver.rpc. clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5328). ver.rpc. clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5575). ver.rpc. clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5612). ver.rpc. clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5328). ver.rpc. clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5612). ver.rpc. clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5328). ver.rpc. clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5328). ver.rpc. clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5328). ver.rpc. clusterservice: [info] Rack controller 'sfyeaw' registered (via infra2:pid=5328).
2017-09-21 15:27:29 provisioningser
2017-09-21 15:27:29 provisioningser
2017-09-21 15:27:30 provisioningser
2017-09-21 15:27:30 provisioningser
2017-09-21 15:27:31 provisioningser
2017-09-21 15:27:31 provisioningser
2017-09-21 15:27:31 provisioningser
2017-09-21 15:27:31 provisioningser
2017-09-21 15:27:31 provisioningser
2017-09-21 15:27:31 provisioningser
2017-09-21 15:27:31 provisioningser
2017-09-21 15:27:32 provisioningser
2017-09-21 15:27:32 provisioningser
2017-09-21 15:27:32 provisioningser
2017-09-21 15:27:33 provisioningser
2017-09-21 15:27:33 provisioningser
2017-09-21 15:27:33 provisioningser
2017-09-21 15:27:33 provisioningser
2017-09-21 15:27:34 provisioningser
2017-09-21 15:27:34 provisioningser
2017-09-21 15:27:34 provisioningser
And the corresponding region: rpc.regionservi ce: [info] Process [5328] - registered rack controller 'sfyeaw'. rpc.regionservi ce: [info] Process [5328] - registered rack controller 'sfyeaw'. rpc.regionservi ce: [info] Process [5328] - registered rack controller 'sfyeaw'. rpc.regionservi ce: [info] Process [5328] - registered rack controller 'sfyeaw'.
2017-09-21 15:27:34 maasserver.
2017-09-21 15:27:34 maasserver.
2017-09-21 15:27:34 maasserver.
2017-09-21 15:27:34 maasserver.
2017-09-21 15:27:34 maasserver.r...