[2.x, UI] 100% cpu usage for 1 regiond process when having hundreds of images

Bug #1705518 reported by Andres Rodriguez
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
MAAS
Invalid
Critical
Unassigned
2.2
Won't Fix
High
Unassigned

Bug Description

I have 1 mas region/rack where I uploaded 200+ images. I noticed that one of the twistd3 processes for the region controller was with 100% load.

Looking at the postgresql logs, i found multiple messagesssimilar to the following non-stop.

2017-07-20 15:40:32 UTC [29440-1272] maas@maasdb LOG: statement: SELECT "maasserver_bootresourceset"."id", "maasserver_bootresourceset"."created", "maasserver_bootresourceset"."updated", "maasserver_bootresourceset"."resource_id", "maasserver_bootresourceset"."version", "maasserver_bootresourceset"."label", SUM("maasserver_largefile"."size") AS "files_size", COUNT("maasserver_bootresourcefile"."id") AS "files_count", SUM("maasserver_largefile"."total_size") AS "files_total_size" FROM "maasserver_bootresourceset" LEFT OUTER JOIN "maasserver_bootresourcefile" ON ( "maasserver_bootresourceset"."id" = "maasserver_bootresourcefile"."resource_set_id" ) LEFT OUTER JOIN "maasserver_largefile" ON ( "maasserver_bootresourcefile"."largefile_id" = "maasserver_largefile"."id" ) WHERE "maasserver_bootresourceset"."resource_id" = 171 GROUP BY "maasserver_bootresourceset"."id", "maasserver_bootresourceset"."created", "maasserver_bootresourceset"."updated", "maasserver_bootresourceset"."resource_id", "maasserver_bootresourceset"."version", "maasserver_bootresourceset"."label" ORDER BY "maasserver_bootresourceset"."id" DESC
2017-07-20 15:40:32 UTC [29463-36] maas@maasdb LOG: statement: SELECT "maasserver_bootresourceset"."id", "maasserver_bootresourceset"."created", "maasserver_bootresourceset"."updated", "maasserver_bootresourceset"."resource_id", "maasserver_bootresourceset"."version", "maasserver_bootresourceset"."label", SUM("maasserver_largefile"."size") AS "files_size", COUNT("maasserver_bootresourcefile"."id") AS "files_count", SUM("maasserver_largefile"."total_size") AS "files_total_size" FROM "maasserver_bootresourceset" LEFT OUTER JOIN "maasserver_bootresourcefile" ON ( "maasserver_bootresourceset"."id" = "maasserver_bootresourcefile"."resource_set_id" ) LEFT OUTER JOIN "maasserver_largefile" ON ( "maasserver_bootresourcefile"."largefile_id" = "maasserver_largefile"."id" ) WHERE "maasserver_bootresourceset"."resource_id" = 182 GROUP BY "maasserver_bootresourceset"."id", "maasserver_bootresourceset"."created", "maasserver_bootresourceset"."updated", "maasserver_bootresourceset"."resource_id", "maasserver_bootresourceset"."version", "maasserver_bootresourceset"."label" ORDER BY "maasserver_bootresourceset"."id" DESC
2017-07-20 15:40:32 UTC [29440-1273] maas@maasdb LOG: statement: SELECT "maasserver_bootresourceset"."id", "maasserver_bootresourceset"."created", "maasserver_bootresourceset"."updated", "maasserver_bootresourceset"."resource_id", "maasserver_bootresourceset"."version", "maasserver_bootresourceset"."label", SUM("maasserver_largefile"."size") AS "files_size", COUNT("maasserver_bootresourcefile"."id") AS "files_count", SUM("maasserver_largefile"."total_size") AS "files_total_size" FROM "maasserver_bootresourceset" LEFT OUTER JOIN "maasserver_bootresourcefile" ON ( "maasserver_bootresourceset"."id" = "maasserver_bootresourcefile"."resource_set_id" ) LEFT OUTER JOIN "maasserver_largefile" ON ( "maasserver_bootresourcefile"."largefile_id" = "maasserver_largefile"."id" ) WHERE "maasserver_bootresourceset"."resource_id" = 170 GROUP BY "maasserver_bootresourceset"."id", "maasserver_bootresourceset"."created", "maasserver_bootresourceset"."updated", "maasserver_bootresourceset"."resource_id", "maasserver_bootresourceset"."version", "maasserver_bootresourceset"."label" ORDER BY "maasserver_bootresourceset"."id" DESC
2017-07-20 15:40:32 UTC [29463-37] maas@maasdb LOG: statement: SELECT "maasserver_bootresourcefile"."id", "maasserver_bootresourcefile"."created", "maasserver_bootresourcefile"."updated", "maasserver_bootresourcefile"."resource_set_id", "maasserver_bootresourcefile"."largefile_id", "maasserver_bootresourcefile"."filename", "maasserver_bootresourcefile"."filetype", "maasserver_bootresourcefile"."extra" FROM "maasserver_bootresourcefile" WHERE "maasserver_bootresourcefile"."resource_set_id" = 182

Tags: performance
Changed in maas:
milestone: none → 2.3.0
importance: Undecided → Critical
status: New → Triaged
Revision history for this message
Andres Rodriguez (andreserl) wrote :

Once I closed the UI, the load reduced significantly.

summary: - [2.2] 100% cpu usage for 1 regiond process when having hundreds of
+ [2.2, UI] 100% cpu usage for 1 regiond process when having hundreds of
images
tags: added: performance
Changed in maas:
importance: Critical → High
importance: High → Critical
Changed in maas:
milestone: 2.3.0 → 2.3.x
Changed in maas:
milestone: 2.3.x → next
summary: - [2.2, UI] 100% cpu usage for 1 regiond process when having hundreds of
+ [2.x, UI] 100% cpu usage for 1 regiond process when having hundreds of
images
Changed in maas:
status: Triaged → Invalid
Changed in maas:
milestone: next → none
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.