Computations with a site_model.xml may become slow

Bug #1288262 reported by Michele Simionato
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenQuake Engine
Fix Released
High
Michele Simionato

Bug Description

We saw in the case of Hannover RE Germany computation that the filtering was becoming very slow; the culprit is
the section:

            s_sites = src.filter_sites_by_distance_to_source(
                hc.maximum_distance, hc.site_collection
            ) if hc.maximum_distance else hc.site_collection

hc.site_collection is a property that in presence of a source model performs heavy queries on the db.
We saw on Wilson a load of 180 (!)

description: updated
Revision history for this message
Michele Simionato (michele-simionato) wrote :

We can mitigate the problem by caching the site collection, so that the queries will be run only once per worker, not once per task.
See https://github.com/gem/oq-engine/pull/1392

Changed in oq-engine:
importance: Undecided → High
assignee: nobody → Michele Simionato (michele-simionato)
milestone: none → 1.0.1
status: New → In Progress
Changed in oq-engine:
status: In Progress → Fix Committed
Changed in oq-engine:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.