Fix memory occupation issues in scenario_risk
Bug #1132018 reported by
Michele Simionato
This bug affects 1 person
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
OpenQuake (deprecated) |
Fix Released
|
Undecided
|
Unassigned |
Bug Description
This is a companion of https:/
Having identified the issue, one should be able to fix it, possibly by changing the query that was reclaiming all that memory, or by simplifying the table structure, or both.
summary: |
- Fix memory occupation issues + Fix memory occupation issues in scenario_risk |
description: | updated |
Changed in openquake: | |
status: | New → Fix Released |
milestone: | none → 1.0.0 |
To post a comment you must log in.
The fix requires changing both the gmf_scenario table and the distribution logic. The gmf_scenario table must have few rows, possibly with a long array for each row, to keep a good performance even for large site collections. Currently instead the gmvs are split in chunks (~30 chunks per location). The proposal is to distribute not according to the realizations, but in blocks of sites. For instance each task could compute all the realizations of a given GMF for a block of sites (say 1000 sites per task).