Activity log for bug #888175

Date Who What changed Old value New value Message
2011-11-09 17:13:44 Lars Butler bug added bug
2011-11-10 10:01:53 Lars Butler description DRAFT UHS results shall be stored in HDF5 files (with a NRML/XML wrapper). For each calculation, there will be 1 file per site of interest. This file will contain results for each PoE and realization of the entire calculation. The data will be structured as a nested hash: Hash<PoE, Hash<Realization, Data>>.
2011-11-14 16:36:31 Lars Butler description UHS results shall be stored in HDF5 files (with a NRML/XML wrapper). For each calculation, there will be 1 file per site of interest. This file will contain results for each PoE and realization of the entire calculation. The data will be structured as a nested hash: Hash<PoE, Hash<Realization, Data>>. UHS results shall be stored in HDF5 files (with a NRML/XML wrapper). For each calculation, there will be 1 file per PoE level. This file will contain the results for all sites and realizations in the calculation. For each site node in the file, there will be a 2D matrix representing the UHS data for all of the logic tree samples. Each row will represent a logic tree sample. The value of each row shall be the list of Spectral Acceleration values for a given UHS function (see attached photo for a more graphical explanation).
2011-11-14 16:36:43 Lars Butler attachment added UHS_hdf5_structure.JPG https://bugs.launchpad.net/openquake/+bug/888175/+attachment/2596629/+files/UHS_hdf5_structure.JPG
2011-11-14 16:37:50 Lars Butler attachment added UHS_hdf5_structure.JPG https://bugs.launchpad.net/openquake/+bug/888175/+attachment/2596631/+files/UHS_hdf5_structure.JPG
2011-11-14 16:47:20 Lars Butler attachment removed UHS_hdf5_structure.JPG https://bugs.launchpad.net/openquake/+bug/888175/+attachment/2596631/+files/UHS_hdf5_structure.JPG
2011-11-14 16:47:37 Lars Butler attachment removed UHS_hdf5_structure.JPG https://bugs.launchpad.net/openquake/+bug/888175/+attachment/2596629/+files/UHS_hdf5_structure.JPG
2011-11-14 16:48:40 Lars Butler attachment added UHS_hdf5_structure.JPG https://bugs.launchpad.net/openquake/+bug/888175/+attachment/2596654/+files/UHS_hdf5_structure.JPG
2012-01-23 10:34:48 Lars Butler description UHS results shall be stored in HDF5 files (with a NRML/XML wrapper). For each calculation, there will be 1 file per PoE level. This file will contain the results for all sites and realizations in the calculation. For each site node in the file, there will be a 2D matrix representing the UHS data for all of the logic tree samples. Each row will represent a logic tree sample. The value of each row shall be the list of Spectral Acceleration values for a given UHS function (see attached photo for a more graphical explanation). UHS results shall be stored in HDF5 files (with a NRML/XML wrapper). For each calculation, there will be 1 file per PoE level. This file will contain the results for all sites and realizations in the calculation. For each site node in the file, there will be a 2D matrix representing the UHS data for all of the logic tree samples. Each row will represent a logic tree sample. The value of each row shall be the list of Spectral Acceleration values for a given UHS function (see attached photo for a more graphical explanation). As outlined and implemented in bug # 888172, intermediate results for a single site (or a small list of the sites, as it may be in the future) are saved to temporary HDF5 files. The work in this bug is concerned with final collection and consolidation of the results into the final output format.
2012-01-23 10:39:04 Lars Butler description UHS results shall be stored in HDF5 files (with a NRML/XML wrapper). For each calculation, there will be 1 file per PoE level. This file will contain the results for all sites and realizations in the calculation. For each site node in the file, there will be a 2D matrix representing the UHS data for all of the logic tree samples. Each row will represent a logic tree sample. The value of each row shall be the list of Spectral Acceleration values for a given UHS function (see attached photo for a more graphical explanation). As outlined and implemented in bug # 888172, intermediate results for a single site (or a small list of the sites, as it may be in the future) are saved to temporary HDF5 files. The work in this bug is concerned with final collection and consolidation of the results into the final output format. UHS results shall be stored in HDF5 files (with a NRML/XML wrapper). For each calculation, there will be 1 file per PoE level. This file will contain the results for all sites and realizations in the calculation. For each site node in the file, there will be a 2D matrix representing the UHS data for all of the logic tree samples. Each row will represent a logic tree sample. The value of each row shall be the list of Spectral Acceleration values for a given UHS function (see attached photo for a more graphical explanation). As outlined and implemented in bug # 888172, intermediate results for a single site (or a small list of the sites, as it may be in the future) are saved to temporary HDF5 files. The work in this bug is concerned with final collection and consolidation of the results into the final output format. The final output is created (empty) at the beginning of the calculation. We simply open the pre-existing files and copy the intermediate results into the proper location in the HDF5 dataset.
2012-01-23 11:01:37 Lars Butler openquake: status New Confirmed
2012-01-23 11:01:40 Lars Butler openquake: importance Undecided High
2012-02-01 13:38:58 John Tarter openquake: milestone 0.6.0
2012-02-01 13:39:03 John Tarter openquake: importance High Medium
2012-02-01 15:40:27 Lars Butler description UHS results shall be stored in HDF5 files (with a NRML/XML wrapper). For each calculation, there will be 1 file per PoE level. This file will contain the results for all sites and realizations in the calculation. For each site node in the file, there will be a 2D matrix representing the UHS data for all of the logic tree samples. Each row will represent a logic tree sample. The value of each row shall be the list of Spectral Acceleration values for a given UHS function (see attached photo for a more graphical explanation). As outlined and implemented in bug # 888172, intermediate results for a single site (or a small list of the sites, as it may be in the future) are saved to temporary HDF5 files. The work in this bug is concerned with final collection and consolidation of the results into the final output format. The final output is created (empty) at the beginning of the calculation. We simply open the pre-existing files and copy the intermediate results into the proper location in the HDF5 dataset. DRAFT - Export UHS results from the DB to HDF5 files - Bug # 888179 is a prerequisite
2012-02-01 15:40:27 Lars Butler openquake: status Confirmed Incomplete
2012-02-02 10:54:28 Lars Butler summary Serialize UHS results to HDF5 format Export UHS results from DB to HDF5
2012-02-02 10:55:03 Lars Butler description DRAFT - Export UHS results from the DB to HDF5 files - Bug # 888179 is a prerequisite DRAFT - Export UHS results from the DB to HDF5 files - Bug # 888179 is a prerequisite - This should happen as a separate action (post-calculation export, for example)
2012-02-17 13:20:21 Lars Butler description DRAFT - Export UHS results from the DB to HDF5 files - Bug # 888179 is a prerequisite - This should happen as a separate action (post-calculation export, for example) - The hzrdr.uh_spectra record for the calculation contains the number of realizations and SA periods. These are required for determining the size of the HDF5 matrix dataset sizes. - The hzrdr.uh_spectrum records contain the PoE values. 1 resulting HDF5 should be created for each PoE. - The hzrdr.uh_spectrum_data records each contain data for a single site (1 data set), a single realization (the row number in the dataset, from 0-N), and the array of sa_values (which make up the data for said row in the dataset). - Export UHS results from the DB to HDF5 files - This should happen as a separate action (post-calculation export, for example) - The following bugs are prerequisites: bug # 888179, bug # 925425, bug # 926141, bug # 926164, bug # 934166
2012-02-17 13:20:54 Lars Butler description - The hzrdr.uh_spectra record for the calculation contains the number of realizations and SA periods. These are required for determining the size of the HDF5 matrix dataset sizes. - The hzrdr.uh_spectrum records contain the PoE values. 1 resulting HDF5 should be created for each PoE. - The hzrdr.uh_spectrum_data records each contain data for a single site (1 data set), a single realization (the row number in the dataset, from 0-N), and the array of sa_values (which make up the data for said row in the dataset). - Export UHS results from the DB to HDF5 files - This should happen as a separate action (post-calculation export, for example) - The following bugs are prerequisites: bug # 888179, bug # 925425, bug # 926141, bug # 926164, bug # 934166 [et=8h] [at=] - The hzrdr.uh_spectra record for the calculation contains the number of realizations and SA periods. These are required for determining the size of the HDF5 matrix dataset sizes. - The hzrdr.uh_spectrum records contain the PoE values. 1 resulting HDF5 should be created for each PoE. - The hzrdr.uh_spectrum_data records each contain data for a single site (1 data set), a single realization (the row number in the dataset, from 0-N), and the array of sa_values (which make up the data for said row in the dataset). - Export UHS results from the DB to HDF5 files - This should happen as a separate action (post-calculation export, for example) - The following bugs are prerequisites: bug # 888179, bug # 925425, bug # 926141, bug # 926164, bug # 934166
2012-02-17 13:20:56 Lars Butler openquake: assignee Lars Butler (lars-butler)
2012-02-17 13:21:00 Lars Butler openquake: status Incomplete In Progress
2012-02-17 13:21:03 Lars Butler openquake: status In Progress Won't Fix
2012-02-17 13:21:06 Lars Butler openquake: status Won't Fix Confirmed
2012-02-22 17:58:48 Lars Butler openquake: status Confirmed In Progress
2012-02-24 16:43:11 Lars Butler description [et=8h] [at=] - The hzrdr.uh_spectra record for the calculation contains the number of realizations and SA periods. These are required for determining the size of the HDF5 matrix dataset sizes. - The hzrdr.uh_spectrum records contain the PoE values. 1 resulting HDF5 should be created for each PoE. - The hzrdr.uh_spectrum_data records each contain data for a single site (1 data set), a single realization (the row number in the dataset, from 0-N), and the array of sa_values (which make up the data for said row in the dataset). - Export UHS results from the DB to HDF5 files - This should happen as a separate action (post-calculation export, for example) - The following bugs are prerequisites: bug # 888179, bug # 925425, bug # 926141, bug # 926164, bug # 934166 [et=8h] [at=7.5h] - The hzrdr.uh_spectra record for the calculation contains the number of realizations and SA periods. These are required for determining the size of the HDF5 matrix dataset sizes. - The hzrdr.uh_spectrum records contain the PoE values. 1 resulting HDF5 should be created for each PoE. - The hzrdr.uh_spectrum_data records each contain data for a single site (1 data set), a single realization (the row number in the dataset, from 0-N), and the array of sa_values (which make up the data for said row in the dataset). - Export UHS results from the DB to HDF5 files - This should happen as a separate action (post-calculation export, for example) - The following bugs are prerequisites: bug # 888179, bug # 925425, bug # 926141, bug # 926164, bug # 934166
2012-02-24 18:01:34 Lars Butler tags export uhs
2012-02-28 13:29:32 Lars Butler openquake: status In Progress Fix Committed
2013-04-08 09:42:05 Lars Butler openquake: status Fix Committed Fix Released