soeretypo: timeout at metadata_mineralization_kinetics_dist

[Olivier Maury]

At soeretypo/extraction/metadata_mineralization_kinetics_dist, downloading the results failed due to server timeout. This is the way to reproduce the bug:

after choosing
- 1. Products: only one product is chosen: 10039
- 2. Elements: All
- Mode: Moyenne ou valeur expérimentales

Click on "Search". The preview is well shown. All values (34) are previewed.

Click on "Download the file". The server CPU is at 100%, nothing is returned.

If we access with "soeretypo/extraction/metadata_mineralization_kinetics_dist?download", do the same choices, the preview step is skipped and the file is returned quickly.

So a common user can't retrieve the results.

[Nautile bleu (nautilebleu)]

I can't reproduce the bug, the download starts quickly. But I discover another issue that may explain the behavior : when doing a search, data are not correctly repopulated after posting the form, so all products are selected when downloading the file.

[Nautile bleu (nautilebleu)]

I've fix some bugs in the CategoryBrowserWidget, probably added when updating the code to allow more than one widget per page. Let me know if it fix the problems for you.

[Olivier Maury (olivier-maury)]

I tried today after merging your changes.

I can get a file (7 minutes after clicking on the button!), but all products are returned in the file.
Each sheet contains 19593 rows.

[Nautile bleu (nautilebleu)]

- Was that result intended (i.e. it's normal to have all products or you have made some choices?)
- Anyway we should probably limit the maximum number of results returned, like in SoerePRO (but we still didn't fix it.)
- If the limit is quite high, this means I've to use the asynchronous task to compute the file.

[Olivier Maury (olivier-maury)]

I followed the initial bug report :
choosing 1 product and expecting 1 product in the result file.

I don't know how the users can handle data. But one hundred of products can be good limit.

It's easy to set the limit on user input.

I've written a validator to check the number of chosen products at
http://bazaar.launchpad.net/~datum/datum/trunk/view/head:/protected/modules/soeretypo/components/SoeretypoTemplateForm.php#L126