Web Staff Client: CSV downloads only current page

[Terran McCanna]

As of Evergreen 2.12:

The Download CSV option on some (all?) views only downloads the current page. This is an issue with large data sets where we need to download all of the data to manipulate it. Specific views I've seen this problem on:

* Holds Shelf
* Holds Pull List
* Patron Search Results

[Bill Erickson (berick)]

Confirming the grid only exports the current page of data for CSV.

As a general FYI, if you change the 'Rows' value in the grid to 100 it will export all 100 rows. That's as far you can go at the moment, though.

Some things to consider..

We'll need a (configurable) way to limit the total number of exportable rows to avoid things like "export the entire patron database by searching for patrons in state=XX".

Related, the display itself (template code) is responsible for modifying data for display (e.g. date filters), so it won't be enough to simply fetch the data. Each item has to be added to the <eg-grid> DOM for filtering. This further limits the total amount of data that can be exported, since the browser will choke at some point as the grid grows and grows. Not sure what that point is, and it will depend. I'm sure we can find a useful medium, though.

[Mike Rylander (mrylander)]

Just a note: there are a couple exceptions to the "100 row limit" -- the grid can be given the "allowAll" feature (a peer to "-sort", etc) which allows up to 10k rows, and the "-pagination" feature will cause up to 10k items to be stored internally. Perhaps that infrastructure could be leveraged.

[Bill Erickson (berick)]

Thanks, Mike. "allowAll" sounds promising. It could be as simple as user clicks 'Export CSV', allowAll gets activated internally, grid refreshes and loads data, does the CSV export, allowAll is deactivated, grid refreshes again.

[Terran McCanna (tmccanna)]

The allowAll sounds great. Staff shouldn't be trying to export tens of thousands of records this way, but there are certainly a lot of situations where more than a hundred would be desired.