MARC batch edit progress reporting is wastefully verbose

[Galen Charlton]

The MARC batch edit interface currently reports its progress to the client by periodically updating an anon_cache key, which the client then fetches every second or so.

However, the contents of that key are a JSON array of the success/failure status of each bib record. In particular, as open-ils.cat.container.template_overlay.background processes each record, it tacks on an entry to the status array and pushes it to the anon_cache. The client, in turn, periodically fetches the entire array and sums up the number of successes and failures, but doesn't make any use of the record IDs that are sent.

For large batches of thousands of records, this yields a lot of network traffic, both inside Evergreen and outside of it. The former seems to be associated with open-ils.actor listeners occasionally getting backlogged and failing to relay requests promptly, thereby slowing down uses of open-ils.actor for purposes other than calling open-ils.actor.anon_cache.set_value. For that reason, I'm marking this as a bug rather than a wishlist.

It would be better if just the counts of successes and failures were passed along as the status update.

Evergreen 2.12+

[Galen Charlton (gmc)]

A patch is available in the user/gmcharlt/lp1705731_slim_batch_edit_progress_reporting branch in the working repository:

http://git.evergreen-ils.org/?p=working/Evergreen.git;a=shortlog;h=refs/heads/user/gmcharlt/lp1705731_slim_batch_edit_progress_reporting

[Bill Erickson (berick)]

Thanks, Galen. Patch reviewed and tested. Confirmed batch editing still performs as expected, MARC data is modified, totals are updated in the UI.

Merged to master and 2.12.