commit aac8315fc68c68dc7711250c24781cff92ebb742
Author: Robert Lyon <email address hidden>
Date: Thu Nov 16 12:10:53 2017 +1300
Bug 1732565: Allow for faster indexing of large sites into elasticsearch
Currently if you index 386,000 records at 10,000 at a time
- default cron at every 5 mins takes 195 mins (3.25 hours)
- cron set to every minute should take 39 mins (but if indexing not
finished the following minute may be skipped)
With fast_index.php it starts next index straight after last finishes
so runs thru at optimal speed
- took only 25 minutes (almost 66% faster than per minute cron and way
faster than default cron speed)
behatnotneeded
Change-Id: I65bfb19ab6481a95bafb120d3139d37e0ef28f92
Signed-off-by: Robert Lyon <email address hidden>
Reviewed: https:/ /reviews. mahara. org/8283 /git.mahara. org/mahara/ mahara/ commit/ aac8315fc68c68d c7711250c24781c ff92ebb742
Committed: https:/
Submitter: Robert Lyon (<email address hidden>)
Branch: master
commit aac8315fc68c68d c7711250c24781c ff92ebb742
Author: Robert Lyon <email address hidden>
Date: Thu Nov 16 12:10:53 2017 +1300
Bug 1732565: Allow for faster indexing of large sites into elasticsearch
Currently if you index 386,000 records at 10,000 at a time
- default cron at every 5 mins takes 195 mins (3.25 hours)
- cron set to every minute should take 39 mins (but if indexing not
finished the following minute may be skipped)
With fast_index.php it starts next index straight after last finishes
so runs thru at optimal speed
- took only 25 minutes (almost 66% faster than per minute cron and way
faster than default cron speed)
behatnotneeded
Change-Id: I65bfb19ab6481a 95bafb120d3139d 37e0ef28f92
Signed-off-by: Robert Lyon <email address hidden>