Comment 17 for bug 132741

We will notify you when its ready to confirm if this bug is fixed

To clarify a few issues:

1) we are reverting back to qdbm over sqlite for the index as its much faster at inserts and causes less IO
2) The issue with fsync/sqlite no longer applies
3) we are increasing cache size such that each flush of the cache is done to its own mini-index
4) Once files have all been indexed we merge all these mini indexes into one big index

with the exception of (4) which will only take 10-20 secs or so, no slow down of the system (cpu and or disk io) occurs
+ even large 500mb source directories are indexed in less than half an hour

the kernel sucks at updating a relatively small index of 30mb with both sqlite and qdbm as it involves lots of seeks, reads and writes (it should cache all the disk pages in ram and flush them out in an optimal fashion but it does not appear to do that) hence we are working around the problem by merging small indexes together and avoiding the seeks completley

The above version will be in svn soon and once its got some testing we will submit it to ubuntu