Slow inserting

[Seif Lotfy]

An average of 2.5 seconds per 200 entries is unacceptable

Creating database... sqlite:stormtest.sqlite
Starting Zeitgeist service...
Updating database with new Documents items
>>>>>> Inserted 1 items in 0.0431048870087s
>>>>>> Inserted 32 items in 0.398054122925s
Updating database with new Images items
>>>>>> Inserted 1 items in 0.0422050952911s
>>>>>> Inserted 200 items in 2.46073818207s
>>>>>> Inserted 200 items in 2.48012709618s
>>>>>> Inserted 200 items in 2.60040402412s
>>>>>> Inserted 56 items in 0.773358106613s
Updating database with new Music items
Updating database with new Other items
>>>>>> Inserted 1 items in 0.0687749385834s
>>>>>> Inserted 14 items in 0.209239006042s
Updating database with new Videos items
>>>>>> Inserted 1 items in 0.0551328659058s
>>>>>> Inserted 2 items in 0.0482969284058s
Updating database with new Development items
>>>>>> Inserted 1 items in 0.0713491439819s
>>>>>> Inserted 44 items in 0.594656944275s

[Mikkel Kamstrup Erlandsen (kamstrup)]

This bug has two causes:

1) We do a lot of SQL calls (often impliticitely via Storm) for inserting a single item, we should cut drastically down on these
2) The SQLite backend of Storm is not particularly well optimized, see https://bugs.launchpad.net/storm/+bug/253922

[Mikkel Kamstrup Erlandsen (kamstrup)]

I marked this bug as "Fix released" - insertion is relatively fast on the querymancer backend. It can probably be at least twice as fast, but I don't see that it is worthwhile shooting a lot of time after that right now. Query time is a lot more important.