Search is slow on high volume logs.

[Ben Kietzman]

Fetching search results for high volume logs is rather slow. Need to look into quicking the search capabilities.

[Ben Kietzman (ben-kietzman)]

Application indexes and their associated data files are organized by day (YYYYMMDD). The current logic has one thread allocated for searching through all the indexes and their associated data files. A possible solution would be to allocate one thread for each daily index file. That way all the files are searched in parallel instead of one at a time.

[Ben Kietzman (ben-kietzman)]

Completed the new logic. Decided to not thread out the entire search process since searching the data files in a threaded fashion ended up causing the I/O wait time to jump to the ceiling. Ended up doing all file I/O in the main thread and then threaded out the content of each dated index file in order to speed up the searche time.