I had a recent sidebar with another user, and it got me to thinking.
Do we have any way of determining if a segment is definitely OK/VALID ?
If so, a much more efficient transactional system could be developed.
Serialize the updates to a log file. Sync the log. Update the lucene
index WITHOUT any sync. Log file writing/sync is VERY efficient
since it is sequential, and a single file.
Upon open of the index, detect if index was not shutdown cleanly. If
so, determine the last valid segment, delete the bad segments, and
then perform the updates (from the log file) since the last valid
segment was written.
The detection could be a VERY slow operation, but this is ok, since
it should be rare, and then you will only pay this price on the rare
occasion, not on every update.
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
