RE: Is indexing much slower in 3.5.0 than in 2.4.1 for Wikipedia data?

2011-12-12 Thread Sean Tong
Thanks Simon for your response. I just re-ran the 3.5 benchmark with the ClassicAnalyzer. Here are the results: [java] > Report sum by Prefix (MAddDocs) and Round (3 about 3 out of 14) [java] Operation round flush mrg runCnt recsPerRunrec/s elapsedSec

Re: Is indexing much slower in 3.5.0 than in 2.4.1 for Wikipedia data?

2011-12-12 Thread Simon Willnauer
hey, can you try to use the ClassicAnalyzer instead of StandartAnalzyer in 3.5 since in 3.5 the StandartAnalyzer is a different implementation than in 2.9 and 2.4 or rerun the 2.4 benchmarks with a WhitespaceAnalyzer just for the comparison. simon On Mon, Dec 12, 2011 at 7:08 PM, Sean Tong wrot

Re: How to detect index in use

2011-12-12 Thread Ian Lea
If another process has an index open for updates it will be locked and you can test that with IndexWriter.isLocked(directory), but that's about it. An OS command like lsof on unix could be used to see if any processes on the same server have index files open but if you're using NFS that won't dete

RE: Is indexing much slower in 3.5.0 than in 2.4.1 for Wikipedia data?

2011-12-12 Thread Sean Tong
Looks like the attachment for the algorithm is missing from last email. I have pasted the text here. Thanks in advance for any help. #Start of the wikipedia-default.alg file merge.factor=mrg:10:10:10 max.field.length=2147483647 #max.buffered=buf:10:10:100:100 ram.flush.mb=flush:16:16:16 compou

How to detect index in use

2011-12-12 Thread Rui Wang
Hi All, I am just wondering given a existing index folder, is there a way of detecting whether this index is in use? Either by IndexReader or IndexWriter, What about on NFS file system? Is there any difference? Thank you for the help in advance, Rui Wang