Thanks for your immediate response. The culprit here is sorting. I stopped sorting then memory consumption is reduced nearly 50%. Further for Testing purpose i set setTermInfosIndexDivisor to 50 then memory consumption is further reduced.
Currently i am sorting DateTime with minute resolution as single string. If i split it as Date, Hour and Minute then memory consumption in sorting will get reduced. Regards Ganesh ----- Original Message ----- From: "Michael McCandless" <luc...@mikemccandless.com> To: <java-user@lucene.apache.org> Sent: Thursday, June 25, 2009 3:44 PM Subject: Re: setTermInfosIndexDivisor On Thu, Jun 25, 2009 at 6:09 AM, Ganesh<emailg...@yahoo.co.in> wrote: > > What about setTermInfosIndexDivisor?? > > Directory dir = FSDirectory.getDirectory(indexPath); > IndexReader reader = IndexReader.open(dir, true); > reader.setTermInfosIndexDivisor(5); > > It supposed to load only one fifth of the terms available?? But there is no > difference in memory consumption with / without settings this parameter. No, it's loads 1/5th of the 1/128th of all the terms available. Ie, by default Lucene loads every 128th term into RAM for searching. If you call setTermInfosIndexDivisor(5), then it loads every 128*5 = every 640 terms. > I reopen the IndexReader whenever there is any document added to Index. Do i > need to set setTermInfosIndexDivisor(5); during re-opening of the index also. > I tried this, first time it accepted and second time onwards it throws "terms > already loaded" expection Calling setTermInfosIndexDivisor on a reopened reader won't work, because of a [just now discovered] bug in Lucene. The workaround (if you really must use setTermInfosIndexDivisor) is to not use reopen. Mike --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org Send instant messages to your online friends http://in.messenger.yahoo.com --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org
