index bigger than it should be?

2011-10-27 Thread v . sevel
Hi, I have an application that has an index with 30 millions docs in it. every day, I add around 1 million docs, and I remove the oldest 1 million, to keepit stable at 30 million. for the most part doc fields are indexed and stored. each doc weighs around from a few Kb to a 1 Mb (a few Mb in so

Re: index bigger than it should be?

2011-10-27 Thread Ian Lea
There's org.apache.lucene.index.CheckIndex which will report assorted stats about the index, as well as checking it for correctness. It can fix it too but you don't need that. I hope. Will take quite a while to run on a large index. What version of lucene? Does a before/after (or large/small) d

Re: index bigger than it should be?

2011-10-30 Thread v . sevel
ser-return-51136-v.sevel=lombardodier@lucene.apache.org 27.10.2011 15:28 Please respond to java-user@lucene.apache.org To java-user@lucene.apache.org cc Subject Re: index bigger than it should be? There's org.apache.lucene.index.CheckIndex which will report assorted stats a

Re: index bigger than it should be?

2011-10-31 Thread Ian Lea
1136-v.sevel=lombardodier@lucene.apache.org > > > 27.10.2011 15:28 > Please respond to > java-user@lucene.apache.org > > > > To > java-user@lucene.apache.org > cc > > Subject > Re: index bigger than it should be? > > > > > > > There