RE: Question on how index works - runs out of disk space!

2008-09-11 Thread Chris Hostetter
:Are the parameters you mentioned, available in the sample : solrconfig.xml that comes with the nightly build? My schema and config the options for influencing when merging happen have always been in the same solrconfig.xml ... but there are new ones in 1.3 to reflect the new options i

RE: Question on how index works - runs out of disk space!

2008-09-11 Thread sundar shankar
] > To: solr-user@lucene.apache.org > Subject: Re: Question on how index works - runs out of disk space! > > Optimize can be a very expensive operation since it copies the entire index > to new data files. Not sure if solr has an auto-optimize feature, though I > doubt it would be u

Re: Question on how index works - runs out of disk space!

2008-09-11 Thread Jason Rennie
Optimize can be a very expensive operation since it copies the entire index to new data files. Not sure if solr has an auto-optimize feature, though I doubt it would be used much. Our policy is to run commits every few thousand documents and run an optimize once every day or so. These commands a

RE: Question on how index works - runs out of disk space!

2008-09-10 Thread sundar shankar
tion on how index works - runs out of disk space! > > > : OPtimize solved it . Thanks Jason. I am surprised on why solr does this? > > this gets into some complicated discussions about the underlying Lucnee > index format, this is discussed at a very low level in the Lucene docs...

RE: Question on how index works - runs out of disk space!

2008-09-10 Thread Chris Hostetter
: OPtimize solved it . Thanks Jason. I am surprised on why solr does this? this gets into some complicated discussions about the underlying Lucnee index format, this is discussed at a very low level in the Lucene docs... http://lucene.apache.org/java/2_3_2/fileformats.html ...but at a

RE: Question on how index works - runs out of disk space!

2008-09-10 Thread sundar shankar
OPtimize solved it . Thanks Jason. I am surprised on why solr does this? > Date: Wed, 10 Sep 2008 14:37:11 -0400 > From: [EMAIL PROTECTED] > To: solr-user@lucene.apache.org > Subject: Re: Question on how index works - runs out of disk space! > > Have you tried performing an

RE: Question on how index works - runs out of disk space!

2008-09-10 Thread sundar shankar
:11 -0400 > From: [EMAIL PROTECTED] > To: solr-user@lucene.apache.org > Subject: Re: Question on how index works - runs out of disk space! > > Have you tried performing an "optimize"? Solr doesn't seem to fully > integrate all updates into a single index until an optim

Re: Question on how index works - runs out of disk space!

2008-09-10 Thread Jason Rennie
Have you tried performing an "optimize"? Solr doesn't seem to fully integrate all updates into a single index until an optimize is performed. Jason On Wed, Sep 10, 2008 at 1:05 PM, sundar shankar <[EMAIL PROTECTED]>wrote: > Hi All, > We have a cluster of 4 servers for the application a