Re: How do we limit the growth of a Lucene Index?

2007-11-05 Thread Grant Ingersoll
You could search this list about distributing your indexes, etc. RemoteSearchable may be handy, but you will probably have to build some infrastructure around it for handling failover, etc. (would make for a nice contribution) How often do you think archived data will need to be accessed?

Re: How do we limit the growth of a Lucene Index?

2007-11-05 Thread Marcus Herou
As you suggest you could either roll the index on the local machine or remote and gzip the content fileds on the archive index and provide a GzipReader when you need to search old results. If money is of the essence then the best solution probably is to have 1 good box with fast SCSI disks which

Re: How do we limit the growth of a Lucene Index?

2007-11-05 Thread Sandeep Mahendru
Hi Marcus, Thanks for providing these suggestions. I will work on these directions with my team. Regards, Sandeep. On 11/5/07, Marcus Herou [EMAIL PROTECTED] wrote: As you suggest you could either roll the index on the local machine or remote and gzip the content fileds on the archive

Re: How do we limit the growth of a Lucene Index?

2007-11-05 Thread Sandeep Mahendru
Hi Grant, Thanks for providing these suggestions. I will work on these directions with my team. Regards, Sandeep. On 11/5/07, Grant Ingersoll [EMAIL PROTECTED] wrote: You could search this list about distributing your indexes, etc. RemoteSearchable may be handy, but you will probably have

How do we limit the growth of a Lucene Index?

2007-11-04 Thread Sandeep Mahendru
Hi , We have been developing an enterprise logging service at the Wachovia bank. The logs (Busines, application, error) for all the bank related applications are consolidated at one single location in an Oracle 10g Database. In our second phase, we are now building a high perforinmg report