Re: Index Rows as Documents? Help me design a solution

2006-07-26 Thread Namit Yadav
Thanks for the suggestions ! I am still talking about Indexing. The 'split the files' implementation was just an experiment as I wasn't able to get the kind of performance I needed from making rows as Documents. Now back to using rows as Documents: As Erick and Jeremy suggested, the MaxBufferedD

Re: Index Rows as Documents? Help me design a solution

2006-07-26 Thread Namit Yadav
Thanks all for the responses. I am very pleasently surprised at the helpful responses that I am getting. Okay, I think I still haven't understood Lucene well. I am sure that I am not solving the problem the right way. So I am explaining the problem at a very high level here .. please tell me what

Re: Index Rows as Documents? Help me design a solution

2006-07-25 Thread Namit Yadav
Thanks for the suggestion, Erick! As for why we can't use a relational database, we get all the logs from an external application. And due to the nature of the business, we need to continue maintaining the logs. Moreover, the search requests are very infrequent .. so it doesn't make sense to (alm

Index Rows as Documents? Help me design a solution

2006-07-24 Thread Namit Yadav
My question might be very easy for you Lucene experts. But after going through the Lucene documentation / example, I haven't been able to figure out how to solve this problem. I'll be really grateful if someone can help me get a starting point here. Our application tracks SMSes sent from a partic