Hello, I searched a lot about lucene limits and its performance, but I still don't know how much I can count on it. I'm storing logs and indexing them with lucene. The event per second is 2000. The format of each log is generally 'fieldname' : 'fieldvalue'. What search performance should I expect after a few days. Right now I'm having around 25 seconds of query response time on around 500 million logs. Each log is converted into a document and the field values are stored as well as being indexed. I have around 10 fields in each log. Is my query time normal, of am I making a huge mistake? How much does storing fields make a difference, would it be better if I didn't store the fields.
Thanks.
