index large size file

2009-03-10 Thread Amy Zhou
Hi, I'm having a couple of questions about indexing large size file. As my understanding, the default MaxFieldLength 100,000. In Lucene 2.4, we can set the MaxFieldLength during constructor. My questions are: 1) How's the performance if MaxFieldLength is set to UNLIMITED? 2) Any other options f

RE: index large size file

2009-03-10 Thread Amy Zhou
Message- From: Mark Miller [mailto:markrmil...@gmail.com] Sent: Tuesday, March 10, 2009 9:37 AM To: java-user@lucene.apache.org Subject: Re: index large size file Amy Zhou wrote: > Hi, > > I'm having a couple of questions about indexing large size file. As my > understan

RE: index large size file

2009-03-10 Thread Amy Zhou
ly more resources for a file with 10 tokens than if the MaxFieldLength were 100. As far as I know. Best Erick On Tue, Mar 10, 2009 at 10:47 AM, Amy Zhou wrote: > My issue here is that large file is truncated with default MaxFieldLength > 10,000 during indexing. The file size I index cou