Re: Indexing the same field multiple times in a doc.

2006-08-15 Thread Yonik Seeley
On 8/15/06, Chris Hostetter <[EMAIL PROTECTED]> wrote: b) i'm not entirely sure if that limit is on a single field value, or on the total number of indexed tokens for that field name -- in which case this approach doesn't work arround it at all -- make sure you test with two fields whose total n

Re: Indexing the same field multiple times in a doc.

2006-08-15 Thread Chris Hostetter
: : Here's the root question: "Am I reasonably safe, for a single document, in : thinking of indexing multiple chunks with the same field as being identical, : for all practical purposes, with indexing the field once with all the chunks : concatenated together?". esentially that's true -- the diff

Re: Indexing the same field multiple times in a doc.

2006-08-15 Thread Erick Erickson
I think I just answered my own question. No, there's no difference. Including running into an OutOfMemory error when adding the doc. It seems like I can think of this exactly as concatenating all the chunks together and indexing them all at once, including the limitations. So even though it all s

Indexing the same field multiple times in a doc.

2006-08-15 Thread Erick Erickson
That's way cool. I'm not entirely clear on this point, but my test sure worked out well. So I thought I'd see if the behavior I'm seeing is expected. If so, way cool coding guys! Here's the root question: "Am I reasonably safe, for a single document, in thinking of indexing multiple chunks wi