On Dec 31, 2007, at 11:44 AM, Yonik Seeley wrote:
On Dec 31, 2007 11:37 AM, Doron Cohen <[EMAIL PROTECTED]> wrote:
On Dec 31, 2007 6:10 PM, Yonik Seeley <[EMAIL PROTECTED]> wrote:
I think I like the 3'rd option - is this what you meant?
I meant (1)... it leaves the core smaller.
I don't see any reason to have logic to truncate or discard tokens in
the core indexing code (except to handle tokens >16k as an error
condition).
I would agree here, with the exception that I want the option for it
to be treated as an error. In some cases, I would be just as happy
for it to silently ignore the token, or to log it.
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
