On Thu, Apr 3, 2008 at 11:46 AM, Tricia Williams <[EMAIL PROTECTED]> wrote: > When a WordDelimiterFilter ingests a token stream and creates a new token > (newTok) it appears to copy most of the old token attributes, except the > payload. I believe this is a bug. My solution is for the > WordDelimiterFilter to use the Token clone() method to create a carbon copy > and then modify the appropriate attributes (offsets and term text). I'm > prepared to open a JIRA issue and submit a patch if others agree with my > solution.
That sounds right. Are there types of payloads that we wouldn't want duplicated for things like WDF or synonyms? -Yonik
