[ 
https://issues.apache.org/jira/browse/LUCENE-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13133694#comment-13133694
 ] 

Uwe Schindler commented on LUCENE-3508:
---------------------------------------

ShingleMatrix is gone in 4.0 and deprecated in 3.x. There may be other filters 
with the same problem, maybe we should look for uses of Token class (which MUST 
DIE DIE DIE!) in the analyzers.
                
> Decompounders based on CompoundWordTokenFilterBase cannot be used with custom 
> attributes
> ----------------------------------------------------------------------------------------
>
>                 Key: LUCENE-3508
>                 URL: https://issues.apache.org/jira/browse/LUCENE-3508
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: modules/analysis
>    Affects Versions: 3.4, 4.0
>            Reporter: Spyros Kapnissis
>            Assignee: Uwe Schindler
>             Fix For: 3.5, 4.0
>
>         Attachments: LUCENE-3508.patch
>
>
> The CompoundWordTokenFilterBase.setToken method will call clearAttributes() 
> and then will reset only the default Token attributes (term, position, flags, 
> etc) resulting in any custom attributes losing their value. Commenting out 
> clearAttributes() seems to do the trick, but will fail the 
> TestCompoundWordTokenFilter tests..

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to