[ https://issues.apache.org/jira/browse/LUCENE-1391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12632191#action_12632191 ]
Wouter Heijke commented on LUCENE-1391: --------------------------------------- Hi Karl, Yes the unigram tokens is what i'm referring to. The output tokens can have 'Shingle', or something I can define, even concattenated types could be handy in some cases! Now that I come to it, I'm also missing setTokenType like ShingleFilter has. > Token type and flags values get lost when using ShingleMatrixFilter > ------------------------------------------------------------------- > > Key: LUCENE-1391 > URL: https://issues.apache.org/jira/browse/LUCENE-1391 > Project: Lucene - Java > Issue Type: Bug > Components: contrib/analyzers > Affects Versions: 2.4 > Reporter: Wouter Heijke > Assignee: Karl Wettin > > While using the new ShingleMatrixFilter I noticed that a token's type and > flags get lost while using this filter. ShingleFilter does respect these > values like the other filters I know. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]