[ 
https://issues.apache.org/jira/browse/LUCENE-1958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12764141#action_12764141
 ] 

Robert Muir commented on LUCENE-1958:
-------------------------------------

MRIT64, actually I am not curious about next(reusableToken), but instead 
whether your Analyzer implements 

{code}
public TokenStream reusableTokenStream(String fieldName, Reader reader) throws 
IOException
{code}

If you were trying to reuse ShingleFilters in 2.4.1 with this technique, I 
think this would be unsafe. It is safe in 2.9

bq. Anyway, it doesnt' matter know because the problem doesnt occur with Lucene 
2.9.

Ok to mark this issue as resolved?


> ShingleFilter creates shingles across two consecutives documents : bug or 
> normal behaviour ?
> --------------------------------------------------------------------------------------------
>
>                 Key: LUCENE-1958
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1958
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: contrib/analyzers
>    Affects Versions: 2.4.1
>         Environment: Windows XP / jdk1.6.0_15
>            Reporter: MRIT64
>            Priority: Minor
>
> HI
> I add two consecutive documents that are indexed with some filters. The last 
> one is ShingleFilter.
> ShingleFilter creates a shingle spannnig the two documents, which has no 
> sense in my context.
> Is that a bug oris it  ShingleFilter normal behaviour ? If it's normal 
> behaviour, is it possible to change it optionnaly ?
> Thanks
> MR

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-dev-h...@lucene.apache.org

Reply via email to