Hello, 
We have a couple of custom token filters that use CachingTokenFilter 
internally. However, when we try to test them with MockTokenizer so that we can 
have these nice TokenStream API checks that it provides, the tests fail with: 
"java.lang.AssertionError: end() called before incrementToken() returned false!"

Here is a link with a unit test to reproduce the issue: 
https://gist.github.com/spyk/c783c72689410070811b
Do we misuse CachingTokenFilter? Or is it an issue of MockTonenizer when used 
with CachingTokenFilter?
Thanks!Spyros


Reply via email to