: However I'm quite sure that this issue can happen will all filter that may
: remove tokens, like StopFilter, infact you can easily put a stopfilter after
: the worddelimiter (instead of the LengthFilter), and obtain the same error if
: you put in stopwords.txt the letters 'u', 's', 'a' (or just try with 'S.T.S.
: and U.K.', as 's' and 't' are already in stopwords.txt file).
correct ... which is why there are two issues:
1) what (if anything) should IndexWriter do when a the first Token in a
stream has a positionIncrement of 0 (being discussed on java-user)
2) LengthFilter needs an option to keep track of the relative positions
based on the Tokens it has skiped (LUCENE-1253)
FYI: StopFilter already has an option to do this, but Solr doesn't make
thta option available when configuring it in the schema ... want to open
another bug for that? :)
-Hoss