: However I'm quite sure that this issue can happen will all filter that may
: remove tokens, like StopFilter, infact you can easily put a stopfilter after
: the worddelimiter (instead of the LengthFilter), and obtain the same error if
: you put in stopwords.txt the letters 'u', 's', 'a' (or just try with 'S.T.S.
: and U.K.', as 's' and 't' are already in stopwords.txt file).

correct ... which is why there are two issues:
  1) what (if anything) should IndexWriter do when a the first Token in a 
     stream has a positionIncrement of 0 (being discussed on java-user)
  2) LengthFilter needs an option to keep track of the relative positions 
     based on the Tokens it has skiped (LUCENE-1253)

FYI: StopFilter already has an option to do this, but Solr doesn't make 
thta option available when configuring it in the schema ... want to open 
another bug for that?  :)


-Hoss

Reply via email to