Do stopfilters create non-contiguous token positions?
I was interested in experimenting with the highlighter and using the
TokenSources.getTokenStream(TermPositionVector
tpv, boolean
tokenPositionsGuaranteedContiguous) method
The javadocs for this method
On Dec 5, 2005, at 11:32 PM, Dan Climan wrote:
Do stopfilters create non-contiguous token positions?
No, not currently. StopFilter leaves token positions in their
original state, which defaults to contiguous (offset of 1).
There is an open issue to change this behavior though, and at one
