Matthias Krueger created LUCENE-8185: ----------------------------------------
Summary: HyphenationCompoundWordTokenFilter returns terms shorter than minSubwordSize Key: LUCENE-8185 URL: https://issues.apache.org/jira/browse/LUCENE-8185 Project: Lucene - Core Issue Type: Bug Reporter: Matthias Krueger To account for languages which use binding characters ("fogemorphemes") for composing words the {{HyphenationCompoundWordTokenFilter}} re-checks the dictionary for a candidate with the last character removed when the original candidate was not found. It currently does not re-check against {{minSubWordSize}} in this case. Terms that are one character shorter than {{minSubWordSize}} can be returned. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org