[jira] Updated: (LUCENE-1966) Arabic Analyzer: Stopwords list needs enhancement
[ https://issues.apache.org/jira/browse/LUCENE-1966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Basem Narmok updated LUCENE-1966: - Attachment: LUCENE-1966.patch arabic-stopwords-comments.txt Please see the arabic-stopwords-comments.txt to see my comments on the list, and why/what did I change. The patch provides an updated Arabic stopwords file, and modifies ArabicAnalyzer to filter stopwords after the normalization, as the provided list is a normalized Arabic stop words. Best, > Arabic Analyzer: Stopwords list needs enhancement > - > > Key: LUCENE-1966 > URL: https://issues.apache.org/jira/browse/LUCENE-1966 > Project: Lucene - Java > Issue Type: Improvement > Components: contrib/analyzers >Affects Versions: 2.9.1 >Reporter: Basem Narmok >Priority: Trivial > Fix For: 2.9 > > Attachments: arabic-stopwords-comments.txt, LUCENE-1966.patch > > > The provided Arabic stopwords list needs some enhancements (e.g. it contains > a lot of words that not stopwords, and some cleanup) . patch will be provided > with this issue. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. - To unsubscribe, e-mail: java-dev-unsubscr...@lucene.apache.org For additional commands, e-mail: java-dev-h...@lucene.apache.org
[jira] Updated: (LUCENE-1966) Arabic Analyzer: Stopwords list needs enhancement
[ https://issues.apache.org/jira/browse/LUCENE-1966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Muir updated LUCENE-1966: Affects Version/s: (was: 2.9.1) 2.9 Fix Version/s: (was: 2.9) 3.0 > Arabic Analyzer: Stopwords list needs enhancement > - > > Key: LUCENE-1966 > URL: https://issues.apache.org/jira/browse/LUCENE-1966 > Project: Lucene - Java > Issue Type: Improvement > Components: contrib/analyzers >Affects Versions: 2.9 >Reporter: Basem Narmok >Assignee: Robert Muir >Priority: Trivial > Fix For: 3.0 > > Attachments: arabic-stopwords-comments.txt, LUCENE-1966.patch > > > The provided Arabic stopwords list needs some enhancements (e.g. it contains > a lot of words that not stopwords, and some cleanup) . patch will be provided > with this issue. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. - To unsubscribe, e-mail: java-dev-unsubscr...@lucene.apache.org For additional commands, e-mail: java-dev-h...@lucene.apache.org
[jira] Updated: (LUCENE-1966) Arabic Analyzer: Stopwords list needs enhancement
[ https://issues.apache.org/jira/browse/LUCENE-1966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Basem Narmok updated LUCENE-1966: - Attachment: LUCENE-1966.patch Robert, you are correct, to solve the problem we have two options: 1- to remove words like علي and وفي 2- to use unnormalized stiowirds list, before the normalization filter. I think the best is the second option, so this patch only modifies the list (unnormalized), please try it. > Arabic Analyzer: Stopwords list needs enhancement > - > > Key: LUCENE-1966 > URL: https://issues.apache.org/jira/browse/LUCENE-1966 > Project: Lucene - Java > Issue Type: Improvement > Components: contrib/analyzers >Affects Versions: 2.9 >Reporter: Basem Narmok >Assignee: Robert Muir >Priority: Trivial > Fix For: 3.0 > > Attachments: arabic-stopwords-comments.txt, LUCENE-1966.patch, > LUCENE-1966.patch > > > The provided Arabic stopwords list needs some enhancements (e.g. it contains > a lot of words that not stopwords, and some cleanup) . patch will be provided > with this issue. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. - To unsubscribe, e-mail: java-dev-unsubscr...@lucene.apache.org For additional commands, e-mail: java-dev-h...@lucene.apache.org
