[jira] [Commented] (LUCENE-8904) Enhance Nori DictionaryBuilder tool
[ https://issues.apache.org/jira/browse/LUCENE-8904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903053#comment-16903053 ] ASF subversion and git services commented on LUCENE-8904: - Commit 70854dc1efbdc1d7efdb8ac0421c69d36ea6e31f in lucene-solr's branch refs/heads/branch_8x from Namgyu Kim [ https://gitbox.apache.org/repos/asf?p=lucene-solr.git;h=70854dc ] LUCENE-8904: enhance Nori DictionaryBuilder tool > Enhance Nori DictionaryBuilder tool > --- > > Key: LUCENE-8904 > URL: https://issues.apache.org/jira/browse/LUCENE-8904 > Project: Lucene - Core > Issue Type: Improvement >Reporter: Namgyu Kim >Assignee: Namgyu Kim >Priority: Major > Time Spent: 1h 50m > Remaining Estimate: 0h > > It is the Nori version of [~sokolov]'s LUCENE-8863. > This patch has two changes. > 1) Improve exception handling > 2) Enable external dictionary for testing > Overall, it is the same as LUCENE-8863. > But there are some differences between Nori and Kuromoji. > These can be slightly different on the code. > 1) CSV field size > Nori : 12 > Kuromoji : 13 > 2) left context ID == right context ID > Nori : can be different > Kuromoji : always same > 3) Dictionary Type > Nori : just one type > Kuromoji : IPADIC, UNIDIC > After this job, I'll apply LUCENE-8866 and LUCENE-8871 to Nori. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-8904) Enhance Nori DictionaryBuilder tool
[ https://issues.apache.org/jira/browse/LUCENE-8904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883474#comment-16883474 ] ASF subversion and git services commented on LUCENE-8904: - Commit 2ac5fb668a83f6484276de8059875bebf6a7ce16 in lucene-solr's branch refs/heads/jira/SOLR-13565 from Namgyu Kim [ https://gitbox.apache.org/repos/asf?p=lucene-solr.git;h=2ac5fb6 ] LUCENE-8904: enhance Nori DictionaryBuilder tool > Enhance Nori DictionaryBuilder tool > --- > > Key: LUCENE-8904 > URL: https://issues.apache.org/jira/browse/LUCENE-8904 > Project: Lucene - Core > Issue Type: Improvement >Reporter: Namgyu Kim >Assignee: Namgyu Kim >Priority: Major > Time Spent: 1h 50m > Remaining Estimate: 0h > > It is the Nori version of [~sokolov]'s LUCENE-8863. > This patch has two changes. > 1) Improve exception handling > 2) Enable external dictionary for testing > Overall, it is the same as LUCENE-8863. > But there are some differences between Nori and Kuromoji. > These can be slightly different on the code. > 1) CSV field size > Nori : 12 > Kuromoji : 13 > 2) left context ID == right context ID > Nori : can be different > Kuromoji : always same > 3) Dictionary Type > Nori : just one type > Kuromoji : IPADIC, UNIDIC > After this job, I'll apply LUCENE-8866 and LUCENE-8871 to Nori. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-8904) Enhance Nori DictionaryBuilder tool
[ https://issues.apache.org/jira/browse/LUCENE-8904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883055#comment-16883055 ] ASF subversion and git services commented on LUCENE-8904: - Commit 2ac5fb668a83f6484276de8059875bebf6a7ce16 in lucene-solr's branch refs/heads/master from Namgyu Kim [ https://gitbox.apache.org/repos/asf?p=lucene-solr.git;h=2ac5fb6 ] LUCENE-8904: enhance Nori DictionaryBuilder tool > Enhance Nori DictionaryBuilder tool > --- > > Key: LUCENE-8904 > URL: https://issues.apache.org/jira/browse/LUCENE-8904 > Project: Lucene - Core > Issue Type: Improvement >Reporter: Namgyu Kim >Priority: Major > Time Spent: 1h 50m > Remaining Estimate: 0h > > It is the Nori version of [~sokolov]'s LUCENE-8863. > This patch has two changes. > 1) Improve exception handling > 2) Enable external dictionary for testing > Overall, it is the same as LUCENE-8863. > But there are some differences between Nori and Kuromoji. > These can be slightly different on the code. > 1) CSV field size > Nori : 12 > Kuromoji : 13 > 2) left context ID == right context ID > Nori : can be different > Kuromoji : always same > 3) Dictionary Type > Nori : just one type > Kuromoji : IPADIC, UNIDIC > After this job, I'll apply LUCENE-8866 and LUCENE-8871 to Nori. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
