[
https://issues.apache.org/jira/browse/LUCENE-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517386#comment-17517386
]
ASF subversion and git services commented on LUCENE-10497:
----------------------------------------------------------
Commit bb4a0dc19ba911ac488e3ea7d6fcb3b17a38832f in lucene's branch
refs/heads/main from Tomoko Uchida
[ https://gitbox.apache.org/repos/asf?p=lucene.git;h=bb4a0dc19ba ]
LUCENE-10497: Add a base Token class to analysis-common (for kuromoji and nori)
(#783)
> Unify "Token" interface in Kuromoji and Nori
> --------------------------------------------
>
> Key: LUCENE-10497
> URL: https://issues.apache.org/jira/browse/LUCENE-10497
> Project: Lucene - Core
> Issue Type: Sub-task
> Reporter: Tomoko Uchida
> Priority: Minor
> Time Spent: 20m
> Remaining Estimate: 0h
>
> "Token" classes are the output of the viterbi algorithm in kuromoji and nori,
> and its implementation is slightly different between them (Nori's Token class
> looks more expressive or extendable).
> To proceed [LUCENE-10493], I think we need the unified "Token" class or at
> least a common interface for it.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
