[ http://issues.apache.org/jira/browse/LUCENE-461?page=all ] Erik Hatcher closed LUCENE-461: -------------------------------
> StandardTokenizer splitting all of Korean words into separate characters > ------------------------------------------------------------------------ > > Key: LUCENE-461 > URL: http://issues.apache.org/jira/browse/LUCENE-461 > Project: Lucene - Java > Type: Bug > Components: Analysis > Environment: Analyzing Korean text with Apache Lucene, esp. with > StandardAnalyzer. > Reporter: Cheolgoo Kang > Priority: Minor > Fix For: 1.9 > Attachments: StandardTokenizer_KoreanWord.patch, > TestStandardAnalyzer_KoreanWord.patch > > StandardTokenizer splits all those Korean words inth separate character > tokens. For example, "?????" is one Korean word that means "Hello", but > StandardAnalyzer separates it into five tokens of "?", "?", "?", "?", "?". -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
