[
https://issues.apache.org/jira/browse/LUCENE-1793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12741173#action_12741173
]
DM Smith commented on LUCENE-1793:
----------------------------------
I wasn't thinking about any encoding in particular. It was in reference to
Uwe's comment:
bq. You are right, to reduce index size, it would be good, to also support
other encodings in addition to UTF-8 for storage of term text.
I think that having other encodings can be problematic. Problems that Unicode
solves. But if the idea is worthy of discussion then a new issue would be a
better place to house it.
Regarding BOCU it is a patented algorithm requiring a license from IBM for
implementation. I gather that it is part of ICU. Not sure if either is a big
deal or not.
> remove custom encoding support in Greek/Russian Analyzers
> ---------------------------------------------------------
>
> Key: LUCENE-1793
> URL: https://issues.apache.org/jira/browse/LUCENE-1793
> Project: Lucene - Java
> Issue Type: Improvement
> Components: contrib/analyzers
> Reporter: Robert Muir
> Priority: Minor
> Attachments: LUCENE-1793.patch
>
>
> The Greek and Russian analyzers support custom encodings such as KOI-8, they
> define things like Lowercase and tokenization for these.
> I think that analyzers should support unicode and that conversion/handling of
> other charsets belongs somewhere else.
> I would like to deprecate/remove the support for these other encodings.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-dev-h...@lucene.apache.org
