[
https://issues.apache.org/jira/browse/SOLR-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716597#action_12716597
]
Robert Muir commented on SOLR-1204:
-----------------------------------
hi, michael. Its not for some languages. I recommend using this definition of
'identifier' from UTR #8:
<identifier> ::= <identifier_start > ( <identifier_start> |
<identifier_extend> )*
<identifier_start> Lu,Ll,Lt,Lm,Lo,Nl Uppercase letter, Lowercase
letter, Titlecase letter, Modifier letter, Other letter, Letter number
<identifier_extend> Mn,Mc,Nd,Pc,Cf Non-spacing mark, Spacing combining
mark, Decimal number, Connector punctuation, Formatting code
<ident_ignorable_char> Cf Formatting code
Thanks!
> Enhance SpellingQueryConverter to handle UTF-8 instead of ASCII only
> --------------------------------------------------------------------
>
> Key: SOLR-1204
> URL: https://issues.apache.org/jira/browse/SOLR-1204
> Project: Solr
> Issue Type: Improvement
> Components: spellchecker
> Affects Versions: 1.3
> Reporter: Michael Ludwig
> Assignee: Shalin Shekhar Mangar
> Priority: Trivial
> Fix For: 1.4
>
> Attachments: SpellingQueryConverter.java.diff,
> SpellingQueryConverter.java.diff
>
>
> Solr - User - SpellCheckComponent: queryAnalyzerFieldType
> http://www.nabble.com/SpellCheckComponent%3A-queryAnalyzerFieldType-td23870668.html
> In the above thread, it was suggested to extend the SpellingQueryConverter to
> cover the full UTF-8 range instead of handling US-ASCII only. This might be
> as simple as changing the regular expression used to tokenize the input
> string to accept a sequence of one or more Unicode letters ( \p{L}+ ) instead
> of a sequence of one or more word characters ( \w+ ).
> See http://java.sun.com/j2se/1.4.2/docs/api/java/util/regex/Pattern.html for
> Java regular expression reference.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
