[ https://issues.apache.org/jira/browse/SOLR-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716763#action_12716763 ]
Robert Muir commented on SOLR-1204: ----------------------------------- those others you mentioned also look good... in fact the last one you mentioned (the java one) might be the easiest to implement http://java.sun.com/j2se/1.4.2/docs/api/java/lang/Character.html#isJavaIdentifierStart(char) http://java.sun.com/j2se/1.4.2/docs/api/java/lang/Character.html#isJavaIdentifierPart(char) i'm not worried about punctuation just real "letters" in languages where .isLetter() returns false! > Enhance SpellingQueryConverter to handle UTF-8 instead of ASCII only > -------------------------------------------------------------------- > > Key: SOLR-1204 > URL: https://issues.apache.org/jira/browse/SOLR-1204 > Project: Solr > Issue Type: Improvement > Components: spellchecker > Affects Versions: 1.3 > Reporter: Michael Ludwig > Assignee: Shalin Shekhar Mangar > Priority: Trivial > Fix For: 1.4 > > Attachments: SpellingQueryConverter.java.diff, > SpellingQueryConverter.java.diff > > > Solr - User - SpellCheckComponent: queryAnalyzerFieldType > http://www.nabble.com/SpellCheckComponent%3A-queryAnalyzerFieldType-td23870668.html > In the above thread, it was suggested to extend the SpellingQueryConverter to > cover the full UTF-8 range instead of handling US-ASCII only. This might be > as simple as changing the regular expression used to tokenize the input > string to accept a sequence of one or more Unicode letters ( \p{L}+ ) instead > of a sequence of one or more word characters ( \w+ ). > See http://java.sun.com/j2se/1.4.2/docs/api/java/util/regex/Pattern.html for > Java regular expression reference. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.