[jira] Updated: (LUCENE-2911) synchronize grammar/token types across StandardTokenizer, UAX29EmailURLTokenizer, ICUTokenizer, add CJK types.

2011-02-09 Thread Robert Muir (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Robert Muir updated LUCENE-2911:


Attachment: LUCENE-2911.patch

improved the patch by using a simpler demorgan expression Steven came up with.

I think this one is ready to commit.

 synchronize grammar/token types across StandardTokenizer, 
 UAX29EmailURLTokenizer, ICUTokenizer, add CJK types.
 --

 Key: LUCENE-2911
 URL: https://issues.apache.org/jira/browse/LUCENE-2911
 Project: Lucene - Java
  Issue Type: Sub-task
  Components: Analysis
Reporter: Robert Muir
Assignee: Robert Muir
 Fix For: 3.1

 Attachments: LUCENE-2911.patch, LUCENE-2911.patch


 I'd like to do LUCENE-2906 (better cjk support for these tokenizers) for a 
 future target such as 3.2
 But, in 3.1 I would like to do a little cleanup first, and synchronize all 
 these token types, etc.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira



-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] Updated: (LUCENE-2911) synchronize grammar/token types across StandardTokenizer, UAX29EmailURLTokenizer, ICUTokenizer, add CJK types.

2011-02-08 Thread Robert Muir (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Robert Muir updated LUCENE-2911:


Attachment: LUCENE-2911.patch

after applying the patch, you have to run 'ant jflex' from 
modules/analysis/common and 'ant genrbbi' from modules/analysis/icu to 
regenerate.

 synchronize grammar/token types across StandardTokenizer, 
 UAX29EmailURLTokenizer, ICUTokenizer, add CJK types.
 --

 Key: LUCENE-2911
 URL: https://issues.apache.org/jira/browse/LUCENE-2911
 Project: Lucene - Java
  Issue Type: Sub-task
  Components: Analysis
Reporter: Robert Muir
Assignee: Robert Muir
 Fix For: 3.1

 Attachments: LUCENE-2911.patch


 I'd like to do LUCENE-2906 (better cjk support for these tokenizers) for a 
 future target such as 3.2
 But, in 3.1 I would like to do a little cleanup first, and synchronize all 
 these token types, etc.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira



-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org