factor CharTokenizer/CharacterUtils into analyzers module
---------------------------------------------------------
Key: LUCENE-3063
URL: https://issues.apache.org/jira/browse/LUCENE-3063
Project: Lucene - Java
Issue Type: Task
Reporter: Robert Muir
Fix For: 4.0
Attachments: LUCENE-3063.patch
Currently these analysis components are in the lucene core, but should really
be .util in the analyzers module.
Also, with MockTokenizer extending Tokenizer directly, we can add some
additional
checks in the future to try to ensure our consumers are being good consumers
(e.g. calling reset).
This is mentioned in http://wiki.apache.org/lucene-java/TestIdeas, I didn't
implement it here yet,
this is just the factoring. I think we should try to do this before LUCENE-3040.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
