[ 
https://issues.apache.org/jira/browse/LUCENE-966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Stanislaw Osinski updated LUCENE-966:
-------------------------------------

    Attachment: jflex-analyzer-patch.txt

Here comes a somewhat rough (needing refactorings, see below) patch adding a 
JFlex-based repalcement for StandardAnalyzer called FastAnalyzer.  A few 
comments:

* all tests from TestStandardAnalyzer pass
* tokenizer generation added to Ant build scripts

Because FastAnalyzer shares some code with StandardAnalyzer, it might be 
worthwhile to do some refactorings:

* have a common test for both analyzers (only if we want to keep them in sync)
* have a common superclass for FastFilter and StandardFilter
* have a common superclass for FastAnalyzer and StandardAnalyzer

> A faster JFlex-based replacement for StandardAnalyzer
> -----------------------------------------------------
>
>                 Key: LUCENE-966
>                 URL: https://issues.apache.org/jira/browse/LUCENE-966
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Analysis
>            Reporter: Stanislaw Osinski
>             Fix For: 2.3
>
>         Attachments: jflex-analyzer-patch.txt
>
>
> JFlex (http://www.jflex.de/) can be used to generate a faster (up to several 
> times) replacement for StandardAnalyzer. Will add a patch and a simple 
> benchmark code in a while.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

Reply via email to