[ 
https://issues.apache.org/jira/browse/LUCENE-2218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12801502#action_12801502
 ] 

Steven Rowe commented on LUCENE-2218:
-------------------------------------

New output from the fixed benchmark script - no change in the ShingleFilter 
patch:

JAVA:
java version "1.5.0_15"
Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_15-b04)
Java HotSpot(TM) 64-Bit Server VM (build 1.5.0_15-b04, mixed mode)

OS:
cygwin
WinVistaService Pack 2
Service Pack 26060022202561

||Max Shingle 
Size||Unigrams?||Unpatched||Patched||StandardAnalyzer||Improvement||
|2|no|5.03s|4.62s|2.18s|16.8%|
|2|yes|5.20s|4.84s|2.18s|13.5%|
|4|no|6.42s|5.70s|2.18s|20.5%|
|4|yes|6.53s|5.89s|2.18s|17.3%|


> ShingleFilter improvements
> --------------------------
>
>                 Key: LUCENE-2218
>                 URL: https://issues.apache.org/jira/browse/LUCENE-2218
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: contrib/analyzers
>    Affects Versions: 3.0
>            Reporter: Steven Rowe
>            Priority: Minor
>         Attachments: LUCENE-2218.benchmark.patch, 
> LUCENE-2218.benchmark.patch, LUCENE-2218.benchmark.patch, LUCENE-2218.patch
>
>
> ShingleFilter should allow configuration of minimum shingle size (in addition 
> to maximum shingle size), so that it's possible to (e.g.) output only 
> trigrams instead of bigrams mixed with trigrams.  The token separator used in 
> composing shingles should be configurable too.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-dev-h...@lucene.apache.org

Reply via email to