[ 
https://issues.apache.org/jira/browse/LUCENE-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13002583#comment-13002583
 ] 

Mark Miller edited comment on LUCENE-2939 at 3/4/11 1:03 PM:
-------------------------------------------------------------

{quote} Right, but you can use term vectors with this highlighter too right?
This issue only seems to refer to the case where you have no term vectors and 
analyze the text at runtime...{quote}

Nope, that's not true. If you turn on term vectors, that does *NOT* solve this 
bug.

      was (Author: markrmil...@gmail.com):
    bq. Right, but you can use term vectors with this highlighter too right?
This issue only seems to refer to the case where you have no term vectors and 
analyze the text at runtime...

Nope, that's not true. If you turn on term vectors, that does *NOT* solve this 
bug.
  
> Highlighter should try and use maxDocCharsToAnalyze in 
> WeightedSpanTermExtractor when adding a new field to MemoryIndex as well as 
> when using CachingTokenStream
> ----------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: LUCENE-2939
>                 URL: https://issues.apache.org/jira/browse/LUCENE-2939
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: contrib/highlighter
>            Reporter: Mark Miller
>            Assignee: Mark Miller
>            Priority: Minor
>             Fix For: 3.1, 4.0
>
>         Attachments: LUCENE-2939.patch, LUCENE-2939.patch, LUCENE-2939.patch
>
>
> huge documents can be drastically slower than need be because the entire 
> field is added to the memory index
> this cost can be greatly reduced in many cases if we try and respect 
> maxDocCharsToAnalyze
> things can be improved even further by respecting this setting with 
> CachingTokenStream

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to