[ 
https://issues.apache.org/jira/browse/LUCENE-1960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Uwe Schindler updated LUCENE-1960:
----------------------------------

    Attachment: optimize-time.txt

Attached is my comparison of an unoptimzed Lucene 2.9 index optimized with 2.9 
and optimized with 3.0 with the latest patch. The index was about 5.7 GB big 
and contained 4 compressed stored fields per document (in addition to ther 
fields uncompressed) containing XML documents.

After optimization with 3.0, the size doubled (which is because of the very 
good compression of XML documents). The optimization took about double time 
with 3.0, because the fields were decompressed and no addRawDocuments was used.

To confirm, that everything worked normal after this initial optimization, I 
updated 38 documents in both indexes and optimized again. The optimization time 
of 2.9 was identical, 3.0 took a little bit longer, which is because the 
uncompressed field created more copy i/o, which you see in the "time" output as 
system time. User time during the initial 2.9 -> 3.0 optimization was much 
larger.

The attached document contains all numbers together with the checkindex outputs 
before and after each step.

> Remove deprecated Field.Store.COMPRESS
> --------------------------------------
>
>                 Key: LUCENE-1960
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1960
>             Project: Lucene - Java
>          Issue Type: Task
>            Reporter: Michael Busch
>            Assignee: Michael Busch
>            Priority: Minor
>             Fix For: 3.0
>
>         Attachments: lucene-1960-1.patch, lucene-1960-1.patch, 
> lucene-1960.patch, optimize-time.txt
>
>
> Also remove FieldForMerge and related code.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-dev-h...@lucene.apache.org

Reply via email to