[jira] [Comment Edited] (LUCENE-4599) Compressed term vectors

2013-01-18 Thread Shawn Heisey (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13557849#comment-13557849
 ] 

Shawn Heisey edited comment on LUCENE-4599 at 1/19/13 1:41 AM:
---

bq. If someone with very large term vector files wanted to test this new 
format, this would be great! I'll try on my side to perform more 
indexing/highlighting
benchmarks..

My indexes are pretty big, with termvectors taking up a lot of that. The 3.5.0 
version of each of my shards is about 21GB. The same index in 4.1 with 
compressed stored fields is a little lres than 17 GB. I will give this patch a 
try on branch_4x. The full import will take 7-8 hours.

  was (Author: elyograg):
bq. If someone with very large term vector files wanted to test this new 
format, this
would be great! I'll try on my side to perform more indexing/highlighting
benchmarks..

My indexes are pretty big, with termvectors taking up a lot of that. The 3.5.0 
version of each of my shards is about 21GB. The same index in 4.1 with 
compressed stored fields is a little lres than 17 GB. I will give this patch a 
try on branch_4x. The full import will take 7-8 hours.
  
> Compressed term vectors
> ---
>
> Key: LUCENE-4599
> URL: https://issues.apache.org/jira/browse/LUCENE-4599
> Project: Lucene - Core
>  Issue Type: Task
>  Components: core/codecs, core/termvectors
>Reporter: Adrien Grand
>Assignee: Adrien Grand
>Priority: Minor
> Fix For: 4.2
>
> Attachments: LUCENE-4599.patch, LUCENE-4599.patch, LUCENE-4599.patch
>
>
> We should have codec-compressed term vectors similarly to what we have with 
> stored fields.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Comment Edited] (LUCENE-4599) Compressed term vectors

2013-01-18 Thread Shawn Heisey (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13557849#comment-13557849
 ] 

Shawn Heisey edited comment on LUCENE-4599 at 1/19/13 1:42 AM:
---

bq. If someone with very large term vector files wanted to test this new 
format, this would be great! I'll try on my side to perform more 
indexing/highlighting benchmarks..

My indexes are pretty big, with termvectors taking up a lot of that. The 3.5.0 
version of each of my shards is about 21GB. The same index in 4.1 with 
compressed stored fields is a little lres than 17 GB. I will give this patch a 
try on branch_4x. The full import will take 7-8 hours.

  was (Author: elyograg):
bq. If someone with very large term vector files wanted to test this new 
format, this would be great! I'll try on my side to perform more 
indexing/highlighting
benchmarks..

My indexes are pretty big, with termvectors taking up a lot of that. The 3.5.0 
version of each of my shards is about 21GB. The same index in 4.1 with 
compressed stored fields is a little lres than 17 GB. I will give this patch a 
try on branch_4x. The full import will take 7-8 hours.
  
> Compressed term vectors
> ---
>
> Key: LUCENE-4599
> URL: https://issues.apache.org/jira/browse/LUCENE-4599
> Project: Lucene - Core
>  Issue Type: Task
>  Components: core/codecs, core/termvectors
>Reporter: Adrien Grand
>Assignee: Adrien Grand
>Priority: Minor
> Fix For: 4.2
>
> Attachments: LUCENE-4599.patch, LUCENE-4599.patch, LUCENE-4599.patch
>
>
> We should have codec-compressed term vectors similarly to what we have with 
> stored fields.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org