Term Frequency vector consumes memory

2009-06-30 Thread Ganesh
At the end of the day, I used to build the stats of top indexed terms. I enabled term frequency for the single field. It is working fine. I could able to get the top terms and its frequencies. It consumes huge amount of RAM. My index size is 5 GB and has 8 million records. If i didn't enable ter

Re: Term Frequency vector consumes memory

2009-06-30 Thread Grant Ingersoll
In Lucene, a Term Vector is a specific thing that is stored on disk when creating a Document and Field. It is optional and off by default. It is separate from being able to get the term frequencies for all the docs in a specific field. The former is decided at indexing time and there is

Re: Term Frequency vector consumes memory

2009-06-30 Thread Ganesh
er to load term vector. I want to switch off this feature? Is that possible without re-indexing? Regards Ganesh - Original Message - From: "Grant Ingersoll" To: Sent: Tuesday, June 30, 2009 9:48 PM Subject: Re: Term Frequency vector consumes memory > In Lucene, a Term Ve

Re: Term Frequency vector consumes memory

2009-07-02 Thread Grant Ingersoll
ant Ingersoll" To: Sent: Tuesday, June 30, 2009 9:48 PM Subject: Re: Term Frequency vector consumes memory In Lucene, a Term Vector is a specific thing that is stored on disk when creating a Document and Field. It is optional and off by default. It is separate from being able to get th