Re: Memory usage

2010-10-07 Thread Jeff Moss
Taking Chris's information into mind I was able to isolate this to a test case. I found this ticket that seems to indicate a fundamental problem in the solr/lucene boundary. https://issues.apache.org/jira/browse/SOLR- Here's how to reproduce my results: 1. Create an index with a field like th

Re: Memory usage

2010-09-30 Thread Jeff Moss
I think you've probably nailed it Chris, thanks for that, I think I can get by with a different approach than this. Do you know if I will get the same memory consumption using the RandomFieldType vs the TrieInt? -Jeff On Thu, Sep 30, 2010 at 12:36 PM, Chris Hostetter wrote: > > : There are 14,6

Re: Memory usage

2010-09-30 Thread Jeff Moss
need 6-12G of ram total. > There is something odd going on here. > > Lance > > On Wed, Sep 29, 2010 at 4:34 PM, Jeff Moss wrote: > > My server has 128GB of ram, the index is 22GB large. It seems the memory > > consumption goes up on every query and the garbage collect

Memory usage

2010-09-29 Thread Jeff Moss
My server has 128GB of ram, the index is 22GB large. It seems the memory consumption goes up on every query and the garbage collector will never free up as much memory as I expect it to. The memory consumption looks like a curve, it eventually levels off but the old gen is always 60 or 70GB. I have