Re: OOM after upgrade to last weeks 0.7

2011-05-17 Thread Ning Zhang
There is a new patch for optimizing partition pruning, including CPU and memory. I think it is not in 0.7 yet. Can you try trunk and see how much memory you need? BTW 72k partitions is indeed quite a large number. When I did the experiments with the new patch, you'll need about 300MB for 20k p

OOM after upgrade to last weeks 0.7

2011-05-17 Thread Terje Marthinussen
Hi, I was running on a 0.7 trunk build from February 2011 until last Friday and upgraded to trunk again then. Things works ok except memory usage when doing queries with large number of partitions is quite dramatically up. I could query 12 months of data in one table with ~72k of partitions with