Re: [Mono-dev] tuning sgen performance & bug

2012-09-03 Thread Nicholas Frechette
You might want to consider optimizing your memory usage. In time series data, usually it is best not to keep objects in those arrays but rather structs. The time serie itself can be an object but keeping large arrays of small objects is very bad performance wise: you waste memory due to the interna

Re: [Mono-dev] tuning sgen performance & bug

2012-08-31 Thread Jonathan Shore
With this specific application, (which is single threaded), I have a "volatile" working set of ~2GB . By volatile I mean that these are not application lifetime objects, rather will be disposed at some point during evaluation. More specifically, I read 1.6TB of data incrementally into 1600 ti

Re: [Mono-dev] tuning sgen performance & bug

2012-08-31 Thread Rodrigo Kumpera
There are two situations that make sgen slower than boehm. The first is a non-generational workload. If your survivor rate is too high, a generational collector can't compete with single space one like boehm. The second one is if you have too much of the old generation pointing to young objects c

[Mono-dev] tuning sgen performance & bug

2012-08-31 Thread Jonathan Shore
HI, sgen is now working for me (thanks to a subtle bug fix for thread-local-storage by Zoltan). However, for one application, sgen is 25% slower than the same with the boehm collector. I am processing some GBs of timeseries data, though only evaluating a window at a time. As the window re