Re: vm.args change for 15% to 80% improvement in leveldb

2013-08-14 Thread Matthew Von-Maszewski
Yes, use logical CPU count. Matthew On Aug 13, 2013, at 23:17, Jeremiah Peschka jeremiah.pesc...@gmail.com wrote: When you say CPU does that mean logical CPU core? Or is this actually referring to physical CPU cores? E.g. On my laptop with 4 physical cores + HyperThreading, should I set

Re: vm.args change for 15% to 80% improvement in leveldb

2013-08-14 Thread Matthew Von-Maszewski
We are not yet tuning specifically for NUMA. This recent testing had both NUMA and nonNUMA. I count 64 logical cores in your example, so +S 32:32. On Aug 14, 2013, at 9:31 AM, Jeremiah Peschka jeremiah.pesc...@gmail.com wrote: Final question - does NUMA matter? e.g. quad socket system

Re: vm.args change for 15% to 80% improvement in leveldb

2013-08-14 Thread Guido Medina
For the following information should it be +S 4:4 or +S 4:8? root@somehost# lshw -C processor *-cpu description: CPU product: Intel(R) Core(TM) i7 CPU 930 @ 2.80GHz vendor: Intel Corp. physical id: 4 bus info: cpu@0 version: Intel(R) Core(TM)

Re: vm.args change for 15% to 80% improvement in leveldb

2013-08-14 Thread Matthew Von-Maszewski
threads=8 is the key phrase … +S 4:4 On Aug 14, 2013, at 10:04 AM, Guido Medina guido.med...@temetra.com wrote: For the following information should it be +S 4:4 or +S 4:8? root@somehost# lshw -C processor *-cpu description: CPU product: Intel(R) Core(TM) i7 CPU 930

Re: vm.args change for 15% to 80% improvement in leveldb

2013-08-14 Thread Guido Medina
Hi Matthew, It is a bit confusing, cause let's say +S C:T is defined as: C = Physical cores? T = Total threads or total - physical cores? Is it a sum of or the physical cores and total of threads? That's the confusing part, let's say you have a server with 8 physical cores with no hyper

Re: vm.args change for 15% to 80% improvement in leveldb

2013-08-14 Thread Sean Cribbs
http://www.erlang.org/doc/man/erl.html#+S +S TotalSchedulers:OnlineSchedulers On Wed, Aug 14, 2013 at 9:57 AM, Guido Medina guido.med...@temetra.comwrote: Hi Matthew, It is a bit confusing, cause let's say +S C:T is defined as: C = Physical cores? T = Total threads or total - physical

vm.args change for 15% to 80% improvement in leveldb

2013-08-13 Thread Matthew Von-Maszewski
** The following is copied from Basho's leveldb wiki page: https://github.com/basho/leveldb/wiki/Riak-tuning-1 Summary: leveldb has a higher read and write throughput in Riak if the Erlang scheduler count is limited to half the number of CPU cores. Tests have demonstrated improvements of

Re: vm.args change for 15% to 80% improvement in leveldb

2013-08-13 Thread Jeremiah Peschka
When you say CPU does that mean logical CPU core? Or is this actually referring to physical CPU cores? E.g. On my laptop with 4 physical cores + HyperThreading, should I set +S to +S 4:4 You hint that it doesn't matter, but I just wanted to trick you into explicitly saying something. ---