Re: How to detect multi-core and/or HT-enabled CPUs in 2.4.x and 2.6.x kernels

2006-12-27 Thread Siddha, Suresh B
On Wed, Dec 27, 2006 at 09:52:02AM -0800, Martin Knoblauch wrote: > For sizing purposes, doing benchmarks is the only way. For the purpose > of Ganglia the sockets/cores/threads info is purely for inventory. And > we are likely going to add the new information to our metrics. > > But - we still

Re: How to detect multi-core and/or HT-enabled CPUs in 2.4.x and 2.6.x kernels

2006-12-27 Thread Martin Knoblauch
>In article <[EMAIL PROTECTED]> you wrote: >> once your program (and many others) have such a check, then the next >> step will be pressure on the kernel code to "fake" the old situation >> when there is a processor where no longer >> holds. It's basically a road to madness :-( > > I agree that fo

Re: How to detect multi-core and/or HT-enabled CPUs in 2.4.x and 2.6.x kernels

2006-12-27 Thread Bernd Eckenfels
In article <[EMAIL PROTECTED]> you wrote: > once your program (and many others) have such a check, then the next > step will be pressure on the kernel code to "fake" the old situation > when there is a processor where no longer > holds. It's basically a road to madness :-( I agree that for HPC si

Re: How to detect multi-core and/or HT-enabled CPUs in 2.4.x and 2.6.x kernels

2006-12-27 Thread Arjan van de Ven
> > actually I wanted to write that "HT as implemented on XEONs did not > help a lot for HPC workloads in the past" btw this is exactly the problem I am trying to point out: ".. as implemented in generation XYZ model ABC of processor DEF". that's going to be really fragile and in fact won'

Re: How to detect multi-core and/or HT-enabled CPUs in 2.4.x and 2.6.x kernels

2006-12-27 Thread Arjan van de Ven
> > this is a real interesting question. Ganglia is coming [originally] > from the HPC side of computing. At least in the past HT as implemented > on XEONs did help a lot. Running two CPU+memory-bandwith intensive > processes on the same physical CPU would at best result in a 50/50 > performanc

Re: How to detect multi-core and/or HT-enabled CPUs in 2.4.x and 2.6.x kernels

2006-12-27 Thread Martin Knoblauch
--- Gleb Natapov <[EMAIL PROTECTED]> wrote: > > > If I run two threads that are doing only calculations and very little > or no > IO at all on the same socket will modern HT and dual core be the same > (or close) performance wise? > actually I wanted to write that "HT as implemented on XEONs

Re: How to detect multi-core and/or HT-enabled CPUs in 2.4.x and 2.6.x kernels

2006-12-27 Thread Martin Knoblauch
--- Gleb Natapov <[EMAIL PROTECTED]> wrote: > On Wed, Dec 27, 2006 at 04:13:00PM +0100, Arjan van de Ven wrote: > > The original p4 HT to a large degree suffered from a too small > cache > > that now was shared. SMT in general isn't per se all that different > in > > performance than dual core, a

Re: How to detect multi-core and/or HT-enabled CPUs in 2.4.x and 2.6.x kernels

2006-12-27 Thread Arjan van de Ven
> If I run two threads that are doing only calculations and very little or no > IO at all on the same socket will modern HT and dual core be the same > (or close) performance wise? it depends on how cache/memory bandwidth sensitive your calculation is if your calculation is memory bandwidth s

Re: How to detect multi-core and/or HT-enabled CPUs in 2.4.x and 2.6.x kernels

2006-12-27 Thread Gleb Natapov
On Wed, Dec 27, 2006 at 04:13:00PM +0100, Arjan van de Ven wrote: > The original p4 HT to a large degree suffered from a too small cache > that now was shared. SMT in general isn't per se all that different in > performance than dual core, at least not on a fundamental level, it's > all a matter of

Re: How to detect multi-core and/or HT-enabled CPUs in 2.4.x and 2.6.x kernels

2006-12-27 Thread Arjan van de Ven
> > one piece of information that Ganglia collects for a node is the > "number of CPUs", originally meaning "physical CPUs". Ok I was afraid of that. > With the > introduction of HT and multi-core things are a bit more complex now. We > have decided that HT sibblings do not qualify as "real"

Re: How to detect multi-core and/or HT-enabled CPUs in 2.4.x and 2.6.x kernels

2006-12-27 Thread Martin Knoblauch
--- Arjan van de Ven <[EMAIL PROTECTED]> wrote: > On Wed, 2006-12-27 at 06:16 -0800, Martin Knoblauch wrote: > > Hi, (please CC on replies, thanks) > > > > for the ganglia project (http://ganglia.sourceforge.net/) we are > > trying to find a heuristics to determine the number of physical CPU >

Re: How to detect multi-core and/or HT-enabled CPUs in 2.4.x and 2.6.x kernels

2006-12-27 Thread Jan Engelhardt
On Dec 27 2006 06:16, Martin Knoblauch wrote: > > So far it seems that looking at the "physical id", "core id" and "cpu >cores" of /proc/cpuinfo is the way to go. Possibly, but it does not catch all cases. $grep '"physical id' /erk/kernel/linux-2.6.20-rc2/ -r returns exactly three lines, for

Re: How to detect multi-core and/or HT-enabled CPUs in 2.4.x and 2.6.x kernels

2006-12-27 Thread Arjan van de Ven
On Wed, 2006-12-27 at 06:16 -0800, Martin Knoblauch wrote: > Hi, (please CC on replies, thanks) > > for the ganglia project (http://ganglia.sourceforge.net/) we are > trying to find a heuristics to determine the number of physical CPU > "cores" as opposed to virtual processors added by enabling H