Re: Performance on singlenode and multinode hadoop

2014-07-31 Thread Sindhu Hosamane
Hello , If i am running my experiment on a server with 2 processors (4 cores each ) . To say it has 2 processors and 8 cores . What would be the ideal values for mapred.tasktracker.map.tasks.maximum and mapred.tasktracker.reduce.tasks.maximum to get maximum performance. Your help is very much

Re: Performance on singlenode and multinode hadoop

2014-07-31 Thread Nitin Pawar
what kind of jobs your tasks will be doing? are they CPU intensive or only memory intensive ? On Thu, Jul 31, 2014 at 6:28 PM, Sindhu Hosamane sindh...@gmail.com wrote: Hello , If i am running my experiment on a server with 2 processors (4 cores each ) . To say it has 2 processors and 8

Re: Performance on singlenode and multinode hadoop

2014-07-31 Thread Sindhu Hosamane
I am not pretty sure about the answer for this. I am running Cascalog queries which runs on files which are in MB . On 31 Jul 2014, at 15:11, Nitin Pawar nitinpawar...@gmail.com wrote: what kind of jobs your tasks will be doing? are they CPU intensive or only memory intensive ? On

Re: Performance on singlenode and multinode hadoop

2014-07-30 Thread Sindhu Hosamane
Thank you Harsh , I have a look on this and get back . On 29 Jul 2014, at 18:56, Harsh J ha...@cloudera.com wrote: It isn't the DataNode that does the compute spawn/work, but the TaskTracker. If you wanted to increase MR parallelism on a single machine, you do not need two DNs, nor two

Re: Performance on singlenode and multinode hadoop

2014-07-29 Thread Harsh J
It isn't the DataNode that does the compute spawn/work, but the TaskTracker. If you wanted to increase MR parallelism on a single machine, you do not need two DNs, nor two TTs, just higher slot capacities in your TT's mapred-site.xml via properties mapred.tasktracker.map.tasks.maximum and

Performance on singlenode and multinode hadoop

2014-07-28 Thread sindhu hosamane
Hello , i set up 2 datanodes on a single machine(ubuntu machine) accordingly mentioned in the thread http://mail-archives.apache.org/mod_mbox/hadoop-common-user/201009.mbox/%3ca3ef3f6af24e204b812d1d24ccc8d71a03688...@mse16be2.mse16.exchange.ms%3E Ubuntu machine has 2 processors and 8 cores.