Re: dual core configuration

false alarm guys, thanks for the replies, I do have 2 set as the task maximum, and it is utilizing 2 cores according to top. I must have caught it in between tasks or during the reduce, since i had only 1 reducer per node going on at the time. hadoop-default.xml: mapred.tasktracker.map.tasks

Re: dual core configuration

Elia, perhaps you can try changing "mapred.tasktracker.map.tasks.maximum" and "mapred.tasktracker.reduce.tasks.maximum" to "4" in hadoop-site.xml in hopes of getting better utilization. It's strange to me that having these both set to 2 only utilizes a single core, because I would imagine that any

Re: dual core configuration

First of all, "mapred.tasktracker.map.tasks.maximum" and "mapred.tasktracker.reduce.tasks.maximum" are both set to 2 in hadoop-default.xml file; this file is read before hadoop-site.xml file so any properties that aren't set in hadoop-site.xml will follow the values set in hadoop-default.xml. As fo

Re: dual core configuration

Taeho, I was going to suggest this change as well, but it's documented that "mapred.tasktracker.map.tasks.maximum" defaults to 2. Can you explain why Elia is only having one core utilized when this config option is set to 2? Here is the documentation I'm referring to:

Re: dual core configuration

You can have your node (tasktracker) running more than 1 task simultaneously. You may set "mapred.tasktracker.map.tasks.maximum" and "mapred.tasktracker.reduce.tasks.maximum" properties found in hadoop-site.xml file. You should change hadoop-site.xml file on all your slave nodes depending on how ma

dual core configuration

hello, I have some dual core nodes, and I've noticed hadoop is only running 1 instance, and so is only using 1 on the CPU's on each node. is there a configuration to tell it to run more than once? or do i need to turn each machine into 2 nodes? Thanks.