The maximum and minimum amount of memory to be used by the task
trackers can be specified inside the configuration files under conf.
For instance, in order to allocate a maximum of 512 MB, you need to
set:
<property>
<name>mapred.child.java.opts</name>
<value>
-Xmx512M
</value>
</property>
Hope that helps.
Jim
On Mon, Aug 31, 2009 at 9:07 AM, Stas Oskin<stas.os...@gmail.com> wrote:
> Hi.
>
>
> I think what you see is reduce task, because in reduce task, you have three
>> steps:
>> copy , sort, and reudce. The copy and sort steps may cost a lot of
>> memory.
>>
>>
>>
> Nope, I just running the Datanode and copying files to HDFS - no reduce
> tasks are running.
>
> How typically large is a standard Datanode?
>
> Regards.
>
