@Bejoy
Adding a little bit here,the ouput of map task writes first to a memory
buffer, and when contents reaches a threshold a background thread will
write the contents to disk.
Niranjan Singh
On Wed, Apr 17, 2013 at 1:06 PM, Ramesh R Nair wrote:
> Hi Bejoy,
>
>Regarding the output of Map p
You are correct, map outputs are stored in LFS not in HDFS.
Regards
Bejoy KS
Sent from remote device, Please excuse typos
-Original Message-
From: Ramesh R Nair
Date: Wed, 17 Apr 2013 13:06:32
To: ;
Subject: Re: Basic Doubt in Hadoop
Hi Bejoy,
Regarding the output of Map phase
Hi Bejoy,
Regarding the output of Map phase, does Hadoop store it in local fs or
in HDFS.
I believe it is in the former. Correct me if I am wrong.
Regards
Ramesh
On Wed, Apr 17, 2013 at 10:30 AM, wrote:
> The data is in HDFS in case of WordCount MR sample.
>
> In hdfs, you have the met
The data is in HDFS in case of WordCount MR sample.
In hdfs, you have the metadata in NameNode and actual data as blocks replicated
across DataNodes.
In case of reducer, If a reducer is running on a particular node then you have
one replica of the blocks in the same node (If there is no space
