s will avoid
> re-tuning of sort buffer sizes and spill threshold values for different
> HDFS
> block sizes. Am I missing something?
>
> Thanks,
> -Shrinivas
>
> On Thu, Apr 14, 2011 at 10:35 AM, 顾荣 wrote:
>
> > Hi Shrinivas,
> > I also used to think about thi
Hi,
You can try hadoop-0.20.2 with Eclipse 3.3,that is recommended.
Regards
Walker Gu.
2011/4/15 Vandana Kanchanapalli
> Hi,
> I am facing this problem with eclipse europa version. I am using
> hadoop-0.21.0. After adding the hadoop-eclipse plugin to the IDE, I started
> to use the map/reduce
Hi Shrinivas,
I also used to think about this.However,the data in buffer are spilled into
HDFS when the can reach the threshold,not copy the entire data int to
HDFS.And also the data in HDFS may not has the same size as they are in
buffer,because
if there is a combiner that works they can be shrin
Hi Mark,
I also met your problem,I found my way finally.
Firstly,your basic idea is right,we need to move these jars in to
HDFS,because files in HDFS are shared by all the node automatically.
So,There seem to be two solutions here.
solution: a)After you export your project as a jar,you add a d
