Re: overeager reduce tasks

2009-11-24 Thread z3r0c001
I'm using hadoop 0.19.2, and this parameter is not part of config, is there a workaround I can use? thanks, On Tue, Nov 24, 2009 at 1:32 PM, Allen Wittenauer wrote: > On 11/24/09 12:55 PM, "z3r0c001" wrote: > > this is a strange problem so please bear with me, I subm

overeager reduce tasks

2009-11-24 Thread z3r0c001
Hi, this is a strange problem so please bear with me, I submitted about 290 jobs on my queue on a 6 machine cluster (15 map slots, 15 reduce slots) , and everything was fine and dandy for first 15 hours, I noticed that some jobs started reduce tasks even before single map had been executed, so ou

Re: build / install hadoop plugin question

2009-11-20 Thread z3r0c001
You need "ant" to build. There are plethora of tutorials for installing and setting up ant out there like http://ant.apache.org/manual/install.htm http://ant.apache.org/manual/install.htm Once you have it setup, go to extracted dir for hadoop using command prompt/shell and run "ant eclipse"

help with Hadoop custom Writable types implementation

2009-10-15 Thread z3r0c001
I'm trying to implement Writable interface. but not sure how to serialize/write/read data from nested objects in public class StorageClass implements Writable{ public String xStr; public String yStr; public List sStor //omitted ctors @override public void write(DataOutput out) throws IOExcept

Fwd: help with Hadoop custom Writable types implementation

2009-10-14 Thread z3r0c001
I'm trying to implement Writable interface. but not sure how to serialize/write/read data from nested objects in public class StorageClass implements Writable{ public String xStr; public String yStr; public List sStor //omitted ctors @override public void write(DataOutput out) throws IOExcept