Just to clarify, When i say equivalent in streaming, i am looking for some way of achieving this in streaming.
On Tue, Jun 2, 2009 at 9:30 AM, amit handa <[email protected]> wrote: > Hi, > > I want to do some initial one time set up before each of my map task > starts. Is there some method which is similar to > org.apache.hadoop.mapreduce.Mapper -setup method, in hadoop pipes or > streaming ? > > Another newbie question - Does hadoop keep the map tasks alive for a given > job e.g if i set max map tasks to 4 and if i call setup method , can i > assume that it won't be called more than 4 times (once for each map task)? > I am assuming the task runs normally (no task hangs or crashes) > > Thanks, > Amit > >
