Re: Sequence of Streaming Jobs

2009-05-04 Thread Sharad Agarwal
see http://hadoop.apache.org/core/docs/current/api/org/apache/hadoop/mapred/jobcontrol/JobControl.html - Sharad Dan Milstein wrote: If I've got a sequence of streaming jobs, each of which depends on the output of the previous one, is there a good way to launch that sequence? Meaning, I

Re: Sequence of Streaming Jobs

2009-05-02 Thread Billy Pearson
I done this with and array of commands for the jobs in a php script checking the return of the job to tell if it failed or not. Billy Dan Milstein dmilst...@hubteam.com wrote in message news:58d66a11-b59c-49f8-b72f-7507482c3...@hubteam.com... If I've got a sequence of streaming jobs, each

Re: Sequence of Streaming Jobs

2009-05-02 Thread Mayuran Yogarajah
that ? thanks Dan Milstein dmilst...@hubteam.com wrote in message news:58d66a11-b59c-49f8-b72f-7507482c3...@hubteam.com... If I've got a sequence of streaming jobs, each of which depends on the output of the previous one, is there a good way to launch that sequence? Meaning, I want step B to only start

Re: Sequence of Streaming Jobs

2009-05-02 Thread jason hadoop
this for a sequence of streaming jobs? Thanks, -Dan Milstein -- Alpha Chapters of my book on Hadoop are available http://www.apress.com/book/view/9781430219422

Re: Sequence of Streaming Jobs

2009-05-02 Thread Billy Pearson
:58d66a11-b59c-49f8-b72f-7507482c3...@hubteam.com... If I've got a sequence of streaming jobs, each of which depends on the output of the previous one, is there a good way to launch that sequence? Meaning, I want step B to only start once step A has finished. From within Java JobClient code, I can do

Sequence of Streaming Jobs

2009-05-01 Thread Dan Milstein
If I've got a sequence of streaming jobs, each of which depends on the output of the previous one, is there a good way to launch that sequence? Meaning, I want step B to only start once step A has finished. From within Java JobClient code, I can do submitJob/runJob, but is there any