Re: How to call Hadoop job from a web service in a non-blocking fashion?

2015-04-27 Thread Chris Nauroth
Hello Marko, Job#waitForCompletion is implemented as a polling loop around Job#isComplete and Job#isSuccessful. Both of those calls are non-blocking. http://hadoop.apache.org/docs/r2.7.0/api/org/apache/hadoop/mapreduce/Job.ht ml#isComplete() http://hadoop.apache.org/docs/r2.7.0/api/org/apache/

How to call Hadoop job from a web service in a non-blocking fashion?

2015-04-27 Thread Marko Dinic
Hello, I have a sequence of jobs that depend on each other, output of one job is input for the next one. Also, there is a loop in one part of the sequence, containing two jobs executing in a row. Until now I was able to run this job by simply creating Job objects and using waitForCompletitio