when it's safe to read map-reduce result?

I have a program that do some map-reduce job and then read the result of the job. I learned that hdfs is not strong consistent. when it's safe to read the result? as long as output/_SUCCESS exist?

Re: when it's safe to read map-reduce result?

_SUCCES implies that the job has succesfully terminated, so this seems like a reasonable criterion. Regards, Dieter 2014-03-28 9:33 GMT+01:00 Li Li fancye...@gmail.com: I have a program that do some map-reduce job and then read the result of the job. I learned that hdfs is not strong

Re: when it's safe to read map-reduce result?

thanks. is the following codes safe? int exitCode=ToolRunner.run() if(exitCode==0){ //safe to read result } On Fri, Mar 28, 2014 at 4:36 PM, Dieter De Witte drdwi...@gmail.com wrote: _SUCCES implies that the job has succesfully terminated, so this seems like a reasonable criterion.

Re: when it's safe to read map-reduce result?

if the job complets without any failures exitCode should be 0 and safe to read the result public class MyApp extends Configured implements Tool { public int run(String[] args) throws Exception { // Configuration processed by ToolRunner Configuration conf = getConf();