Re: Who will Responsible for Handling DFS Write Pipe line Failure

2015-09-07 Thread miriyala srinivas
@Harsh thanks for sharing link. On Tue, Sep 8, 2015 at 6:56 AM, Harsh J wrote: > [image: Boxbe] This message is eligible > for Automatic Cleanup! (ha...@cloudera.com) Add cleanup rule >

Re: Who will Responsible for Handling DFS Write Pipe line Failure

2015-09-07 Thread Harsh J
These 2-part blog posts from Yongjun should help you understand the HDFS file write recovery process better: http://blog.cloudera.com/blog/2015/02/understanding-hdfs-recovery-processes-part-1/ and http://blog.cloudera.com/blog/2015/03/understanding-hdfs-recovery-processes-part-2/ On Mon, Sep 7, 2

Who will Responsible for Handling DFS Write Pipe line Failure

2015-09-06 Thread miriyala srinivas
Hi All, I am just started Learning fundamentals of HDFS and its internal mechanism , concepts used here are very impressive and looks simple but makes me confusing and my question is *who will responsible for handling DFS write failure in pipe line (assume replication factor is 3 and 2nd DN fail