Documentation inconsistency about append write in HDFS

2015-08-02 Thread Thanh Hong Dai
In the latest version of the documentation (http://hadoop.apache.org/docs/current2/hadoop-project-dist/hadoop-hdfs/Hdfs Design.html#Simple_Coherency_Model and also documentation for version 2.x), it's mentioned that A file once created, written, and closed need not be changed. and There is a plan

Re: Able to connect to the same app master

2015-08-02 Thread twinkle sachdeva
Hi, Thanks Mirko. It is doing more than just monitoring the progress. It is giving some more commands from the user which affects the next execution of the code. Regards, Twinkle On Sat, Aug 1, 2015 at 9:30 PM, mirko.kaempf mirko.kae...@gmail.com wrote: Hey, your APPMaster could listen

mapreduce speculative execution

2015-08-02 Thread Shushant Arora
Does Mapper's cleanup or close method gets called for map tasks which get killed due to speculative execution ? And when does a task is considered completed for killing duplicate task which was started because of speculative execution- after cleanup or close of faster is executed or before that