mr1 and mr2

2014-05-10 Thread Tony Dean
Hi, I am trying to write a Java application that works with either MR1 and MR2. At the present I have MR2 (YARN) implementation deployed and running. I am using mapred API. I believe that I read mapred and mapreduce APIs are compatible so either should work. The only thing that is

Rack awareness and pipeline write

2014-05-10 Thread jianan hu
Hi everyone, See HDFS documents, It says For the common case, when the replication factor is three, HDFS’s placement policy is to put one replica on one node in the local rack, another on a node in a different (remote) rack, and the last on a different node in the same remote rack. Assume there