Subir, On Sat, Jul 14, 2012 at 5:30 PM, Subir S <subir.sasiku...@gmail.com> wrote: > Harsh, Thanks I think this is what I was looking for. I have 3 related > questions. > > 1.) Will this work in 0.20.2-cdh3u3
Yes, will work. (Btw, best to ask CDH-specific questions on the cdh-u...@cloudera.org lists) > 2.) What is the hard limit that you mean? If a reducer gets more data than this value, due to the map's outputs growing large (for any partition), the job will begin to fail. > 3.)Can this be applied for streaming? Yes, streaming is still MR and this property is for MR (applied during scheduling, so not streaming/java specific). -- Harsh J