RE: Right way to implement MR ?

2012-05-24 Thread Shailesh Dargude
: Right way to implement MR ? Hi All, How to compare to input file In M/R Job. let A Log file around 30GB and B Log file size is around 60 GB I wanted to know how i will define K,V inside the mapper. Thanks samir.

Re: Right way to implement MR ?

2012-05-24 Thread samir das mohapatra
Thanks Harsh J for your help. On Thu, May 24, 2012 at 1:24 AM, Harsh J ha...@cloudera.com wrote: Samir, You can use MultipleInputs for multiple forms of inputs per mapper (with their own input K/V types, but common output K/V types) with a common reduce-side join/compare. See

Re: Right way to implement MR ?

2012-05-23 Thread Harsh J
Samir, You can use MultipleInputs for multiple forms of inputs per mapper (with their own input K/V types, but common output K/V types) with a common reduce-side join/compare. See http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/mapreduce/lib/input/MultipleInputs.html. On