: Right way to implement MR ?
Hi All,
How to compare to input file In M/R Job.
let A Log file around 30GB
and B Log file size is around 60 GB
I wanted to know how i will define K,V inside the mapper.
Thanks
samir.
Thanks
Harsh J for your help.
On Thu, May 24, 2012 at 1:24 AM, Harsh J ha...@cloudera.com wrote:
Samir,
You can use MultipleInputs for multiple forms of inputs per mapper
(with their own input K/V types, but common output K/V types) with a
common reduce-side join/compare.
See
Samir,
You can use MultipleInputs for multiple forms of inputs per mapper
(with their own input K/V types, but common output K/V types) with a
common reduce-side join/compare.
See
http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/mapreduce/lib/input/MultipleInputs.html.
On