Unless some transformation can additionally be applied in the Mapper
phases for your text input, this operation could be done without
MapReduce itself; since your requirement of a single file output will
incur unnecessary intermediate-phase costs.
On Sat, Feb 26, 2011 at 7:22 AM, Mapred Learn wro
Hi guys,
If I have a text file of 10 GB and I want to convert it to sequence file
using map-reduce and make filesplits of 1 GB each so that 10 mappers work in
parallel on it and convert it to Sequence file output.
Can I combine these 10 mapper outputs into 1 sequence file of 10 GB size in
reduce st
Hello all,
I have few mapreduce jobs that I am calling from a java driver. The problem I
am facing is that when there is an exception in mapred job, the exception is
not propogated to the client so even if first job failed, its going to second
job and so on. Is there an another way of catching e
