able to tackle with the situation.(Pardon my
> ignorance)
>
> May thanks.
>
> Regards,
> Mohammad Tariq
>
>
> On Tue, Jul 10, 2012 at 8:34 PM, Harsh J wrote:
>> I don't see why you'd have to use the WholeFileInputFormat for such a
>> task. Your task is ve
ot able to tackle with the situation.(Pardon my
ignorance)
May thanks.
Regards,
Mohammad Tariq
On Tue, Jul 10, 2012 at 8:34 PM, Harsh J wrote:
> I don't see why you'd have to use the WholeFileInputFormat for such a
> task. Your task is very similar to joins, and you can
I don't see why you'd have to use the WholeFileInputFormat for such a
task. Your task is very similar to joins, and you can see the section
"General reducer-side join" for what your overall logic should look
like, under Ricky's
http://horicky.blogspot.in/2010/08/desi
hat could be the approximate maximum size of the files that
>> can be handled using WholeFileInputFormat format??I mean, if the file
>> is very big, then is it feasible to use WholeFileInputFormat as the
>> entire load will go to one mapper??Many thanks.
>>
>> Regards,
>> Mohammad Tariq
>
>
>
> --
> Harsh J
, Mohammad Tariq wrote:
> Hello list,
>
>What could be the approximate maximum size of the files that
> can be handled using WholeFileInputFormat format??I mean, if the file
> is very big, then is it feasible to use WholeFileInputFormat as the
> entire load will go to one m
Hello list,
What could be the approximate maximum size of the files that
can be handled using WholeFileInputFormat format??I mean, if the file
is very big, then is it feasible to use WholeFileInputFormat as the
entire load will go to one mapper??Many thanks.
Regards,
Mohammad Tariq
Hi,
On Fri, Feb 25, 2011 at 4:31 AM, Mohamed Riadh Trad
wrote:
> Dear All,
> Has anyone wrote the WholeFileInputFormat with the hadoop 0.20.2 api?
1. Create new class extending FileInputFormat (or its other derivatives)
2. Override isSplitable to return false.
3. Provide a record
Dear All,
Has anyone wrote the WholeFileInputFormat with the hadoop 0.20.2 api?
Best Regards,
Trad Mohamed Riadh, M.Sc, Ing.
PhD. student
INRIA-TELECOM PARISTECH
Office: 11-15
Phone: (33)-1 39 63 59 33
Fax: (33)-1 39 63 56 74
Email: riadh.t...@inria.fr
Home page: http://www-rocq.inria.fr/who
