ward.
>
> thanks
>
I had a similar problem and solved it by writing a custom InputFormat (see
attachment). You should improve the methods ACrossBInputSplit.getLength ,
ACrossBRecordReader.getPos and ACrossBRecordReader.getProgress.
--
View this message in context:
http://old.nabble.co
gt; each record from single input file and reduces into an output forward.
> >
> > thanks
> >
>
>
> I had a similar problem and solved it by writing a custom InputFormat (see
> attachment). You should improve the methods ACrossBInputSplit.getLength ,
> ACrossBReco
, you match it with the
lines in hash table and join them. This is actually map side join, which only
needs map phase.
-Gang
- 原始邮件
发件人: Ed Kohlwey
收件人: common-user@hadoop.apache.org
发送日期: 2009/12/8 (周二) 10:14:51 上午
主 题: Re: multiple file input
One important thing to note is that