Is there any way to use NLineInputFormat with new API in hadoop 0.20?

2011-09-28 Thread Arsen Zahray
Hadoop 0.20(.203) api seem to have only one NLineInputFormat class, and that is: org.apache.hadoop.mapred.lib.NLineInputFormat; Is there any way I can use it together with the new API, or what should I use instead?

Re: Type mismatch in key from map when replacing Mapper with MultithreadMapper

2011-09-28 Thread Arsen Zahray
Ok. That works. Thanks again! On Wed, Sep 28, 2011 at 10:01 AM, Kamesh wrote: > ** > On Wednesday 28 September 2011 12:25 PM, Arsen Zahray wrote: > > Hey! Thank you for replying! > > Please, confirm that I understand you correctly: > 1. Use a class, which extends ma

Re: Type mismatch in key from map when replacing Mapper with MultithreadMapper

2011-09-27 Thread Arsen Zahray
On Wed, Sep 28, 2011 at 9:38 AM, Kamesh wrote: > ** > On Wednesday 28 September 2011 11:33 AM, Arsen Zahray wrote: > > MultithreadMapper extends MultithreadedMapper IntWritable, MyPage> { > > ConcurrentLinkedQueuescrapers= new > ConcurrentLinkedQueue(); > &g

Type mismatch in key from map when replacing Mapper with MultithreadMapper

2011-09-27 Thread Arsen Zahray
I'd like to implement a MultithreadMapper for my MapReduce job. For this I replaced Mapper with MultithreadMapper in a working code. Here's the exeption I'm getting: java.io.IOException: Type mismatch in key from map: expected org.apache.hadoop.io.IntWritable, recieved org.apache.hadoop.io.L