new mapreduce API and NLineInputFormat

2010-11-09 Thread Henning Blohm
I am using the new mapreduce.* API in my jobs on hadoop 0.20.2. - I actually have some utilities around job scheduling and such. Now I would like to use NLineInputFormat to parallelize some data import task into a number of mappers. However in 0.20.2 you cannot call job.setInputFormatClass(NLin

Re: new mapreduce API and NLineInputFormat

2010-11-09 Thread Harsh J
Hi, On Tue, Nov 9, 2010 at 8:42 PM, Henning Blohm wrote: > > However in 0.20.2 you cannot call > > job.setInputFormatClass(NLineInputFormat.class); > > as NLineInputFormat does not extend the "right" InputFormat interface > (in > contrast to the 0.21 version). > 0.20.2 does not have it. You can

Re: new mapreduce API and NLineInputFormat

2010-11-09 Thread Henning Blohm
Right, that's what I will do. Thanks, Henning On Wed, 2010-11-10 at 10:36 +0530, Harsh J wrote: > Hi, > > On Tue, Nov 9, 2010 at 8:42 PM, Henning Blohm > wrote: > > > > However in 0.20.2 you cannot call > > > > job.setInputFormatClass(NLineInputFormat.class); > > > > as NLineInputFormat does

Re: new mapreduce API and NLineInputFormat

2011-01-14 Thread Attila Csordas
Hi, what other jars should be added to the build path from 0.21.0 besides hadoop-common-0.21.0.jar in order to make 0.21.0 NLineInputFormat work in 0.20.2 as suggested below? Generally can somebody provide me a working example code? Thanks, Attila On Wed, Nov 10, 2010 at 5:06 AM, Harsh J wrot

Re: new mapreduce API and NLineInputFormat

2011-01-14 Thread Edward Capriolo
On Fri, Jan 14, 2011 at 5:05 PM, Attila Csordas wrote: > Hi, > > what other jars should be added to the build path from 0.21.0 > besides hadoop-common-0.21.0.jar in order to make 0.21.0 NLineInputFormat > work in 0.20.2 as suggested below? > > Generally can somebody provide me a working example co