Re: Problems adding JARs to distributed classpath in Hadoop 0.20.2

2011-05-27 Thread Alejandro Abdelnur
John, If you are using Oozie, dropping all the JARs your MR jobs needs in the Oozie WF lib/ directory should suffice. Oozie will make sure all those JARs are in the distributed cache. Alejandro On Thu, May 26, 2011 at 7:45 AM, John Armstrong wrote: > Hi, everybody. > > I'm running into some dif

Re: Hadoop problem

2011-05-27 Thread Laurent Hatier
Of couurse !!! It's logical. Thank you John. 2011/5/27 John Armstrong > On Fri, 27 May 2011 13:52:04 +0200, Laurent Hatier > wrote: > > I'm a newbie with Hadoop/MapReduce. I've a problem with hadoop. I set > some > > variables in the run function but when Map running, he can't get the > value >

Re: How does Map and Reduce class are sent to remote node by hadoop ??

2011-05-27 Thread Francesco De Luca
Thank you Robert, infact i didn't specify any job.jar so i think that hadoop have some mechanism to guess the jar 2011/5/27 Robert Evans > Francesco, > > The mapreduce client will create a jar called job.jar and place it in HDFS > in a staging directory. This is the jar that you specified to

Re: How does Map and Reduce class are sent to remote node by hadoop ??

2011-05-27 Thread Robert Evans
Francesco, The mapreduce client will create a jar called job.jar and place it in HDFS in a staging directory. This is the jar that you specified to your job conf, or I believe that it tries to guess the jar based off of the Mapper class and the Reducer class but I am not sure of that. Once th

How does Map and Reduce class are sent to remote node by hadoop ??

2011-05-27 Thread Francesco De Luca
Anyone knows the mechanism that hadoop use to load Map and Reduce class on the remote node where the JobTracker submit the tasks? In particular, how can hadoop retrieves the .class files ? Thanks

Re: Hadoop problem

2011-05-27 Thread John Armstrong
On Fri, 27 May 2011 13:52:04 +0200, Laurent Hatier wrote: > I'm a newbie with Hadoop/MapReduce. I've a problem with hadoop. I set some > variables in the run function but when Map running, he can't get the value > of theses variables... > If anyone knows the solution :) By the "run function" do y

Hadoop problem

2011-05-27 Thread Laurent Hatier
Hi, I'm a newbie with Hadoop/MapReduce. I've a problem with hadoop. I set some variables in the run function but when Map running, he can't get the value of theses variables... If anyone knows the solution :) -- Laurent HATIER Étudiant en 2e année du Cycle Ingénieur à l'EISTI