Re: Making sure I understand HADOOP_CLASSPATH

2011-08-22 Thread John Armstrong
On Mon, 22 Aug 2011 11:01:23 -0700, "W.P. McNeill" wrote: > If it is, what is the proper way to make MyJar.jar available to both the > Job > Client and the Task Trackers? Do you mean the task trackers, or the tasks themselves? What process do you want to be able to run the code in MyJar.jar?

Re: Making sure I understand HADOOP_CLASSPATH

2011-08-22 Thread Harsh J
On Mon, Aug 22, 2011 at 11:31 PM, W.P. McNeill wrote: > What does HADOOP_CLASSPATH set in $HADOOP/conf/hadoop-env.sh do? > > This isn't clear to me from documentation and books, so I did some > experimenting. Here's the conclusion I came to: the paths in > HADOOP_CLASSPATH are added to the class p

RE: Making sure I understand HADOOP_CLASSPATH

2011-08-22 Thread GOEKE, MATTHEW (AG/1000)
If you are asking how to make those classes available at run time you can either use the -libjars command for the distributed cache or you can just shade those classes into your jar using maven. I have had enough issues in the past with classpath being flaky that I prefer the shading method but

Re: Making sure I understand HADOOP_CLASSPATH

2011-08-22 Thread W.P. McNeill
I meant tasks running on the Task Trackers. Harsh J.'s answer is what I needed. This makes sense now. On Mon, Aug 22, 2011 at 11:06 AM, John Armstrong wrote: > On Mon, 22 Aug 2011 11:01:23 -0700, "W.P. McNeill" > wrote: > > If it is, what is the proper way to make MyJar.jar available to both th