Re: DistributedCache Question

2012-04-09 Thread Nick Collier
Thanks. This: > > FileSystem fs = FileSystem.get(conf); > DistributedCache.addFileToClassPath(new > Path("hdfs://localhost:9000/my.app/batch.jar"), conf, fs); didn't work, but the uber-jar /lib subfolder did work. thanks again, Nick On Apr 9, 2012, at 2:44 PM, Harsh J wrote: > Nick, > > F

Re: DistributedCache Question

2012-04-09 Thread Harsh J
Nick, For jars, you need to use DistributedCache.addFileToClassPath(…). The archive-adding function is only to be used when you want the file you're adding to also be extracted into the task's working directory. Also, you don't need to use DistributedFileSystem classes (its not supposed to be pub

DistributedCache Question

2012-04-09 Thread Nick Collier
Hi, Using Hadoop 1.0.1 I'm trying to use the DistributedCache to add additional jars to the classpath used by my Mappers but I can't get it to work. In the run(String[] args) method of my Tool implementation, I've tried: FileSystem fs = DistributedFileSystem.get(conf); DistributedCache.addArchi