Re: passing dependencies to my Mapper

2009-09-15 Thread Varene Olivier
Just my two cents, but, if your ressources can be intantiated at configuration time, you can use the "configure" method from MapperReduceBase Object to assign your local static objects with the values taken from the job configuration object public class Normalize_Reduce extends MapReduceBase

Reading Files

2009-09-15 Thread Geoffry Roberts
All, I have an issue wrt common file access from within a map reduce job. I have tried to do this two ways and wind up with either a FileNotFoundException or a EOFException. 1. I copy the file into the hadoop hdfs using the -copyFromLocal utility. I then attempt the following: JobConf conf = n

JVM reuse

2009-09-15 Thread Amogh Vasekar
Hi All, Regarding the JVM reuse feature incorporated, it says reuse is generally recommended for streaming and pipes jobs. I'm a little unclear on this and any pointers will be appreciated. Also, in what scenarios will this feature be helpful for java mapred jobs? Thanks, Amogh