Re: How to rebuild Hadoop ??

2010-09-08 Thread Matthew John
Thanks Jeff ! Following what you have said, I build my hadoop core jar first (command - ant jar). That created a hadoop-core.jar in the build. Now can you please tell me how to use this as dependable for the building of examples.jar. Because if I give ant example , it gives errors like the new

Re: How to rebuild Hadoop ??

2010-09-08 Thread Jeff Zhang
Mattew, Do you still put your source code in the io package and mapred package ? If so, rebuild and hadoop core (seems you have done), and then invoke the command bin/hadoop -jar hadoop-0.20.2-example.jar sort -libjars hadoop-core-0.20.2.jar(your new builded jar) other_arguments PS: I do not

Re: How to rebuild Hadoop ??

2010-09-08 Thread Matthew John
Hey Jeff , I gave the command : bin/hadoop jar hadoop-0.20.2-examples.jar sort -libjars ./build/hadoop-0.20.3-dev-core.jar -inFormat org.apache.hadoop.mapred.MetafileInputFormat -outFormat org.apache.hadoop.mapred.MetafileOutputFormat -outKey org.apache.hadoop.io.FpMetaId -outValue

Re: How to rebuild Hadoop ??

2010-09-08 Thread Jeff Zhang
Matthew, InputFormat will been used in client side, so you should combine the hadoop-0.20.2.jar and hadoop-example.jar into one single jar On Wed, Sep 8, 2010 at 2:58 AM, Matthew John tmatthewjohn1...@gmail.com wrote: Hey Jeff , I gave the command :  bin/hadoop jar

Re: How to rebuild Hadoop ??

2010-09-08 Thread Amareshwari Sri Ramadasu
If the jar passed in -libjars is in local filesystem, it is added to client classpath also. On 9/8/10 3:57 PM, Jeff Zhang zjf...@gmail.com wrote: Matthew, InputFormat will been used in client side, so you should combine the hadoop-0.20.2.jar and hadoop-example.jar into one single jar On

Re: How to rebuild Hadoop ??

2010-09-08 Thread Matthew John
target name=examples depends=jar, compile-examples description=Make the Hadoop examples jar. jar jarfile=${build.dir}/${final.name}-examples.jar basedir=${build.examples} manifest attribute name=Main-Class

Re: How to rebuild Hadoop ??

2010-09-08 Thread Matthew John
Hey Guys ! , Finally my examples.jar got built :) :) .. It was just a small error - dint initialize the package for some of the newly written files :P .. Now i will run the command : bin/hadoop jar hadoop-0.20.2-examples.jarnew one sort -inFormat org.apache.hadoop.mapred.MetafileInputFormat

How to rebuild Hadoop ??

2010-09-07 Thread Matthew John
Hi all, I wrote some new writable files corresponding to my data input. I added them to /src/org//io/ where all the writables reside. Similarly, I also wrote input/output format files and a recordreader and added them to src/mapred/./mapred/ where all related files reside. I want

Re: How to rebuild Hadoop ??

2010-09-07 Thread Jeff Zhang
Matthew, You should put your code in the example source folder, and rebuild the example. And use the new generated hadoop*version*example.jar in the build folder. PS: each mapred job needs a jar which contains the classes this job needs On Tue, Sep 7, 2010 at 8:14 PM, Matthew John

Re: How to rebuild Hadoop ??

2010-09-07 Thread Matthew John
Thanks a lot Jeff ! The problem is that everytime I build (using ant ) there is a build folder created. But there is no examples.jar created inside that. I wanted to add some files into io package and mapred package. So I suppose I should put the files appropriately ( inside io and mapred folder

Re: How to rebuild Hadoop ??

2010-09-07 Thread Jeff Zhang
Do you run ant example ? On Tue, Sep 7, 2010 at 10:29 PM, Matthew John tmatthewjohn1...@gmail.com wrote: Thanks a lot Jeff ! The problem is that everytime I build (using ant ) there is a build folder created. But there is no examples.jar created inside that. I wanted to add some files into