Re: Building and Deploying MRv2

2011-06-18 Thread Praveen Sripati
Thanks to the group. Finally, I got the build and deploying going with the following exception during the common build [exec] validate-sitemap: [exec] /home/praveensripati/Installations/apache-forrest-0.8/main/webapp/resources/schema/relaxng/sitemap-v06.rng:72:31: error: datatype l

Re: Building and Deploying MRv2

2011-06-18 Thread Praveen Sripati
Hi, I have got the code from the svn into into /home/praveensripati/Hadoop/ directory and untar'd the hadoop-mapreduce-1.0-SNAPSHOT-all.tar.gz file in the /home/praveensripati/Hadoop folder. The INSTALL document says to export the following variables. What should the HADOOP_CONF_DIR variable

Re: Building and Deploying MRv2

2011-06-17 Thread Praveen Sripati
Hi, Finally, got all the jars built. Now is the time to run the MRv2. It would be nice if the below documentation gets updated http://svn.apache.org/repos/asf/hadoop/common/branches/MR-279/mapreduce/INSTALL -- yarn build Ubuntu had an older version of the protoc binary, I did put th

Re: Building and Deploying MRv2

2011-06-17 Thread Siddharth Seth
Ubuntu seems to install the protocol buffer library (protobuf-compiler) as part of the standard install. Can you run 'protoc --version' to figure out which version is being used. If you've installed it separately - you could play around with the path, remove the package installed by Ubuntu, etc to

Re: Building and Deploying MRv2

2011-06-17 Thread Luke Lu
MR-279 actually works fine with maven 3.0.3 (sans a few (IMO bogus) warnings). You can leave out the "tar" target (which depends on the "docs" target, which requires forrest 0.8) to unblock the progress, as mvn-install would suffice for common and hdfs builds. On Thu, Jun 16, 2011 at 7:55 PM, Prav

Re: Building and Deploying MRv2

2011-06-16 Thread Praveen Sripati
Tom, I downgraded maven and also changed from open-jdk to sun-jdk and there is not any progress. I am using Ubuntu 11.04 and could not find sun-java5-jdk in the Ubuntu repositories, so I installed sun-java6-jdk. praveensripati@praveensripati:~$ java -version java version "1.6.0_24" Java(TM) S

Re: Building and Deploying MRv2

2011-06-16 Thread Robert Evans
Forrest requires java5 unless you are using the beta of forrest, what has been in beta for a few years, which can run on java6 --Bobby On 6/16/11 3:34 PM, "Thomas Graves" wrote: I know at one time maven 3.x didn't work so I've been using maven 2.x. Well I've never tried using java6 for java

Re: Building and Deploying MRv2

2011-06-16 Thread Thomas Graves
I know at one time maven 3.x didn't work so I've been using maven 2.x. Well I've never tried using java6 for java5 home but I would think it wouldn't work. I thought it was forrest that required java5. I would suggest using java5. Tom On 6/16/11 12:24 PM, "Praveen Sripati" wrote: > > Tom,

Re: Building and Deploying MRv2

2011-06-16 Thread Praveen Sripati
Tom, >> Note, it looks like your java5.home is pointing to java6? I have java6 on my laptop and pointed java5.home variable to java6. The hadoop doc says "Java 1.6.x - preferable from Sun". Is this the problem? >> What version of protobufs are you using? I have protobuf 2.4.1. >> What about

Re: Building and Deploying MRv2

2011-06-16 Thread Thomas Graves
Note, it looks like your java5.home is pointing to java6? I've never seen this particular error. The java_generate_equals_and_hash option seems to have been added in protobuf2.4.0. What version of protobufs are you using? The instructions say to use atleast 2.4.0a, I'm using 2.4.1 right now. You

Re: Building and Deploying MRv2

2011-06-16 Thread Praveen Sripati
Hi, The hdfs build was successful after including the -Dforrest.home property to the ant command. *** When I started the mapreduce build to get the below error. mvn clean install assembly:assembly Downloaded: http://repo1.maven.org/maven2/org/apache/commons/commons-exec/1.0.1/com

Re: Building and Deploying MRv2

2011-06-15 Thread Luke Lu
On Wed, Jun 15, 2011 at 6:45 PM, Praveen Sripati wrote: > Do I need the avro-maven-plugin? When I ran the below command got the > error that the pom file was not found. Where do I get the jar and the > pom files for the avro-maven-plugin? I was able to get the source code > for them, but not the b

Re: Building and Deploying MRv2

2011-06-15 Thread Praveen Sripati
Thomas, Thanks for the response. I completed the following steps. - got the code from MR-279 branch. - installed ant/maven. - Got the protobuf code, compiled and installed it. Do I need the avro-maven-plugin? When I ran the below command got the error that the pom file was not found. Where do I

Re: Building and Deploying MRv2

2011-06-15 Thread Praveen Sripati
Thomas, Thanks for the response. I completed the following steps. - got the code from MR-279 branch. - installed ant/maven. - Got the protobuf code, compiled and installed it. Do I need the avro-maven-plugin? When I ran the below command got the error that the pom file was not found. Where d

Re: Building and Deploying MRv2

2011-06-15 Thread Mahadev Konar
I just checked in Tom's patch for updated INSTALL instructions. Hope that helps. thanks mahadev On Wed, Jun 15, 2011 at 7:49 AM, Thomas Graves wrote: > > > On 6/15/11 8:54 AM, "Praveen Sripati" wrote: > >> Hi, >> >> I am trying to build and deploy MRv2 and following the instructions in the >> I

Re: Building and Deploying MRv2

2011-06-15 Thread Thomas Graves
On 6/15/11 8:54 AM, "Praveen Sripati" wrote: > Hi, > > I am trying to build and deploy MRv2 and following the instructions in the > INSTALL file. The instructions have to be modified after the recent > re-organisation (HADOOP-7106) > > http://svn.apache.org/repos/asf/hadoop/common/branches/M

Building and Deploying MRv2

2011-06-15 Thread Praveen Sripati
Hi, I am trying to build and deploy MRv2 and following the instructions in the INSTALL file. The instructions have to be modified after the recent re-organisation (HADOOP-7106) http://svn.apache.org/repos/asf/hadoop/common/branches/MR-279/mapreduce/INSTALL 1. Is the code under MR-279 branch not