Re: Compiling Giraph with Hadoop 2.5.1 YARN

2014-10-28 Thread Nicola Vitucci
Hi Alessandro, I'll try to explain the details, but I know it is a bit complicated and not necessarily easy to reproduce. In my setup I have a master server (4 processors, 16 GB RAM) and 2 slaves (3 processors, 4 GB RAM each) running Hadoop 2.5.1 and ZooKeeper 3.4.6. Thanks to your suggestions I

Re: Compiling Giraph with Hadoop 2.5.1 YARN

2014-10-27 Thread Nicola Vitucci
Hi Alessandro, thanks for the reply. In order to start fresh, before adding the line you suggested I re-cloned the repository and tried to compile from trunk using the same command: mvn package -DskipTests -Dhadoop.version=2.5.1 -Phadoop_yarn clean install I get an error (on the variable

Re: Compiling Giraph with Hadoop 2.5.1 YARN

2014-10-27 Thread Nicola Vitucci
Hi Alessandro, I can confirm that after your addition I'm able to build Giraph for Hadoop 2.4.0, so this works: mvn package -DskipTests -Dhadoop.version=2.4.0 -Phadoop_yarn clean install Do you know whether there are any plans to support Hadoop 2.5.x too? Thank you very much, Nicola Il

Re: Compiling Giraph with Hadoop 2.5.1 YARN

2014-10-27 Thread Alessandro Negro
Hi Nicola, I have just fixed this other issue, but I’m not sure that it will work completely. After I checked the code I notice that the issue is related to the munge symbol STATIC_SASL_SYMBOL. Try removing STATIC_SASL_SYMBOL from the munge symbols list in the hadoop_yarn profile. My profile

Re: Compiling Giraph with Hadoop 2.5.1 YARN

2014-10-27 Thread Nicola Vitucci
Hi Alessandro, I can now complete the compiling process and get the full .jar. I can't get it working right away, but I think it's more an Hadoop problem than a Giraph problem (can't get past superstep -1 in the PageRank example). I'll keep you updated. Thanks again, Nicola Il 27/10/2014

Re: Compiling Giraph with Hadoop 2.5.1 YARN

2014-10-27 Thread Alessandro Negro
Hi Nicola, how are you running the test? Could you help me to test it on yarn? I would like to see the error. Thanks, Alessandro Il giorno 27/ott/2014, alle ore 17:34, Nicola Vitucci nicola.vitu...@gmail.com ha scritto: Hi Alessandro, I can now complete the compiling process and get the

Re: Compiling Giraph with Hadoop 2.5.1 YARN

2014-10-26 Thread Alessandro Negro
Hi Nicola, I was able to fix this issue adding the following line into the munge maven plugin: mungedDirectory${project.build.directory}/munged/mungedDirectory Now it is: plugin groupIdorg.sonatype.plugins/groupId artifactIdmunge-maven-plugin/artifactId

Re: Compiling Giraph with Hadoop 2.5.1 YARN

2014-10-10 Thread میلاد نصر اصفهانی
run it without -X to check debug info and paste here On Oct 10, 2014, at 9:32 PM, Nicola Vitucci nicola.vitu...@gmail.com wrote: So, no one had the same problem? Nicola Il 30/09/2014 17:30, Nicola Vitucci ha scritto: Hi all, I've just tried compiling Giraph (from trunk and

Re: Compiling Giraph with Hadoop 2.5.1 YARN

2014-10-10 Thread میلاد نصر اصفهانی
with -X On Oct 10, 2014, at 9:32 PM, Nicola Vitucci nicola.vitu...@gmail.com wrote: So, no one had the same problem? Nicola Il 30/09/2014 17:30, Nicola Vitucci ha scritto: Hi all, I've just tried compiling Giraph (from trunk and release-1.1) after applying the GIRAPH-947 patch, but I

Re: Compiling Giraph with Hadoop 2.5.1 YARN

2014-10-10 Thread Tripti Singh
What maven version are u using? Sent from my iPhone On 10-Oct-2014, at 11:37 pm, میلاد نصر اصفهانی miladnasresfah...@gmail.com wrote: with -X On Oct 10, 2014, at 9:32 PM, Nicola Vitucci nicola.vitu...@gmail.com wrote: So, no one had the same problem? Nicola Il 30/09/2014 17:30,

Re: Compiling Giraph with Hadoop 2.5.1 YARN

2014-10-10 Thread Nicola Vitucci
Hi, - the debug log is available here: https://dl.dropboxusercontent.com/u/8555005/giraph.log (~7 MB) - the maven version is 3.2.3 (33f8c3e1027c3ddde99d3cdebad2656a31e8fdf4) Thanks, Nicola Il 10/10/2014 20:08, Tripti Singh ha scritto: What maven version are u using? Sent from my iPhone

Re: Compiling Giraph with Hadoop 2.5.1 YARN

2014-10-10 Thread Nicola Vitucci
Hi, I tried it but it keeps failing. The problem is still the same: maven is looking into giraph-core/target/munged/maven-shared-archive-resources, but it does not exist - instead giraph-core/target/munged/munged/maven-shared-archive-resources (with munged nested into another munged) does exist.

Compiling Giraph with Hadoop 2.5.1 YARN

2014-09-30 Thread Nicola Vitucci
Hi all, I've just tried compiling Giraph (from trunk and release-1.1) after applying the GIRAPH-947 patch, but I am still unable to compile it successfully. This is the command I use for compiling: mvn package -DskipTests -Dhadoop.version=2.5.1 -Phadoop_yarn clean install and this is the stack