Re: Compiling Giraph with Hadoop 2.5.1 & YARN

2014-10-28 Thread Nicola Vitucci
Hi Alessandro, I'll try to explain the details, but I know it is a bit complicated and not necessarily easy to reproduce. In my setup I have a master server (4 processors, 16 GB RAM) and 2 slaves (3 processors, 4 GB RAM each) running Hadoop 2.5.1 and ZooKeeper 3.4.6. Thanks to your suggestions I

Re: Compiling Giraph with Hadoop 2.5.1 & YARN

2014-10-27 Thread Alessandro Negro
Hi Nicola, how are you running the test? Could you help me to test it on yarn? I would like to see the error. Thanks, Alessandro Il giorno 27/ott/2014, alle ore 17:34, Nicola Vitucci ha scritto: > Hi Alessandro, > > I can now complete the compiling process and get the full .jar. I can't > get

Re: Compiling Giraph with Hadoop 2.5.1 & YARN

2014-10-27 Thread Nicola Vitucci
Hi Alessandro, I can now complete the compiling process and get the full .jar. I can't get it working right away, but I think it's more an Hadoop problem than a Giraph problem (can't get past "superstep -1" in the PageRank example). I'll keep you updated. Thanks again, Nicola Il 27/10/2014 17:1

Re: Compiling Giraph with Hadoop 2.5.1 & YARN

2014-10-27 Thread Alessandro Negro
Hi Nicola, I have just fixed this other issue, but I’m not sure that it will work completely. After I checked the code I notice that the issue is related to the munge symbol STATIC_SASL_SYMBOL. Try removing STATIC_SASL_SYMBOL from the munge symbols list in the hadoop_yarn profile. My profile wa

Re: Compiling Giraph with Hadoop 2.5.1 & YARN

2014-10-27 Thread Nicola Vitucci
Hi Alessandro, I can confirm that after your addition I'm able to build Giraph for Hadoop 2.4.0, so this works: mvn package -DskipTests -Dhadoop.version=2.4.0 -Phadoop_yarn clean install Do you know whether there are any plans to support Hadoop 2.5.x too? Thank you very much, Nicola Il 27/10/

Re: Compiling Giraph with Hadoop 2.5.1 & YARN

2014-10-27 Thread Alessandro Negro
Hi Nicola, it’s true I got the same error but also before changing the plugin configuration. I was able to compile only for version 2.4.0. I tested with 2.5.0 as well. I tested everything on the main trunk. Cheers, Alessandro Il giorno 27/ott/2014, alle ore 15:00, Nicola Vitucci ha scritto:

Re: Compiling Giraph with Hadoop 2.5.1 & YARN

2014-10-27 Thread Nicola Vitucci
Hi Alessandro, thanks for the reply. In order to start fresh, before adding the line you suggested I re-cloned the repository and tried to compile from trunk using the same command: mvn package -DskipTests -Dhadoop.version=2.5.1 -Phadoop_yarn clean install I get an error (on the variable SASL_PR

Re: Compiling Giraph with Hadoop 2.5.1 & YARN

2014-10-26 Thread Alessandro Negro
Hi Nicola, I was able to fix this issue adding the following line into the munge maven plugin: ${project.build.directory}/munged Now it is: org.sonatype.plugins munge-maven-plugin 1.0 munge generate-sourc

Re: Compiling Giraph with Hadoop 2.5.1 & YARN

2014-10-10 Thread Nicola Vitucci
Hi, I tried it but it keeps failing. The problem is still the same: maven is looking into "giraph-core/target/munged/maven-shared-archive-resources", but it does not exist - instead "giraph-core/target/munged/munged/maven-shared-archive-resources" (with "munged" nested into another "munged") does

Re: Compiling Giraph with Hadoop 2.5.1 & YARN

2014-10-10 Thread Milad Nasr
try mvm clean before that or remove $HOME/Downloads/giraph/giraph-core/target/munged/ and recompile On Oct 11, 2014, at 1:05 AM, Nicola Vitucci wrote: > Hi, > > - the debug log is available here: > https://dl.dropboxusercontent.com/u/8555005/giraph.log (~7 MB) > - the maven version is 3.2.3

Re: Compiling Giraph with Hadoop 2.5.1 & YARN

2014-10-10 Thread Nicola Vitucci
Hi, - the debug log is available here: https://dl.dropboxusercontent.com/u/8555005/giraph.log (~7 MB) - the maven version is 3.2.3 (33f8c3e1027c3ddde99d3cdebad2656a31e8fdf4) Thanks, Nicola Il 10/10/2014 20:08, Tripti Singh ha scritto: > What maven version are u using? > > > Sent from my iPhon

Re: Compiling Giraph with Hadoop 2.5.1 & YARN

2014-10-10 Thread Tripti Singh
What maven version are u using? Sent from my iPhone > On 10-Oct-2014, at 11:37 pm, "میلاد نصر اصفهانی" > wrote: > > with -X >> On Oct 10, 2014, at 9:32 PM, Nicola Vitucci wrote: >> >> So, no one had the same problem? >> >> Nicola >> >> Il 30/09/2014 17:30, Nicola Vitucci ha scritto: >>>

Re: Compiling Giraph with Hadoop 2.5.1 & YARN

2014-10-10 Thread میلاد نصر اصفهانی
with -X On Oct 10, 2014, at 9:32 PM, Nicola Vitucci wrote: > So, no one had the same problem? > > Nicola > > Il 30/09/2014 17:30, Nicola Vitucci ha scritto: >> Hi all, >> >> I've just tried compiling Giraph (from trunk and release-1.1) after >> applying the GIRAPH-947 patch, but I am still un

Re: Compiling Giraph with Hadoop 2.5.1 & YARN

2014-10-10 Thread میلاد نصر اصفهانی
run it without -X to check debug info and paste here On Oct 10, 2014, at 9:32 PM, Nicola Vitucci wrote: > So, no one had the same problem? > > Nicola > > Il 30/09/2014 17:30, Nicola Vitucci ha scritto: >> Hi all, >> >> I've just tried compiling Giraph (from trunk and release-1.1) after >> app

Re: Compiling Giraph with Hadoop 2.5.1 & YARN

2014-10-10 Thread Nicola Vitucci
So, no one had the same problem? Nicola Il 30/09/2014 17:30, Nicola Vitucci ha scritto: > Hi all, > > I've just tried compiling Giraph (from trunk and release-1.1) after > applying the GIRAPH-947 patch, but I am still unable to compile it > successfully. This is the command I use for compiling:

Compiling Giraph with Hadoop 2.5.1 & YARN

2014-09-30 Thread Nicola Vitucci
Hi all, I've just tried compiling Giraph (from trunk and release-1.1) after applying the GIRAPH-947 patch, but I am still unable to compile it successfully. This is the command I use for compiling: mvn package -DskipTests -Dhadoop.version=2.5.1 -Phadoop_yarn clean install and this is the stack t