Re: Compiling Giraph with Hadoop 2.5.1 & YARN

2014-10-10 Thread Nicola Vitucci
Hi, I tried it but it keeps failing. The problem is still the same: maven is looking into "giraph-core/target/munged/maven-shared-archive-resources", but it does not exist - instead "giraph-core/target/munged/munged/maven-shared-archive-resources" (with "munged" nested into another "munged") does

Re: Compiling Giraph with Hadoop 2.5.1 & YARN

2014-10-10 Thread Milad Nasr
try mvm clean before that or remove $HOME/Downloads/giraph/giraph-core/target/munged/ and recompile On Oct 11, 2014, at 1:05 AM, Nicola Vitucci wrote: > Hi, > > - the debug log is available here: > https://dl.dropboxusercontent.com/u/8555005/giraph.log (~7 MB) > - the maven version is 3.2.3

Re: Compiling Giraph with Hadoop 2.5.1 & YARN

2014-10-10 Thread Nicola Vitucci
Hi, - the debug log is available here: https://dl.dropboxusercontent.com/u/8555005/giraph.log (~7 MB) - the maven version is 3.2.3 (33f8c3e1027c3ddde99d3cdebad2656a31e8fdf4) Thanks, Nicola Il 10/10/2014 20:08, Tripti Singh ha scritto: > What maven version are u using? > > > Sent from my iPhon

Re: giraph.metrics.enable

2014-10-10 Thread Young Han
The stderr should be in the same directory as the rest of the Hadoop userlogs (e.g., syslog). If your Hadoop files are in "~/hadoop_data/hadoop_local-username/", then the metrics are outputted to "~/hadoop_data/hadoop_local-username/userlogs/job_mmddhhmm_/*/stderr" by default. Also, if you'

Re: giraph.metrics.enable

2014-10-10 Thread xuhong zhang
I can not see the output from my command line, does stderr here really mean the terminal output? sorry, i really don't know where to locate the output? thanks On Fri, Oct 10, 2014 at 2:16 PM, Young Han wrote: > Use them as -Dgiraph.metrics.enable=true, after GiraphRunner but before > you speci

Re: Zookeeper Problems when running Giraph (PageRankVertex) on large graphs.

2014-10-10 Thread Fontana, Peter C.
I figured out my error. I either did not allocate enough memory or I did not tune the garbage collector. Adding the configuration parameter to the Giraph command -Dmapred.child.java.opts="-Xmx64g -XX:ParallelGCThreads=4 -XX:+UseConcMarkSweepGC -XX:MaxGCPauseMillis=100 -XX:-UseGCOverheadLimit”

Re: giraph.metrics.enable

2014-10-10 Thread xuhong zhang
Thank you Matthew, it worked, but where can i find the stderr files. Xuhong On Fri, Oct 10, 2014 at 2:10 PM, Matthew Saltz wrote: > Use the -ca flag, for each one. Metrics.enable puts metrics from the run > in the stderr file of each worker by default. I've never used the command > to change th

Re: giraph.metrics.enable

2014-10-10 Thread Young Han
Use them as -Dgiraph.metrics.enable=true, after GiraphRunner but before you specify the algorithm of interest. In other words, hadoop jar org.apache.giraph.GiraphRunner \ -Dgiraph.metrics.enable=true \ -Dgiraph.metrics.directory=dir \ org.apache.giraph.examples.SomeAlgorithm \ -ca

Re: YARN vs. MR1: is YARN a good idea?

2014-10-10 Thread Tripti Singh
Hi Matthew, I would have been thrilled to give you numbers on this one but for me the Application is not scaling without the out-of-core option( which isn't working the way it was in previous version) I'm still figuring it out and can get back once it's resolved. I have patched a few things and

Re: giraph.metrics.enable

2014-10-10 Thread Matthew Saltz
Use the -ca flag, for each one. Metrics.enable puts metrics from the run in the stderr file of each worker by default. I've never used the command to change the directory. If that's not what you're looking for let me know, I'll be glad to help. Best, Matthew El 10/10/2014 19:55, "xuhong zhang" es

Re: Compiling Giraph with Hadoop 2.5.1 & YARN

2014-10-10 Thread Tripti Singh
What maven version are u using? Sent from my iPhone > On 10-Oct-2014, at 11:37 pm, "میلاد نصر اصفهانی" > wrote: > > with -X >> On Oct 10, 2014, at 9:32 PM, Nicola Vitucci wrote: >> >> So, no one had the same problem? >> >> Nicola >> >> Il 30/09/2014 17:30, Nicola Vitucci ha scritto: >>>

Re: Compiling Giraph with Hadoop 2.5.1 & YARN

2014-10-10 Thread میلاد نصر اصفهانی
with -X On Oct 10, 2014, at 9:32 PM, Nicola Vitucci wrote: > So, no one had the same problem? > > Nicola > > Il 30/09/2014 17:30, Nicola Vitucci ha scritto: >> Hi all, >> >> I've just tried compiling Giraph (from trunk and release-1.1) after >> applying the GIRAPH-947 patch, but I am still un

Re: Compiling Giraph with Hadoop 2.5.1 & YARN

2014-10-10 Thread میلاد نصر اصفهانی
run it without -X to check debug info and paste here On Oct 10, 2014, at 9:32 PM, Nicola Vitucci wrote: > So, no one had the same problem? > > Nicola > > Il 30/09/2014 17:30, Nicola Vitucci ha scritto: >> Hi all, >> >> I've just tried compiling Giraph (from trunk and release-1.1) after >> app

Re: Compiling Giraph with Hadoop 2.5.1 & YARN

2014-10-10 Thread Nicola Vitucci
So, no one had the same problem? Nicola Il 30/09/2014 17:30, Nicola Vitucci ha scritto: > Hi all, > > I've just tried compiling Giraph (from trunk and release-1.1) after > applying the GIRAPH-947 patch, but I am still unable to compile it > successfully. This is the command I use for compiling:

giraph.metrics.enable

2014-10-10 Thread xuhong zhang
Dear everyone, How to use "giraph.metrics.enable=true" and "giraph.metrics.directory=dir" options. Where should i specify them in the command? thanks -- Xuhong Zhang