Where could I get a introduction of Giraph

Hi, everybody, I am learning Giraph. I have read the paper *pregel a system for large-scale graph processing.*Although Giraph is based on pregel, I guess it has added some extra features to improve the performances ( e.g., multi-threading). I wonder if I can get some introductions about technical

Differences in building Giraph

Hi Giraph Experts, I'm trying to build Giraph (trunk) for Hadoop 2.4.0. I know that there are 2 profiles with which I can proceed to build. *hadoop_yarn* and *hadoop_2 * profiles. When I try with *hadoop_yarn*, build is fine. When I try with *hadoop_2*, build is failing. The commands I used is *

Re: Help with Giraph on Yarn

Hey, I am not aware of this error. Maybe ur Hadoop home is not correctly set or some other minor issue. Sent from my iPhone On 07-Nov-2014, at 2:02 am, "Jing Fan" mailto:fanjin...@gmail.com>> wrote: Hi Tripti, The GiraphApplicationMaster error but the yarn error log says java.lang.RuntimeExc

Re: Help with Giraph on Yarn

Hi Tripti, The GiraphApplicationMaster error but the yarn error log says java.lang.RuntimeException: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.giraph.examples.SimplePageRankComputation not found at org.apache.hadoop.conf.Configuration.getClass(Configuration.ja

Re: Help with Giraph on Yarn

I don't know if u have access to this node. But if u do, u could check if the file is indeed there and u have access to it. Sent from my iPhone On 06-Nov-2014, at 6:12 pm, "Alessandro Negro" mailto:alenegr...@yahoo.it>> wrote: You are right it works, but now I receive the following error: SLF

Re: Help with Giraph on Yarn

You are right it works, but now I receive the following error: SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/private/tmp/hadoop-yarn/nm-local-dir/usercache/ale/appcache/application_1415264041937_0009/filecache/10/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2

Re: Help with Giraph on Yarn

Why r u adding two jars? Example jar ideally contains core library so everything should be available with just one example jar included Sent from my iPhone On 06-Nov-2014, at 4:33 pm, "Alessandro Negro" mailto:alenegr...@yahoo.it>> wrote: Hi, now it seems better, I need to add: giraph-1.1.0-S

Re: Help with Giraph on Yarn

Hi, now it seems better, I need to add: giraph-1.1.0-SNAPSHOT-for-hadoop-2.5.1-jar-with-dependencies.jar,giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.5.1-jar-with-dependencies.jar Now it seems that after a lot of cycle it fail with this error: Could not find or load main class org.apache.giraph

Re: Help with Giraph on Yarn

Hi, I remember seeing this thread, but since i was already deep into fixing this issue in production, I didn't really wait for the patch, not even the munge symbol as I was not even able to compile the yarn profile( sorry for being so ruthless to giraph :-( ) I did later cross check with the pat

Re: Help with Giraph on Yarn

Hi Tripti, let me add one info, As you can see from this thread of email: http://mail-archives.apache.org/mod_mbox/giraph-user/201410.mbox/%3cc3f75a98-bde8-4205-971f-1f7241e6e...@yahoo.it%3E I had some issue while compiling for Hadoop 2.5.1 could be that into the process I loose something? Tha

Re: Help with Giraph on Yarn

Hey, Yeah I learnt it the hard way but -yj parameter doesn't need the full path like I mentioned(I stated that it's just the file name as opposed to the full path u give while mentioning Hadoop jar). Just try giving it the jar file name and not the full path( say something like -yj giraph-1.1.0

Re: Help with Giraph on Yarn

Hi Tripti, yes I run in this way: $HADOOP_INSTALL/bin/hadoop jar /Users/ale/extprj/giraph/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.5.1-jar-with-dependencies.jar org.apache.giraph.GiraphRunner org.apache.giraph.examples.SimpleShortestPathsComputation -vif org.apache.g

Re: Help with Giraph on Yarn

For GiraphApplicationMaster not found, the simple thing that worked for me was adding a -yj parameter to my command. (hadoop jar {jar-file-path} {path to giraph runner} {computation-class} {bunch of parameters} -yj {jar-file-name}) If u look at job logs, Do u see a log statement defining "LIB JAR

Re: Help with Giraph on Yarn

Hi, yea my logs shows that error. I follow this example: http://mail-archives.apache.org/mod_mbox/giraph-user/201408.mbox/%3c53f4c689.5060...@web.de%3E without success. Then I try to add all jars I can from giraph adding the following lines into the hadoop-env.sh: export MYLIB=/opt/yarn/hadoop