Hello Vishal,
Cross-posting from a different mailing list thread with the steps that allowed
me to compile and run SimpleShortestPaths on a pure-yarn cluster. Hope it
works for you too :)
I was able to compile and run Giraph 1.1.0-SNAPSHOT on top of hadoop-2.2.0.
Here's what I did:
Hi,
I have a question on load balance in giraph. How does giraph to load data
if only VertexInputFormat is used? By hash on vertex id, or range based?
Thank you.
-Yi
By hash on vertex id.
On 09.12.2013 11:01, Yi Lu wrote:
Hi,
I have a question on load balance in giraph. How does giraph to load data
if only VertexInputFormat is used? By hash on vertex id, or range based?
Thank you.
-Yi
Hi Eli/Alexandre,
I have tried with Giraph-1.1.0-SNAPSHOT and hadoop-2.2.0 as well using the
steps mentioned by Alexandre, but again i am getting the same error while
running the example:
Command:
$HADOOP_HOME/bin/hadoop jar
Hi Rohit,
In my case, I got 2 Shell$ExitCodeExceptions when trying to run the
SimpleShortestPathsComputation:
- Error: Could not find or load main class
org.apache.giraph.yarn.GiraphApplicationMaster
This was solved by adding -yj giraph-examples-1.1.0-SNAPSHOT-for-
Hi Alexandre,
I looked into the logs and found this:
2013-12-09 12:29:08,925 INFO [main] yarn.GiraphApplicationMaster
(GiraphApplicationMaster.java:main(426)) - Starting GitaphAM
2013-12-09 12:29:09,727 WARN [main] util.NativeCodeLoader
(NativeCodeLoader.java:clinit(62)) - Unable to load
Tried the steps (one variation was 'clean package' instead of 'compile'
since a dependency check was failing) provided by Alexandre and hitting the
same error as Rohit.
Note that I'm attempting on a cluster.
Cmdline: hadoop jar
When you execute the job, one of the INFO lines should state the environment
used for the launching of the ApplicationMaster. In my case, it looks
something like this:
13/12/09 21:54:56 INFO yarn.GiraphYarnClient: Environment for AM :
{CLASSPATH=${CLASSPATH}:./*:$HADOOP_CONF_DIR:
I have confirmed a bug in Giraph's YARN code related to the default MapReduce
configuration. Either provide your own mapreduce.application.classpath in
mapred-site.xml or apply the patch described here:
https://issues.apache.org/jira/browse/GIRAPH-814
Application runs successfully if using
