Can we run giraph SimpleShortestPathsVertex example from eclipse.

2014-06-22 Thread satyajit ag
Hi ,

i have been trying to run SimpleShortestPathsVertex program from eclipse
and was facing error shown below,
java.lang.IllegalArgumentException: checkLocalJobRunnerConfiguration: When
using LocalJobRunner, you cannot run in split master / worker mode since
there is only 1 task at a time!

So wanted to check, if it is possible to run the
SimpleShortestPathsVertex program from eclipse or is eclipse is only to
just develop code and then to create the jar file and run it in command
line.

is there a way to run the program using hadoop from eclipse??

REGARDS,
SATYAJIT.


Re: Can we run giraph SimpleShortestPathsVertex example from eclipse.

2014-06-22 Thread Francisco Sanches
Hi

I'm having this same doubt if achieve some breakthrough would very much
like that you share with me.


2014-06-22 9:30 GMT-04:00 satyajit ag satyajit.apac...@gmail.com:

 Hi ,

 i have been trying to run SimpleShortestPathsVertex program from eclipse
 and was facing error shown below,
 java.lang.IllegalArgumentException: checkLocalJobRunnerConfiguration: When
 using LocalJobRunner, you cannot run in split master / worker mode since
 there is only 1 task at a time!

 So wanted to check, if it is possible to run the
 SimpleShortestPathsVertex program from eclipse or is eclipse is only to
 just develop code and then to create the jar file and run it in command
 line.

 is there a way to run the program using hadoop from eclipse??

 REGARDS,
 SATYAJIT.





-- 
Francisco Sanches


Got Giraph 1.1.0 examples running on YARN

2014-06-22 Thread John Yost
Hi Everyone,

I just gotten the Giraph examples to run on YARN and I thought I would
share the details since it looks like a few people have struggled with
this. This is what I did:

1. Downloaded the latest snapshot (giraph-b218d2)
2. Built with mvn install -P=hadoop_2 -DskipTests=true
3. Executed with the following CLI entry against a Hadoop 2.2.0
pseudo-cluster with mapreduce.framework.name=yarn:

hadoop jar
/usr/local/java/giraph/giraph-1.1/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.2.0-jar-with-dependencies.jar
org.apache.giraph.GiraphRunner
org.apache.giraph.examples.SimpleShortestPathsComputation -vif
org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
-vip /user/hadoop/tiny.txt -vof
org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
/user/hadoop/shortestpaths -w 1 -ca giraph.zkList=localhost:2181 -ca
giraph.SplitMasterWorker=true -ca mapred.job.tracker=localhost:54311 -ca
mapreduce.job.tracker=localhost:54311

Note: the parameter -ca mapred.job.tracker=localhost:54311 is crucial to
this working in cluster/pseudo-cluster mode.  Otherwise, You'll get the
following error hat Satyajit recently posted:

java.lang.IllegalArgumentException: checkLocalJobRunnerConfiguration: When
using LocalJobRunner, you cannot run in split master / worker mode since
there is only 1 task at a time!

If you actually want to run in local mode, have not figured that out as I
want to be able to run on my cluster instead.

--John.