Issue while trying to run giraph using eclipse IDE.

[satyajit ag]

Hi,

I am new to Giraph, and i am trying to run a sample program from eclipse.

run configuration used:

org.apache.giraph.examples.SimpleShortestPathsVertex -vif
org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
-vip /user/balu/tiny_graph.txt -of
org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
/user/balu/shortestpaths -w 1

main class:org.apache.giraph.GiraphRunner

but i am getting the below error:
Exception in thread main java.lang.IllegalArgumentException:
checkLocalJobRunnerConfiguration: When using LocalJobRunner, you cannot run
in split master / worker mode since there is only 1 task at a time!
at
org.apache.giraph.job.GiraphJob.checkLocalJobRunnerConfiguration(GiraphJob.java:159)
at org.apache.giraph.job.GiraphJob.run(GiraphJob.java:227)
at org.apache.giraph.GiraphRunner.run(GiraphRunner.java:98)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.giraph.GiraphRunner.main(GiraphRunner.java:129).


i was able to run from command line, but wanted to run the same from
eclipse.

Could you please help in progressing further,

hadoop daemon process are running when i run in eclipse, not sure if there
is any other way to make sure the giraph framework runs and points to the
hadoop running on the same machine, from eclipse.

Thank you in advance.,
Satyajit.

Shortest Path Still Won't Work--Any Ideas?

[John Yost]

Here's more details regarding my attempts are running Shortest Path.  Any
help would be greatly appreciated as the root cause for the Giraph job
failing is not obvious to me.

Thanks

---John

Command Line:

$ hadoop jar
giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.2.0-jar-with-dependencies.jar
org.apache.giraph.GiraphRunner
org.apache.giraph.examples.SimpleShortestPathsComputation -vif
org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
-vip /user/hadoop/tiny.txt -vof
org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
/user/hadoop/shortestpaths -w 1 -yj
giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.2.0-jar-with-dependencies.jar

Console Output:

14/06/20 21:49:02 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
14/06/20 21:49:03 INFO utils.ConfigurationUtils: No edge input format
specified. Ensure your InputFormat does not require one.
14/06/20 21:49:03 INFO utils.ConfigurationUtils: No edge output format
specified. Ensure your OutputFormat does not require one.
14/06/20 21:49:03 INFO yarn.GiraphYarnClient: Final output path is:
hdfs://localhost.localdomain:8020/user/hadoop/shortestpaths
14/06/20 21:49:03 INFO yarn.GiraphYarnClient: Running Client
14/06/20 21:49:03 INFO client.RMProxy: Connecting to ResourceManager at /
0.0.0.0:8032
14/06/20 21:49:03 INFO yarn.GiraphYarnClient: Got node report from ASM for,
nodeId=localhost.localdomain:36056, nodeAddress localhost.localdomain:8042,
nodeRackName /default-rack, nodeNumContainers 0
14/06/20 21:49:03 INFO yarn.GiraphYarnClient: Defaulting per-task heap size
to 1024MB.
14/06/20 21:49:03 INFO yarn.GiraphYarnClient: Obtained new Application ID:
application_1402926902901_0001
14/06/20 21:49:03 INFO Configuration.deprecation: mapred.job.id is
deprecated. Instead, use mapreduce.job.id
14/06/20 21:49:03 INFO yarn.GiraphYarnClient: Set the environment for the
application master
14/06/20 21:49:03 INFO yarn.GiraphYarnClient: Environment for AM
:{CLASSPATH=${CLASSPATH}:./*:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/share/hadoop/common/*:$HADOOP_COMMON_HOME/share/hadoop/common/lib/*:$HADOOP_HDFS_HOME/share/hadoop/hdfs/*:$HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*:$HADOOP_YARN_HOME/share/hadoop/yarn/*:$HADOOP_YARN_HOME/share/hadoop/yarn/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*}
14/06/20 21:49:03 INFO yarn.GiraphYarnClient: buildLocalResourceMap 
14/06/20 21:49:03 INFO Configuration.deprecation: mapred.output.dir is
deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
14/06/20 21:49:04 INFO yarn.YarnUtils: Registered file in LocalResources ::
hdfs://localhost.localdomain:8020/user/hadoop/giraph_yarn_jar_cache/application_1402926902901_0001/giraph-conf.xml
14/06/20 21:49:04 INFO yarn.GiraphYarnClient: LIB JARS
:giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.2.0-jar-with-dependencies.jar
14/06/20 21:49:04 INFO yarn.YarnUtils: Class path name .
14/06/20 21:49:04 INFO yarn.YarnUtils: base path checking .
14/06/20 21:49:04 INFO yarn.GiraphYarnClient: Made local resource for
:/home/hadoop/Downloads/giraph/giraph-1200915/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.2.0-jar-with-dependencies.jar
to
hdfs://localhost.localdomain:8020/user/hadoop/giraph_yarn_jar_cache/application_1402926902901_0001/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.2.0-jar-with-dependencies.jar
14/06/20 21:49:04 INFO yarn.YarnUtils: Registered file in LocalResources ::
hdfs://localhost.localdomain:8020/user/hadoop/giraph_yarn_jar_cache/application_1402926902901_0001/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.2.0-jar-with-dependencies.jar
14/06/20 21:49:04 INFO yarn.GiraphYarnClient: ApplicationSumbissionContext
for GiraphApplicationMaster launch container is populated.
14/06/20 21:49:04 INFO yarn.GiraphYarnClient: Submitting application to ASM
14/06/20 21:49:04 INFO impl.YarnClientImpl: Submitted application
application_1402926902901_0001 to ResourceManager at /0.0.0.0:8032
14/06/20 21:49:04 INFO yarn.GiraphYarnClient: Got new appId after
submission :application_1402926902901_0001
14/06/20 21:49:04 INFO yarn.GiraphYarnClient: GiraphApplicationMaster
container request was submitted to ResourceManager for job: Giraph:
org.apache.giraph.examples.SimpleShortestPathsComputation
14/06/20 21:49:05 INFO yarn.GiraphYarnClient: Giraph:
org.apache.giraph.examples.SimpleShortestPathsComputation, Elapsed: 0.88
secs
14/06/20 21:49:05 INFO yarn.GiraphYarnClient:
appattempt_1402926902901_0001_01, State: ACCEPTED, Containers used: 1
14/06/20 21:49:09 INFO yarn.GiraphYarnClient: Giraph:
org.apache.giraph.examples.SimpleShortestPathsComputation, Elapsed: 4.90
secs
14/06/20 21:49:09 INFO yarn.GiraphYarnClient:
appattempt_1402926902901_0001_01, State: RUNNING, Containers used: 1
14/06/20 21:49:13 INFO yarn.GiraphYarnClient: Cleaning up HDFS distributed
cache directory for Giraph job.
14/06/20 21:49:13 INFO