Giraph 1.0 | Computation stuck at map 100% - reduce 0% for my algorithm only, at multi-node cluster

2014-09-30 Thread Panagiotis Eustratiadis
Good morning, I have been having a problem the past few days which sadly I can't solve. First of all I set up a Hadoop 0.20.203.0 cluster of two nodes a master and a slave. I followed this tutorial for the settings:

Re: Giraph 1.0 | Computation stuck at map 100% - reduce 0% for my algorithm only, at multi-node cluster

2014-09-30 Thread Matthew Cornell
I'm new, but in my meager experience when it stops at map 100% it means there was an error somewhere. In Giraph I've often found it difficult to pin down what that error actually was (e.g., out of memory), but the logs are the first place to look. Just to clarify re: not finding outputs: Are you

Re: Giraph 1.0 | Computation stuck at map 100% - reduce 0% for my algorithm only, at multi-node cluster

2014-09-30 Thread Panagiotis Eustratiadis
Hello Matthew, thanks for the answer. Oddly enough the job isn't listed under the failed jobs, as it is still running. The execution never ends unless I kill it from the command line. And I did check the logs (I always do), but they don't say anything. By the way I see no syslog, only stdout and

Compiling Giraph with Hadoop 2.5.1 YARN

2014-09-30 Thread Nicola Vitucci
Hi all, I've just tried compiling Giraph (from trunk and release-1.1) after applying the GIRAPH-947 patch, but I am still unable to compile it successfully. This is the command I use for compiling: mvn package -DskipTests -Dhadoop.version=2.5.1 -Phadoop_yarn clean install and this is the stack

Passing options to giraph 1.1.0 - SNAPSHOT, Hadoop 2.2.0

2014-09-30 Thread Charith Wickramarachchi
Hi, I am trying to pass some system options into the giraph job so that I can access it through the Giraph configuration. I am using the following command $HADOOP_HOME/bin/hadoop jar giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.2.0-jar-with-dependencies.jar org.apache.giraph.GiraphRunner