My Giraph job gets stuck at this point and will not go any further, that log is what is continually printed out every 5 seconds. This log is coming from the CombinedWorkerProgress class:
else if (isComputeSuperstep()) { sb.append("Compute superstep ").append(currentSuperstep).append(": "); sb.append(verticesComputed).append(" out of ").append( verticesToCompute).append(" vertices computed; "); sb.append(partitionsComputed).append(" out of ").append( partitionsToCompute).append(" partitions computed"); So the data is loaded in fine and then the Giraph job gets stuck in superstep 0 for some reason? public void compute(Vertex<IntWritable, IntWritable, NullWritable> vertex, Iterable<IntWritable> messages) throws IOException { //check if its the first superstep if (getSuperstep() == 0) { if(isStart(vertex)) { vertex.setValue(new IntWritable((int) getSuperstep())); for (Edge<IntWritable, NullWritable> edge : vertex.getEdges()) { idQueue.addInt(edge.getTargetVertexId().get()); sendMessage(edge.getTargetVertexId(), new IntWritable(1)); } Collections.sort(idQueue.getArrayList()); aggregate(ID_AGG, idQueue); } else { vertex.setValue(new IntWritable(Integer.MAX_VALUE)); } } Thats the code I wrote for the first superstep. I ran this code before without the aggregate and it worked, so I think my problem is related the the aggregator/master. Kind regards, Ghufran On Thu, Apr 3, 2014 at 4:40 PM, Rob Vesse <rve...@dotnetrdf.org> wrote: > How is that an error? > > That's just some informational log statements from Giraph, you'll need to > provide the actual error message/describe the issue to get help with your > problem > > Rob > > From: ghufran malik <ghufran1ma...@gmail.com> > Reply-To: <user@giraph.apache.org> > Date: Thursday, 3 April 2014 16:09 > To: <user@giraph.apache.org> > Subject: Master/Agreggators > > Hi, > > I received the error: > > 14/04/03 16:01:07 INFO mapred.JobClient: map 100% reduce 0% > 14/04/03 16:01:11 INFO job.JobProgressTracker: Data from 1 workers - > Compute superstep 0: 0 out of 4 vertices computed; 0 out of 1 partitions > computed; min free memory on worker 1 - 106.6MB, average 106.6MB > 14/04/03 16:01:16 INFO job.JobProgressTracker: Data from 1 workers - > Compute superstep 0: 0 out of 4 vertices computed; 0 out of 1 partitions > computed; min free memory on worker 1 - 106.6MB, average 106.6MB > 14/04/03 16:01:21 INFO job.JobProgressTracker: Data from 1 workers - > Compute superstep 0: 0 out of 4 vertices computed; 0 out of 1 partitions > computed; min free memory on worker 1 - 106.6MB, average 106.6MB > 14/04/03 16:01:26 INFO job.JobProgressTracker: Data from 1 workers - > Compute superstep 0: 0 out of 4 vertices computed; 0 out of 1 partitions > computed; min free memory on worker 1 - 106.59MB, average 106.59MB > > > After trying to run a computation class I made that makes use of an > agreggator and master. I remember getting a similar error when I tried > SimplePageRank which also makes uses of a master and a agreggator. > > Does anyone know why I receive this error and how to fix it? > > Kind regards, > > Ghufran > >