> On July 2, 2014, 1:53 a.m., Maja Kabiljo wrote: > > giraph-examples/src/test/java/org/apache/giraph/master/TestAggregatorsHandling.java, > > line 19 > > <https://reviews.apache.org/r/23140/diff/2/?file=622266#file622266line19> > > > > Why did you move this file?
> On July 2, 2014, 1:53 a.m., Maja Kabiljo wrote: > > giraph-core/src/main/java/org/apache/giraph/master/BspServiceMaster.java, > > lines 817-818 > > <https://reviews.apache.org/r/23140/diff/2/?file=622249#file622249line817> > > > > Interesting, where do we rely on this? I don't remember it right now, will run some experiments later - Sergey ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23140/#review47169 ----------------------------------------------------------- On July 15, 2014, 9:08 p.m., Sergey Edunov wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/23140/ > ----------------------------------------------------------- > > (Updated July 15, 2014, 9:08 p.m.) > > > Review request for giraph. > > > Repository: giraph-git > > > Description > ------- > > This fix merely makes checkpointing work again. > > > Diffs > ----- > > > giraph-core/src/main/java/org/apache/giraph/aggregators/AggregatorWrapper.java > 9613805 > giraph-core/src/main/java/org/apache/giraph/bsp/BspService.java 2e35373 > giraph-core/src/main/java/org/apache/giraph/comm/ServerData.java 85bfe04 > giraph-core/src/main/java/org/apache/giraph/conf/GiraphConstants.java > ab0570f > giraph-core/src/main/java/org/apache/giraph/master/BspServiceMaster.java > 0275395 > > giraph-core/src/main/java/org/apache/giraph/partition/BasicPartitionOwner.java > 545d1af > > giraph-core/src/main/java/org/apache/giraph/partition/HashMasterPartitioner.java > 240687e > > giraph-core/src/main/java/org/apache/giraph/partition/HashWorkerPartitioner.java > d833895 > > giraph-core/src/main/java/org/apache/giraph/partition/MasterGraphPartitioner.java > 50c750a > > giraph-core/src/main/java/org/apache/giraph/partition/PartitionBalancer.java > 3454d62 > giraph-core/src/main/java/org/apache/giraph/partition/PartitionOwner.java > 0ac74da > > giraph-core/src/main/java/org/apache/giraph/partition/SimpleMasterPartitioner.java > f128f34 > > giraph-core/src/main/java/org/apache/giraph/partition/SimpleWorkerPartitioner.java > 3c0de44 > > giraph-core/src/main/java/org/apache/giraph/partition/WorkerGraphPartitioner.java > 004ea81 > giraph-core/src/main/java/org/apache/giraph/utils/InternalVertexRunner.java > 2c4606f > > giraph-core/src/main/java/org/apache/giraph/utils/io/ExtendedDataInputOutput.java > af45426 > giraph-core/src/main/java/org/apache/giraph/worker/BspServiceWorker.java > de7af28 > giraph-core/src/main/java/org/apache/giraph/worker/WorkerContext.java > 29835c5 > > giraph-core/src/test/java/org/apache/giraph/partition/SimpleRangePartitionFactoryTest.java > 96bd5d7 > > Diff: https://reviews.apache.org/r/23140/diff/ > > > Testing > ------- > > I tested it running multiple different jobs. I run page rank on 2*10^9 > vertices on 200 workers and it seems to work just fine. It only takes 2 > minutes to save checkpoint. > > > Thanks, > > Sergey Edunov > >
