I ran a first test with the new DiskBackedPartitionStore and it didn't
work for me unfortunately. The job never leaves the input phase
(superstep -1). I sshd onto one of the workers and it seems to wait
forever on DiskBackedPartitionStore.getOrCreatePartition:
java.lang.Thread.State: BLOCKED (on object monitor)
at
org.apache.giraph.partition.DiskBackedPartitionStore.getOrCreatePartition(DiskBackedPartitionStore.java:226)
- waiting to lock <0x00000000aeb757c8> (a
org.apache.giraph.partition.DiskBackedPartitionStore$MetaPartition)
Here are the custom arguments for my run, let me know if I should do
another run with a different config.
giraph.oneToAllMsgSending=true
giraph.isStaticGraph=true
giraph.numComputeThreads=15
giraph.numInputThreads=15
giraph.numOutputThreads=15
giraph.maxNumberOfSupersteps=30
giraph.useOutOfCoreGraph=true
giraph.stickyPartitions=5
I also ran the job without using oneToAllMsgSending and saw the same
behavior.
Best,
Sebastian
On 02/12/2014 12:44 AM, Claudio Martella wrote:
please give it a test. i've been working on this with armando. i'll give a
review, but we have been testing it for while. we'd really appreciate if
somebody else could run some additional tests as well. thanks!
On Wed, Feb 12, 2014 at 12:39 AM, Sebastian Schelter <s...@apache.org> wrote:
I'll test the patch from GIRAPH-825 this week.
On 02/12/2014 12:10 AM, Roman Shaposhnik wrote:
Hi!
Given how big the diff here are:
https://issues.apache.org/jira/browse/GIRAPH-825
https://issues.apache.org/jira/browse/GIRAPH-840
I am wondering whether it is realistic
to have them in 1.1.0.
Would appreciate folks chiming in.
Thanks,
Roman.
