[jira] [Updated] (GIRAPH-246) Periodic worker calls to context.progress() will prevent timeout on some Hadoop clusters during barrier waits

2012-08-16 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Reisman updated GIRAPH-246: --- Attachment: GIRAPH-246-7_rebase2.patch this "GIRAPH-246-7_rebase2.patch" is the rebase that builds wi

[jira] [Updated] (GIRAPH-246) Periodic worker calls to context.progress() will prevent timeout on some Hadoop clusters during barrier waits

2012-08-16 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Reisman updated GIRAPH-246: --- Attachment: GIRAPH-246-NEW-FIX-2.patch This includes one more extra call to progress() and is otherwi

Re: [jira] [Reopened] (GIRAPH-297) Checkpointing on master is done one superstep later

2012-08-16 Thread Eli Reisman
Sounds like this is a tough one. I think doing master compute after vertices is a little counter intuitive but if it fits the existing framework the best, then its the best option. I do think its a priority to make sure the super step numbers a user sees when working with a master compute or vertex

[jira] [Updated] (GIRAPH-297) Checkpointing on master is done one superstep later

2012-08-16 Thread Maja Kabiljo (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maja Kabiljo updated GIRAPH-297: Attachment: GIRAPH-297-fix.patch This patch introduced a bug: with finalizing checkpoint I also mov

[jira] [Reopened] (GIRAPH-297) Checkpointing on master is done one superstep later

2012-08-16 Thread Maja Kabiljo (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maja Kabiljo reopened GIRAPH-297: - > Checkpointing on master is done one superstep later > -

[jira] [Commented] (GIRAPH-246) Periodic worker calls to context.progress() will prevent timeout on some Hadoop clusters during barrier waits

2012-08-16 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436244#comment-13436244 ] Eli Reisman commented on GIRAPH-246: The problem might not be this patch after all. Th

[jira] [Commented] (GIRAPH-246) Periodic worker calls to context.progress() will prevent timeout on some Hadoop clusters during barrier waits

2012-08-16 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436179#comment-13436179 ] Eli Reisman commented on GIRAPH-246: did 3 very long runs on this patch now. The very

[jira] [Commented] (GIRAPH-300) Improve netty reliability with retrying failed connections, tracking requests, thread-safe hash partitioning

2012-08-16 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436168#comment-13436168 ] Avery Ching commented on GIRAPH-300: Glad to hear it Eli. I have another patch I work

[jira] [Commented] (GIRAPH-300) Improve netty reliability with retrying failed connections, tracking requests, thread-safe hash partitioning

2012-08-16 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436144#comment-13436144 ] Eli Reisman commented on GIRAPH-300: This patch is great, I have now completed several

[jira] [Commented] (GIRAPH-301) InputSplit Reservations are clumping, leaving many workers asleep while other process too many splits and get overloaded.

2012-08-16 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436083#comment-13436083 ] Eli Reisman commented on GIRAPH-301: Please do, I agree with your concerns about scale

[jira] [Commented] (GIRAPH-246) Periodic worker calls to context.progress() will prevent timeout on some Hadoop clusters during barrier waits

2012-08-16 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436077#comment-13436077 ] Eli Reisman commented on GIRAPH-246: Actually the calls that made the difference for u

Review Request: Random Walks on Graphs

2012-08-16 Thread Gianmarco De Francisci Morales
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/6653/ --- Review request for giraph and Jakob Homan. Description --- Random Walks on

Re: Review Request: Move part of the graph out-of-core when memory is low

2012-08-16 Thread Maja Kabiljo
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/5987/#review10400 --- I'll take a deeper look into this once you have a final version, for

[jira] [Commented] (GIRAPH-301) InputSplit Reservations are clumping, leaving many workers asleep while other process too many splits and get overloaded.

2012-08-16 Thread Alessandro Presta (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435858#comment-13435858 ] Alessandro Presta commented on GIRAPH-301: -- Cool, I'll wait for the results.