[jira] [Created] (GIRAPH-297) Checkpointing on master is done one superstep later

2012-08-13 Thread Maja Kabiljo (JIRA)
Maja Kabiljo created GIRAPH-297: --- Summary: Checkpointing on master is done one superstep later Key: GIRAPH-297 URL: https://issues.apache.org/jira/browse/GIRAPH-297 Project: Giraph Issue Type:

[jira] [Created] (GIRAPH-296) TotalNumVertices and TotalNumEdges are not saved in checkpoint

2012-08-13 Thread Maja Kabiljo (JIRA)
Maja Kabiljo created GIRAPH-296: --- Summary: TotalNumVertices and TotalNumEdges are not saved in checkpoint Key: GIRAPH-296 URL: https://issues.apache.org/jira/browse/GIRAPH-296 Project: Giraph

[jira] [Commented] (GIRAPH-297) Checkpointing on master is done one superstep later

2012-08-13 Thread Maja Kabiljo (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433011#comment-13433011 ] Maja Kabiljo commented on GIRAPH-297: - This also takes me back to the discussion about

[jira] [Created] (GIRAPH-298) TestAutoCheckpoint doesn't restart from checkpoint

2012-08-13 Thread Maja Kabiljo (JIRA)
Maja Kabiljo created GIRAPH-298: --- Summary: TestAutoCheckpoint doesn't restart from checkpoint Key: GIRAPH-298 URL: https://issues.apache.org/jira/browse/GIRAPH-298 Project: Giraph Issue Type: B

[jira] [Commented] (GIRAPH-298) TestAutoCheckpoint doesn't restart from checkpoint

2012-08-13 Thread Maja Kabiljo (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433048#comment-13433048 ] Maja Kabiljo commented on GIRAPH-298: - I've been (unsuccessfully) trying to figure out

[jira] [Updated] (GIRAPH-235) SequenceFile output format (id-value only)

2012-08-13 Thread Gianmarco De Francisci Morales (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gianmarco De Francisci Morales updated GIRAPH-235: -- Attachment: GIRAPH-235.2.patch Rebased the patch, changed the n

[jira] [Updated] (GIRAPH-296) TotalNumVertices and TotalNumEdges are not saved in checkpoint

2012-08-13 Thread Maja Kabiljo (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maja Kabiljo updated GIRAPH-296: Attachment: GIRAPH-296.patch Added GlobalStats to checkpointed data. > TotalNumVer

[jira] [Commented] (GIRAPH-214) GiraphJob should have configuration split out of it to be cleaner (GiraphConf)

2012-08-13 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433259#comment-13433259 ] Eli Reisman commented on GIRAPH-214: Options I am considering include overriding parts

[jira] [Resolved] (GIRAPH-258) Check type compatibility before submitting job

2012-08-13 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan resolved GIRAPH-258. Resolution: Fixed +1. Committed this during the JIRA outage. Resolving. Thanks, Eli.

[jira] [Updated] (GIRAPH-246) Periodic worker calls to context.progress() will prevent timeout on some Hadoop clusters during barrier waits

2012-08-13 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Reisman updated GIRAPH-246: --- Attachment: (was: GIRAPH-214-6-option1.patch) > Periodic worker calls to context.progress() w

[jira] [Updated] (GIRAPH-246) Periodic worker calls to context.progress() will prevent timeout on some Hadoop clusters during barrier waits

2012-08-13 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Reisman updated GIRAPH-246: --- Attachment: GIRAPH-214-6-option1.patch This is about as I can get without attempting to subclass/reim

[jira] [Updated] (GIRAPH-214) GiraphJob should have configuration split out of it to be cleaner (GiraphConf)

2012-08-13 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Reisman updated GIRAPH-214: --- Attachment: GIRAPH-214-6-option1.patch This is another more convincing attempt to force GiraphJob hel

Review Request: SequenceFile output format (id-value only)

2012-08-13 Thread Gianmarco De Francisci Morales
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/6569/ --- Review request for giraph and Jakob Homan. Description --- GIRAPH-235: Sequ

Re: Review Request: SequenceFile output format (id-value only)

2012-08-13 Thread Gianmarco De Francisci Morales
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/6569/ --- (Updated Aug. 13, 2012, 11:22 a.m.) Review request for giraph and Jakob Homan.

Re: Review Request: SequenceFile output format (id-value only)

2012-08-13 Thread Gianmarco De Francisci Morales
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/6569/ --- (Updated Aug. 13, 2012, 11:22 a.m.) Review request for giraph and Jakob Homan.

[jira] [Commented] (GIRAPH-246) Periodic worker calls to context.progress() will prevent timeout on some Hadoop clusters during barrier waits

2012-08-13 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433345#comment-13433345 ] Eli Reisman commented on GIRAPH-246: sorry about this last comment, the autocomplete o

[jira] [Commented] (GIRAPH-297) Checkpointing on master is done one superstep later

2012-08-13 Thread Jan van der Lugt (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433354#comment-13433354 ] Jan van der Lugt commented on GIRAPH-297: - This is expected: the at the end of sup

[jira] [Commented] (GIRAPH-296) TotalNumVertices and TotalNumEdges are not saved in checkpoint

2012-08-13 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433358#comment-13433358 ] Eli Reisman commented on GIRAPH-296: This builds for me and passes mvn verify, great c

[jira] [Commented] (GIRAPH-297) Checkpointing on master is done one superstep later

2012-08-13 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433372#comment-13433372 ] Eli Reisman commented on GIRAPH-297: Is there anything master.compute() needs to do du

[jira] [Commented] (GIRAPH-297) Checkpointing on master is done one superstep later

2012-08-13 Thread Jan van der Lugt (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433377#comment-13433377 ] Jan van der Lugt commented on GIRAPH-297: - This is very difficult, since aggregato

[jira] [Updated] (GIRAPH-246) Periodic worker calls to context.progress() will prevent timeout on some Hadoop clusters during barrier waits

2012-08-13 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Reisman updated GIRAPH-246: --- Attachment: GIRAPH-246-7_rebase1.patch This is patch is a rebasing of the "revert 267" code, its not

[jira] [Updated] (GIRAPH-297) Checkpointing on master is done one superstep later

2012-08-13 Thread Maja Kabiljo (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maja Kabiljo updated GIRAPH-297: Attachment: GIRAPH-297.patch > Checkpointing on master is done one superstep later > --

[jira] [Commented] (GIRAPH-297) Checkpointing on master is done one superstep later

2012-08-13 Thread Maja Kabiljo (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433426#comment-13433426 ] Maja Kabiljo commented on GIRAPH-297: - The easiest way here would be to switch the exe

[jira] [Updated] (GIRAPH-275) Restore data locality to workers reading InputSplits where possible without querying NameNode, ZooKeeper

2012-08-13 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Reisman updated GIRAPH-275: --- Attachment: GIRAPH-275-7.patch Rebase for 275-7 because it didn't end up getting committed to trunk d

[jira] [Commented] (GIRAPH-292) Computation progress is not being logged

2012-08-13 Thread Maja Kabiljo (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433475#comment-13433475 ] Maja Kabiljo commented on GIRAPH-292: - Eli, I see the output like this when running bi

[jira] [Commented] (GIRAPH-297) Checkpointing on master is done one superstep later

2012-08-13 Thread Jan van der Lugt (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433477#comment-13433477 ] Jan van der Lugt commented on GIRAPH-297: - If it makes stuff easier, let's just sw

[jira] [Commented] (GIRAPH-275) Restore data locality to workers reading InputSplits where possible without querying NameNode, ZooKeeper

2012-08-13 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433478#comment-13433478 ] Jakob Homan commented on GIRAPH-275: Sorry. I was sure I had committed this. +1 on t

[jira] [Commented] (GIRAPH-275) Restore data locality to workers reading InputSplits where possible without querying NameNode, ZooKeeper

2012-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433515#comment-13433515 ] Hudson commented on GIRAPH-275: --- Integrated in Giraph-trunk-Commit #170 (See [https://build

[jira] [Created] (GIRAPH-299) Constant value in BspServiceMaster should be static

2012-08-13 Thread Eli Reisman (JIRA)
Eli Reisman created GIRAPH-299: -- Summary: Constant value in BspServiceMaster should be static Key: GIRAPH-299 URL: https://issues.apache.org/jira/browse/GIRAPH-299 Project: Giraph Issue Type: Im

[jira] [Updated] (GIRAPH-26) Improve PseudoRandomVertexInputFormat to create a more realistic synthetic graph (e.g. power-law distributed vertex-cardinality).

2012-08-13 Thread Sean Choi (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-26?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Choi updated GIRAPH-26: Attachment: (was: GIRAPH-26-1.patch) > Improve PseudoRandomVertexInputFormat to create a more realis

[jira] [Updated] (GIRAPH-191) Random Walks on Graphs

2012-08-13 Thread Gianmarco De Francisci Morales (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gianmarco De Francisci Morales updated GIRAPH-191: -- Attachment: GIRAPH-191.3.patch As I said on the dev list, the m

[jira] [Updated] (GIRAPH-191) Random Walks on Graphs

2012-08-13 Thread Gianmarco De Francisci Morales (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gianmarco De Francisci Morales updated GIRAPH-191: -- Attachment: (was: GIRAPH-191.3.patch) > Random Walks on

[jira] [Updated] (GIRAPH-191) Random Walks on Graphs

2012-08-13 Thread Gianmarco De Francisci Morales (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gianmarco De Francisci Morales updated GIRAPH-191: -- Attachment: (was: PIG-191.1.patch) > Random Walks on Gr

[jira] [Updated] (GIRAPH-191) Random Walks on Graphs

2012-08-13 Thread Gianmarco De Francisci Morales (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gianmarco De Francisci Morales updated GIRAPH-191: -- Attachment: GIRAPH-191.3.patch > Random Walks on Graphs > -

[jira] [Commented] (GIRAPH-191) Random Walks on Graphs

2012-08-13 Thread Gianmarco De Francisci Morales (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433656#comment-13433656 ] Gianmarco De Francisci Morales commented on GIRAPH-191: --- Tried to up

[jira] [Assigned] (GIRAPH-278) Website still tries to load incubator logo

2012-08-13 Thread Eugene Koontz (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koontz reassigned GIRAPH-278: Assignee: Eugene Koontz > Website still tries to load incubator logo >

[jira] [Updated] (GIRAPH-278) Website still tries to load incubator logo

2012-08-13 Thread Eugene Koontz (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koontz updated GIRAPH-278: - Attachment: GIRAPH-278.patch Adds Giraph logo in PNG format. Tested in Firefox, Chrome and Safari

[jira] [Commented] (GIRAPH-278) Website still tries to load incubator logo

2012-08-13 Thread Eugene Koontz (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433831#comment-13433831 ] Eugene Koontz commented on GIRAPH-278: -- Sorry, in SVG format, not PNG format.

[jira] [Commented] (GIRAPH-191) Random Walks on Graphs

2012-08-13 Thread Eugene Koontz (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433850#comment-13433850 ] Eugene Koontz commented on GIRAPH-191: -- Hi Gianmarco, I have the same issues with RB.

[jira] [Commented] (GIRAPH-191) Random Walks on Graphs

2012-08-13 Thread Eugene Koontz (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433852#comment-13433852 ] Eugene Koontz commented on GIRAPH-191: -- Good idea about the automated formatting prof

[jira] [Commented] (GIRAPH-278) Website still tries to load incubator logo

2012-08-13 Thread Eugene Koontz (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433854#comment-13433854 ] Eugene Koontz commented on GIRAPH-278: -- Updated wiki regarding site updates - please