[jira] [Resolved] (GIRAPH-1134) Track number of input splits in command line
[ https://issues.apache.org/jira/browse/GIRAPH-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maja Kabiljo resolved GIRAPH-1134. -- Resolution: Fixed > Track number of input splits in command line > > > Key: GIRAPH-1134 > URL: https://issues.apache.org/jira/browse/GIRAPH-1134 > Project: Giraph > Issue Type: Improvement >Reporter: Maja Kabiljo >Assignee: Maja Kabiljo >Priority: Minor > > The progress we track during input reports how much data have we read, but > not how much data there is to read. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Resolved] (GIRAPH-1141) Kill the job if no progress is being made
[ https://issues.apache.org/jira/browse/GIRAPH-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maja Kabiljo resolved GIRAPH-1141. -- Resolution: Fixed > Kill the job if no progress is being made > - > > Key: GIRAPH-1141 > URL: https://issues.apache.org/jira/browse/GIRAPH-1141 > Project: Giraph > Issue Type: New Feature >Reporter: Maja Kabiljo >Assignee: Maja Kabiljo >Priority: Minor > > Sometimes jobs can get stuck for various reasons, it's better to have an > option to kill them then to keep them running holding resources. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Resolved] (GIRAPH-1140) Cleanup temp files in hdfs after job is done
[ https://issues.apache.org/jira/browse/GIRAPH-1140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maja Kabiljo resolved GIRAPH-1140. -- Resolution: Fixed > Cleanup temp files in hdfs after job is done > > > Key: GIRAPH-1140 > URL: https://issues.apache.org/jira/browse/GIRAPH-1140 > Project: Giraph > Issue Type: Bug >Reporter: Maja Kabiljo >Assignee: Maja Kabiljo > > Currently we are not cleaning up temp files we create in hdfs, fix it. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Resolved] (GIRAPH-1133) Fix JobProgressTracker in OverrideExceptionHandler
[ https://issues.apache.org/jira/browse/GIRAPH-1133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maja Kabiljo resolved GIRAPH-1133. -- Resolution: Fixed > Fix JobProgressTracker in OverrideExceptionHandler > -- > > Key: GIRAPH-1133 > URL: https://issues.apache.org/jira/browse/GIRAPH-1133 > Project: Giraph > Issue Type: Bug >Reporter: Maja Kabiljo >Assignee: Maja Kabiljo >Priority: Minor > > We create OverrideExceptionHandler before JobProgressTracker, so it can't > report errors to command line. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (GIRAPH-1146) Keep track of number of supersteps when possible
Maja Kabiljo created GIRAPH-1146: Summary: Keep track of number of supersteps when possible Key: GIRAPH-1146 URL: https://issues.apache.org/jira/browse/GIRAPH-1146 Project: Giraph Issue Type: New Feature Reporter: Maja Kabiljo Assignee: Maja Kabiljo Priority: Minor In many cases we know how many supersteps are there going to be. We can keep track of it and log it with progress. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (GIRAPH-1146) Keep track of number of supersteps when possible
[ https://issues.apache.org/jira/browse/GIRAPH-1146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997364#comment-15997364 ] ASF GitHub Bot commented on GIRAPH-1146: GitHub user majakabiljo opened a pull request: https://github.com/apache/giraph/pull/36 GIRAPH-1146: Keep track of number of supersteps when possible Summary: In many cases we know how many supersteps are there going to be. We can keep track of it and log it with progress. Test Plan: Ran a job, example log line: Data from 3 workers - Compute superstep 5 (out of 6): 171824 out of 1304814 vertices computed; 19 out of 252 partitions computed You can merge this pull request into a Git repository by running: $ git pull https://github.com/majakabiljo/giraph numSupersteps Alternatively you can review and apply these changes as the patch at: https://github.com/apache/giraph/pull/36.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #36 commit 4a4d69b674d327f3cd092036a7e3fec4ffb4c2ce Author: Maja Kabiljo Date: 2017-05-04T20:07:22Z GIRAPH-1146: Keep track of number of supersteps when possible Summary: In many cases we know how many supersteps are there going to be. We can keep track of it and log it with progress. Test Plan: Ran a job, example log line: Data from 3 workers - Compute superstep 5 (out of 6): 171824 out of 1304814 vertices computed; 19 out of 252 partitions computed > Keep track of number of supersteps when possible > > > Key: GIRAPH-1146 > URL: https://issues.apache.org/jira/browse/GIRAPH-1146 > Project: Giraph > Issue Type: New Feature >Reporter: Maja Kabiljo >Assignee: Maja Kabiljo >Priority: Minor > > In many cases we know how many supersteps are there going to be. We can keep > track of it and log it with progress. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (GIRAPH-1138) Don't wrap exceptions from executor service
[ https://issues.apache.org/jira/browse/GIRAPH-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997373#comment-15997373 ] ASF GitHub Bot commented on GIRAPH-1138: GitHub user majakabiljo opened a pull request: https://github.com/apache/giraph/pull/37 [GIRAPH-1138] Don't wrap exceptions from executor service Summary: In ProgressableUtils.getResultsWithNCallables we wrap exceptions from underlying threads, making logs hard to read. We should re-throw original exception when possible. (accidentally closed #27) Test Plan: Ran a job which fails in one of input threads before and after change, verified exception is clear now You can merge this pull request into a Git repository by running: $ git pull https://github.com/majakabiljo/giraph exceptions2 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/giraph/pull/37.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #37 commit c859833de5a28e580b38dc46a8b371cd82b6b6d0 Author: Maja Kabiljo Date: 2017-05-04T20:15:44Z [GIRAPH-1138] Don't wrap exceptions from executor service Summary: In ProgressableUtils.getResultsWithNCallables we wrap exceptions from underlying threads, making logs hard to read. We should re-throw original exception when possible. (accidentally closed #27) Test Plan: Ran a job which fails in one of input threads before and after change, verified exception is clear now > Don't wrap exceptions from executor service > --- > > Key: GIRAPH-1138 > URL: https://issues.apache.org/jira/browse/GIRAPH-1138 > Project: Giraph > Issue Type: Improvement >Reporter: Maja Kabiljo >Assignee: Maja Kabiljo >Priority: Minor > > In ProgressableUtils.getResultsWithNCallables we wrap exceptions from > underlying threads, making logs hard to read. We should re-throw original > exception when possible. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
