[
https://issues.apache.org/jira/browse/TINKERPOP-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15605725#comment-15605725
]
ASF GitHub Bot commented on TINKERPOP-1525:
-------------------------------------------
Github user dalaro commented on the issue:
https://github.com/apache/tinkerpop/pull/462
Marko's right, I wrote and tested this against TINKERPOP-1389 (before the
latest rebase), then cherry-picked against current master without retesting.
Sorry about that. He's also right about the Iterator/Iterable change. I'll
change it sometime today, force-push the branch, and comment.
> Plug VertexProgram iteration leak on empty Spark RDD partitions
> ---------------------------------------------------------------
>
> Key: TINKERPOP-1525
> URL: https://issues.apache.org/jira/browse/TINKERPOP-1525
> Project: TinkerPop
> Issue Type: Bug
> Components: hadoop
> Affects Versions: 3.2.3
> Reporter: Dan LaRocque
>
> If SparkExecutor gets an RDD with empty partitions, it can invoke
> {{VertexProgram.workerIterationStart}} without ever invoking
> {{VertexProgram.workerIterationEnd}}.
> For vertex programs that allocate and release meaningful resources in the
> start/end methods, this can lead to resource leaks.
> I already tested a fix that I made against the 3.2 series. I will submit PRs
> momentarily.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
