[
https://issues.apache.org/jira/browse/CRUNCH-458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091837#comment-14091837
]
Josh Wills commented on CRUNCH-458:
-----------------------------------
[~gabriel.reid] on the TreeSet-- what would the comparator be? I wasn't sure if
the depth comparator was the right way to ensure stability.
> Eliminate potentially random MR split-point decisions
> -----------------------------------------------------
>
> Key: CRUNCH-458
> URL: https://issues.apache.org/jira/browse/CRUNCH-458
> Project: Crunch
> Issue Type: Bug
> Reporter: Josh Wills
> Attachments: CRUNCH-458.patch
>
>
> I'm running into a pipeline in which the decision of where to split two
> dependent jobs seems to be random from run-to-run (I only noticed it b/c one
> of the runs causes the pipeline to throw an NPE, and the other does not.) I'd
> like to investigate this and try to eliminate any potential sources of
> randomness in the way that two dependent GBK operations are split.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
