[
https://issues.apache.org/jira/browse/TEZ-1083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14109453#comment-14109453
]
Gopal V commented on TEZ-1083:
------------------------------
This looks alright - this just needs a roll-over check for the sameKey long
variable.
The worst-case value for that is near O(n^2), so it might overflow before
totalKeys does.
For performance, it can be assumed that if sameKeys is < 0, isRLENeeded == true
- instead of checking within the loop.
> Enable IFile RLE for DefaultSorter
> ----------------------------------
>
> Key: TEZ-1083
> URL: https://issues.apache.org/jira/browse/TEZ-1083
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Siddharth Seth
> Assignee: Gopal V
> Attachments: TEZ-1083.1.patch
>
>
> Generate RLE IFiles for DefaultSorter and use it to fast-forward map-side
> merge.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
