[jira] [Commented] (TEZ-3709) TezMerger is slow for high number of segments

[ https://issues.apache.org/jira/browse/TEZ-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16012451#comment-16012451 ] Rajesh Balamohan commented on TEZ-3709: --- Checked the patch. LGTM. +1. Corner case: For

[jira] [Commented] (TEZ-3709) TezMerger is slow for high number of segments

[ https://issues.apache.org/jira/browse/TEZ-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011929#comment-16011929 ] Rajesh Balamohan commented on TEZ-3709: --- Sorry about the delay. Will review it today. > TezMerger is

[jira] [Commented] (TEZ-3709) TezMerger is slow for high number of segments

[ https://issues.apache.org/jira/browse/TEZ-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011765#comment-16011765 ] Jonathan Eagles commented on TEZ-3709: -- [~rajesh.balamohan], can you give a review on this patch? I am

[jira] [Commented] (TEZ-3709) TezMerger is slow for high number of segments

[ https://issues.apache.org/jira/browse/TEZ-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001373#comment-16001373 ] Jonathan Eagles commented on TEZ-3709: -- Thanks for the feedback, [~rajesh.balamohan]. For some

[jira] [Commented] (TEZ-3709) TezMerger is slow for high number of segments

[ https://issues.apache.org/jira/browse/TEZ-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16000597#comment-16000597 ] Rajesh Balamohan commented on TEZ-3709: --- Patch .3 considerably reduces the time as it ends up using

[jira] [Commented] (TEZ-3709) TezMerger is slow for high number of segments

[ https://issues.apache.org/jira/browse/TEZ-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997652#comment-15997652 ] TezQA commented on TEZ-3709: {color:red}-1 overall{color}. Here are the results of testing the latest

[jira] [Commented] (TEZ-3709) TezMerger is slow for high number of segments

[ https://issues.apache.org/jira/browse/TEZ-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997577#comment-15997577 ] Jonathan Eagles commented on TEZ-3709: -- [~rajesh.balamohan], found one more example of remove(0) in

[jira] [Commented] (TEZ-3709) TezMerger is slow for high number of segments

[ https://issues.apache.org/jira/browse/TEZ-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997166#comment-15997166 ] Jonathan Eagles commented on TEZ-3709: -- [~rajesh.balamohan], can you have a detailed look at the v2

[jira] [Commented] (TEZ-3709) TezMerger is slow for high number of segments

[ https://issues.apache.org/jira/browse/TEZ-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997142#comment-15997142 ] TezQA commented on TEZ-3709: {color:red}-1 overall{color}. Here are the results of testing the latest

[jira] [Commented] (TEZ-3709) TezMerger is slow for high number of segments

[ https://issues.apache.org/jira/browse/TEZ-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15995942#comment-15995942 ] TezQA commented on TEZ-3709: {color:red}-1 overall{color}. Here are the results of testing the latest

[jira] [Commented] (TEZ-3709) TezMerger is slow for high number of segments

[ https://issues.apache.org/jira/browse/TEZ-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15995920#comment-15995920 ] Rajesh Balamohan commented on TEZ-3709: --- Thanks for sharing the patch [~jeagles]. Patch lgtm. +1.

[jira] [Commented] (TEZ-3709) TezMerger is slow for high number of segments

[ https://issues.apache.org/jira/browse/TEZ-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15995850#comment-15995850 ] Jonathan Eagles commented on TEZ-3709: -- Example performance gains | task attempt | duration w/o patch