[jira] [Commented] (TEZ-3647) Lower default Xmx for small AM container

2017-03-02 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15893685#comment-15893685 ] TezQA commented on TEZ-3647: {color:green}+1 overall{color}. Here are the results of testing the latest

Success: TEZ-3647 PreCommit Build #2292

2017-03-02 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3647 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2292/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3647) Lower default Xmx for small AM container

2017-03-02 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15893650#comment-15893650 ] Siddharth Seth commented on TEZ-3647: - - Why do we need a separate method in AMContainerHelpers. The

[jira] [Updated] (TEZ-3647) Lower default Xmx for small AM container

2017-03-02 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated TEZ-3647: -- Attachment: TEZ-3647.2.patch Upload new patch to address comments. [~sseth] > Lower default Xmx for

[jira] [Commented] (TEZ-3647) Lower default Xmx for small AM container

2017-03-02 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15893568#comment-15893568 ] TezQA commented on TEZ-3647: {color:green}+1 overall{color}. Here are the results of testing the latest

[jira] [Commented] (TEZ-3647) Lower default Xmx for small AM container

2017-03-02 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15893531#comment-15893531 ] Siddharth Seth commented on TEZ-3647: - [~aplusplus] - can we change this to work based on the old config

[jira] [Updated] (TEZ-3647) Lower default Xmx for small AM container

2017-03-02 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated TEZ-3647: -- Description: The default Xmx is 80% of container size. For a 2G container, non-heap memory can cost more

[jira] [Comment Edited] (TEZ-3647) Lower default Xmx for small AM container

2017-03-02 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15893377#comment-15893377 ] Zhiyuan Yang edited comment on TEZ-3647 at 3/3/17 12:31 AM: This patch let Tez

[jira] [Updated] (TEZ-3647) Lower default Xmx for small AM container

2017-03-02 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated TEZ-3647: -- Attachment: TEZ-3647.1.patch This patch let Tez auto determine AM container size. The policy is like slab

[jira] [Updated] (TEZ-3644) Cleanup container list stored in AMNode

2017-03-02 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-3644: Attachment: TEZ-3644.02.patch Updated patch. Fixed the imports. Also modified one log line in

[jira] [Commented] (TEZ-3642) Tez UI: Auto-refresh is not stopping when DAG is the main entity

2017-03-02 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15893264#comment-15893264 ] TezQA commented on TEZ-3642: {color:green}+1 overall{color}. Here are the results of testing the latest

Success: TEZ-3642 PreCommit Build #2290

2017-03-02 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3642 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2290/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3644) Cleanup container list stored in AMNode

2017-03-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15893203#comment-15893203 ] Rajesh Balamohan commented on TEZ-3644: --- lgtm. +1. Please cleanup imports in {{TestAMContainer}}

[jira] [Commented] (TEZ-3647) Lower default Xmx for small AM container

2017-03-02 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15893154#comment-15893154 ] Zhiyuan Yang commented on TEZ-3647: --- The off-heap memory is quite stable (except that 'Internal' section

[jira] [Created] (TEZ-3647) Lower default Xmx for small AM container

2017-03-02 Thread Zhiyuan Yang (JIRA)
Zhiyuan Yang created TEZ-3647: - Summary: Lower default Xmx for small AM container Key: TEZ-3647 URL: https://issues.apache.org/jira/browse/TEZ-3647 Project: Apache Tez Issue Type: Bug

[jira] [Updated] (TEZ-3642) Tez UI: Auto-refresh is not stopping when DAG is the main entity

2017-03-02 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram updated TEZ-3642: Attachment: TEZ-3642.1.patch [~sseth] Please help in review. > Tez UI: Auto-refresh

[jira] [Commented] (TEZ-3645) Reuse SerializationFactory while sorting, merging, and writing IFiles

2017-03-02 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15892732#comment-15892732 ] TezQA commented on TEZ-3645: {color:green}+1 overall{color}. Here are the results of testing the latest

Success: TEZ-3645 PreCommit Build #2289

2017-03-02 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3645 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2289/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Updated] (TEZ-3645) Reuse SerializationFactory while sorting, merging, and writing IFiles

2017-03-02 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3645: - Attachment: TEZ-3645.2.patch > Reuse SerializationFactory while sorting, merging, and writing

[jira] [Updated] (TEZ-3646) IFile.Writer has an extra output stream flush call

2017-03-02 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3646: - Attachment: (was: TEZ-3546.1.patch) > IFile.Writer has an extra output stream flush call >

[jira] [Updated] (TEZ-3646) IFile.Writer has an extra output stream flush call

2017-03-02 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3646: - Attachment: TEZ-3646.1.patch > IFile.Writer has an extra output stream flush call >

[jira] [Commented] (TEZ-3646) IFile.Writer has an extra output stream flush call

2017-03-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15892445#comment-15892445 ] Rajesh Balamohan commented on TEZ-3646: --- Thanks for sharing the patch [~jeagles]. Patch lgtm. +1. >