[jira] [Updated] (TEZ-1528) Native support for multi cluster aggregations

2014-08-31 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated TEZ-1528: --- Description: Increasingly, data-sets are partitioned across clusters due to legal or operational consid

[jira] [Created] (TEZ-1528) Native support for multi cluster aggregations

2014-08-31 Thread Arun C Murthy (JIRA)
Arun C Murthy created TEZ-1528: -- Summary: Native support for multi cluster aggregations Key: TEZ-1528 URL: https://issues.apache.org/jira/browse/TEZ-1528 Project: Apache Tez Issue Type: New Feat

[jira] [Commented] (TEZ-1476) DAGClient waitForCompletion output is confusing

2014-08-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14117079#comment-14117079 ] Jeff Zhang commented on TEZ-1476: - [~seth.siddha...@gmail.com] After checking again, found a

[jira] [Updated] (TEZ-1527) Improvement on waitForCompletion API

2014-08-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1527: Description: After [TEZ-1476|https://issues.apache.org/jira/browse/TEZ-1476], the waitForCompletion API has s

[jira] [Updated] (TEZ-1527) Improvement on waitForCompletion API

2014-08-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1527: Description: After [TEZ-1476|https://issues.apache.org/jira/browse/TEZ-1476], the waitForCompletion API has s

[jira] [Created] (TEZ-1527) Improvement on waitForCompletion API

2014-08-31 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-1527: --- Summary: Improvement on waitForCompletion API Key: TEZ-1527 URL: https://issues.apache.org/jira/browse/TEZ-1527 Project: Apache Tez Issue Type: Bug Reporte

[jira] [Commented] (TEZ-1526) LoadingCache for TezTaskID slow for large jobs

2014-08-31 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14117060#comment-14117060 ] Siddharth Seth commented on TEZ-1526: - [~jeagles] - the loading cache was used to avoid

[jira] [Commented] (TEZ-1476) DAGClient waitForCompletion output is confusing

2014-08-31 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14117058#comment-14117058 ] Siddharth Seth commented on TEZ-1476: - [~zjffdu] - there's two APIs on DAGClient which c

[jira] [Updated] (TEZ-1526) LoadingCache for TezTaskID slow for large jobs

2014-08-31 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-1526: - Attachment: TEZ-1526-v1.patch Attaching a naive patch that completely removes the LoadingCache. > L

[jira] [Commented] (TEZ-1526) LoadingCache for TezTaskID slow for large jobs

2014-08-31 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14117048#comment-14117048 ] Jonathan Eagles commented on TEZ-1526: -- One question I have is what solution the Loadin

[jira] [Updated] (TEZ-1526) LoadingCache for TezTaskID slow for large jobs

2014-08-31 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-1526: - Description: Using the LoadingCache with default builder settings. 100,000 TezTaskIDs are created in

[jira] [Updated] (TEZ-1526) LoadCache for TezTaskID slow for large jobs

2014-08-31 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-1526: - Attachment: 10-TezTaskIDs.patch > LoadCache for TezTaskID slow for large jobs >

[jira] [Updated] (TEZ-1526) LoadingCache for TezTaskID slow for large jobs

2014-08-31 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-1526: - Summary: LoadingCache for TezTaskID slow for large jobs (was: LoadCache for TezTaskID slow for larg

[jira] [Created] (TEZ-1526) LoadCache for TezTaskID slow for large jobs

2014-08-31 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created TEZ-1526: Summary: LoadCache for TezTaskID slow for large jobs Key: TEZ-1526 URL: https://issues.apache.org/jira/browse/TEZ-1526 Project: Apache Tez Issue Type: Improv

[jira] [Updated] (TEZ-1522) ShuffleVertexManager scheduling can result in out of order execution and slowdown of upstream work

2014-08-31 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-1522: -- Attachment: TEZ-1522.am.log.gz Attaching AppMaster log. > ShuffleVertexManager scheduling can res

[jira] [Commented] (TEZ-1522) ShuffleVertexManager scheduling can result in out of order execution and slowdown of upstream work

2014-08-31 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14116694#comment-14116694 ] Rajesh Balamohan commented on TEZ-1522: --- > In the example job, did R3 get scheduled af

[jira] [Commented] (TEZ-1515) DAGAppMaster : Thread contentions due to org.apache.tez.common.counters.ResourceBundles

2014-08-31 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14116683#comment-14116683 ] Rajesh Balamohan commented on TEZ-1515: --- Some issue with local git setup; it didn't pu