[jira] [Commented] (TEZ-3631) Tez UI: TEZ_DAG_EXTRA_INFO compatibility changes - Makes All DAGs page faster.

2017-04-19 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976169#comment-15976169 ] Harish Jaiprakash commented on TEZ-3631: Thanks [~Sreenath]. Tried out the UI with b

[jira] [Comment Edited] (TEZ-3680) Optimizations to UnorderedPartitionedKVWriter

2017-04-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976157#comment-15976157 ] Rajesh Balamohan edited comment on TEZ-3680 at 4/20/17 6:12 AM: --

[jira] [Updated] (TEZ-3680) Optimizations to UnorderedPartitionedKVWriter

2017-04-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3680: -- Attachment: TEZ-3680.7.patch TezCounter is not threadsafe and update this from multiple threads in

[jira] [Commented] (TEZ-3690) Tez on hadoop 3 build failed due to hdfs client/server jar separation

2017-04-19 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975897#comment-15975897 ] TezQA commented on TEZ-3690: {color:red}-1 overall{color}. Here are the results of testing the

Failed: TEZ-3690 PreCommit Build #2382

2017-04-19 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3690 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2382/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Commented] (TEZ-3690) Tez on hadoop 3 build failed due to hdfs client/server jar separation

2017-04-19 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975886#comment-15975886 ] Junping Du commented on TEZ-3690: - Hi [~sseth], that's a fair point. However, I found in HDF

[jira] [Comment Edited] (TEZ-3689) Change minimum hadoop version to 2.7.0

2017-04-19 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975853#comment-15975853 ] Zhiyuan Yang edited comment on TEZ-3689 at 4/20/17 1:22 AM: Shou

[jira] [Commented] (TEZ-3689) Change minimum hadoop version to 2.7.0

2017-04-19 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975853#comment-15975853 ] Zhiyuan Yang commented on TEZ-3689: --- Should we just remove hadoop-shim-2.4? Also there is

[jira] [Commented] (TEZ-3689) Change minimum hadoop version to 2.7.0

2017-04-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975843#comment-15975843 ] Siddharth Seth commented on TEZ-3689: - The new Javac warnings are expected due to deprec

[jira] [Updated] (TEZ-3690) Tez on hadoop 3 build failed due to hdfs client/server jar separation

2017-04-19 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated TEZ-3690: Attachment: TEZ-3690.patch > Tez on hadoop 3 build failed due to hdfs client/server jar separation > -

[jira] [Commented] (TEZ-3690) Tez on hadoop 3 build failed due to hdfs client/server jar separation

2017-04-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975840#comment-15975840 ] Siddharth Seth commented on TEZ-3690: - Done. [~djp] - wondering if hadoop-hdfs should al

[jira] [Assigned] (TEZ-3690) Tez on hadoop 3 build failed due to hdfs client/server jar separation

2017-04-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reassigned TEZ-3690: --- Assignee: Junping Du > Tez on hadoop 3 build failed due to hdfs client/server jar separation >

[jira] [Commented] (TEZ-3690) Tez on hadoop 3 build failed due to hdfs client/server jar separation

2017-04-19 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975822#comment-15975822 ] Junping Du commented on TEZ-3690: - Can someone add me as contributor? CC [~sseth], [~apluspl

[jira] [Created] (TEZ-3690) Tez on hadoop 3 build failed due to hdfs client/server jar separation

2017-04-19 Thread Junping Du (JIRA)
Junping Du created TEZ-3690: --- Summary: Tez on hadoop 3 build failed due to hdfs client/server jar separation Key: TEZ-3690 URL: https://issues.apache.org/jira/browse/TEZ-3690 Project: Apache Tez I

[jira] [Assigned] (TEZ-3675) Handle changes to ResourceCalculatorProcessTree in YARN-3427 for Hadoop 3.x

2017-04-19 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang reassigned TEZ-3675: - Assignee: Zhiyuan Yang > Handle changes to ResourceCalculatorProcessTree in YARN-3427 for Hadoop 3.

Failed: TEZ-3689 PreCommit Build #2381

2017-04-19 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3689 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2381/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Commented] (TEZ-3689) Change minimum hadoop version to 2.7.0

2017-04-19 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975719#comment-15975719 ] TezQA commented on TEZ-3689: {color:red}-1 overall{color}. Here are the results of testing the

[jira] [Updated] (TEZ-3689) Change minimum hadoop version to 2.7.0

2017-04-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-3689: Attachment: TEZ-3689.01.patch Changed the min version to 2.7.0. Updates BUILDING.txt, README etc. Remo

[jira] [Created] (TEZ-3689) Change minimum hadoop version to 2.7.0

2017-04-19 Thread Siddharth Seth (JIRA)
Siddharth Seth created TEZ-3689: --- Summary: Change minimum hadoop version to 2.7.0 Key: TEZ-3689 URL: https://issues.apache.org/jira/browse/TEZ-3689 Project: Apache Tez Issue Type: Task

[jira] [Commented] (TEZ-3274) Vertex with MRInput and shuffle input does not respect slow start

2017-04-19 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975524#comment-15975524 ] Eric Badger commented on TEZ-3274: -- bq. In what situation does Shuffle and MRInput go toget

[jira] [Commented] (TEZ-3274) Vertex with MRInput and shuffle input does not respect slow start

2017-04-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975492#comment-15975492 ] Siddharth Seth commented on TEZ-3274: - I'm a little confused by what is being changed in

[jira] [Commented] (TEZ-1187) Share Thread pools between different tasks

2017-04-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975483#comment-15975483 ] Siddharth Seth commented on TEZ-1187: - +1. Thanks [~harishjp] > Share Thread pools betw

[jira] [Commented] (TEZ-3680) Optimizations to UnorderedPartitionedKVWriter

2017-04-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975038#comment-15975038 ] Rajesh Balamohan commented on TEZ-3680: --- I agree. There is some flakiness in the test

[jira] [Commented] (TEZ-3631) Tez UI: TEZ_DAG_EXTRA_INFO compatibility changes - Makes All DAGs page faster.

2017-04-19 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975017#comment-15975017 ] TezQA commented on TEZ-3631: {color:green}+1 overall{color}. Here are the results of testing th

Success: TEZ-3631 PreCommit Build #2380

2017-04-19 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3631 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2380/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Commented] (TEZ-3680) Optimizations to UnorderedPartitionedKVWriter

2017-04-19 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15974978#comment-15974978 ] Harish Jaiprakash commented on TEZ-3680: Without the getSpillPathDetails move to cal

[jira] [Updated] (TEZ-3673) Allocate smaller buffers in UnorderedPartitionedKVWriter

2017-04-19 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3673: --- Attachment: TEZ-3673.02.patch * Using configured value for buffer limit instead of 32 mb. * Usin

[jira] [Updated] (TEZ-3631) Tez UI: TEZ_DAG_EXTRA_INFO compatibility changes - Makes All DAGs page faster.

2017-04-19 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram updated TEZ-3631: Attachment: TEZ-3631.1.patch [~harishjp] [~sseth] Please help in reviewing the patch.

[jira] [Updated] (TEZ-3631) Tez UI: TEZ_DAG_EXTRA_INFO compatibility changes - Makes All DAGs page faster.

2017-04-19 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram updated TEZ-3631: Description: TEZ-3611 will be moving dagPlan and counters into a new entity of type T

[jira] [Commented] (TEZ-3274) Vertex with MRInput and shuffle input does not respect slow start

2017-04-19 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15974874#comment-15974874 ] TezQA commented on TEZ-3274: {color:red}-1 overall{color}. Here are the results of testing the

Failed: TEZ-3274 PreCommit Build #2379

2017-04-19 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3274 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2379/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Commented] (TEZ-1187) Share Thread pools between different tasks

2017-04-19 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15974718#comment-15974718 ] TezQA commented on TEZ-1187: {color:green}+1 overall{color}. Here are the results of testing th

Success: TEZ-1187 PreCommit Build #2378

2017-04-19 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-1187 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2378/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Updated] (TEZ-3274) Vertex with MRInput and shuffle input does not respect slow start

2017-04-19 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3274: - Attachment: TEZ-3274.003.patch Attaching new patch that only adds the root vertex functionality to {{Shuffl

[jira] [Commented] (TEZ-3616) TestMergeManager#testLocalDiskMergeMultipleTasks fails intermittently

2017-04-19 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15974626#comment-15974626 ] Fei Hui commented on TEZ-3616: -- ping [~harishjp] again > TestMergeManager#testLocalDiskMergeMu

[jira] [Updated] (TEZ-1187) Share Thread pools between different tasks

2017-04-19 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-1187: --- Attachment: TEZ-1187.09.patch Fixed javac warnings introduced because of deprecated constructor.

[jira] [Commented] (TEZ-1187) Share Thread pools between different tasks

2017-04-19 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15974459#comment-15974459 ] TezQA commented on TEZ-1187: {color:red}-1 overall{color}. Here are the results of testing the

Failed: TEZ-1187 PreCommit Build #2377

2017-04-19 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-1187 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2377/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Commented] (TEZ-3688) Add analyzer to provide the set of machines that participated in the vertex and the number of tasks that ran on that node

2017-04-19 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15974441#comment-15974441 ] TezQA commented on TEZ-3688: {color:red}-1 overall{color}. Here are the results of testing the

Failed: TEZ-3688 PreCommit Build #2376

2017-04-19 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3688 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2376/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Updated] (TEZ-1187) Share Thread pools between different tasks

2017-04-19 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-1187: --- Attachment: TEZ-1187.08.patch * Changed default to -1 and using it to configure for Integer.MAX_

[jira] [Updated] (TEZ-3688) Add analyzer to provide the set of machines that participated in the vertex and the number of tasks that ran on that node

2017-04-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3688: -- Attachment: TEZ-3688.2.patch Attaching .2 version with additional 2 metrics. "firstTaskToLastTas

[jira] [Commented] (TEZ-3688) Add analyzer to provide the set of machines that participated in the vertex and the number of tasks that ran on that node

2017-04-19 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15974335#comment-15974335 ] TezQA commented on TEZ-3688: {color:red}-1 overall{color}. Here are the results of testing the

Failed: TEZ-3688 PreCommit Build #2375

2017-04-19 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3688 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2375/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Updated] (TEZ-3688) Add analyzer to provide the set of machines that participated in the vertex and the number of tasks that ran on that node

2017-04-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3688: -- Attachment: TEZ-3688.1.patch Attaching .1 patch for review. For every vertex, it provides "verte