[jira] [Created] (TEZ-3698) UnorderedKV writer should be able to honor tez.runtime.enable.final-merge.in.output without pipelinedshuffle

2017-04-24 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created TEZ-3698: - Summary: UnorderedKV writer should be able to honor tez.runtime.enable.final-merge.in.output without pipelinedshuffle Key: TEZ-3698 URL: https://issues.apache.org/jira/browse/TE

[jira] [Commented] (TEZ-3695) TestTezSharedExecutor fails sporadically

2017-04-24 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15982196#comment-15982196 ] Harish Jaiprakash commented on TEZ-3695: +1 for the changes. Thank [~jlowe] for find

[jira] [Commented] (TEZ-2049) Remove YARN references from Tez AsyncDispatcher

2017-04-24 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15982145#comment-15982145 ] Zhiyuan Yang commented on TEZ-2049: --- Thanks [~sseth]! Patch committed. {noformat} commit

[jira] [Commented] (TEZ-2049) Remove YARN references from Tez AsyncDispatcher

2017-04-24 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15982130#comment-15982130 ] Siddharth Seth commented on TEZ-2049: - +1 > Remove YARN references from Tez AsyncDispat

[jira] [Updated] (TEZ-3690) Tez on hadoop 3 build failed due to hdfs client/server jar separation

2017-04-24 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated TEZ-3690: -- Attachment: TEZ-3690.addendum.patch Upload addendum patch to remove hadoop-hdfs dependency in 2.8 profile.

[jira] [Commented] (TEZ-3685) ShuffleHandler completedInputSet off-by-one error

2017-04-24 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15982112#comment-15982112 ] Siddharth Seth commented on TEZ-3685: - [~jeagles] - not sure if you're waiting for a rev

[jira] [Updated] (TEZ-2049) Remove YARN references from Tez AsyncDispatcher

2017-04-24 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated TEZ-2049: -- Attachment: TEZ-2049.4.patch Upload new patch to keep original default behavior. > Remove YARN references

[jira] [Commented] (TEZ-3694) Adopt YARN-5007 in MiniTezCluster

2017-04-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15982074#comment-15982074 ] Junping Du commented on TEZ-3694: - I think previous constructor of MiniYARNCluster get depre

[jira] [Commented] (TEZ-3694) Adopt YARN-5007 in MiniTezCluster

2017-04-24 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15982025#comment-15982025 ] Siddharth Seth commented on TEZ-3694: - Why is that? conf.setBoolean(YarnConfiguration.TI

[jira] [Updated] (TEZ-2049) Remove YARN references from Tez AsyncDispatcher

2017-04-24 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated TEZ-2049: -- Attachment: TEZ-2049.3.patch Fixed TestDAGImpl test failure in new patch. > Remove YARN references from T

[jira] [Commented] (TEZ-3694) Adopt YARN-5007 in MiniTezCluster

2017-04-24 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15981949#comment-15981949 ] Zhiyuan Yang commented on TEZ-3694: --- Previous patch is incorrect. It's pretty hard to fix

[jira] [Comment Edited] (TEZ-3694) Adopt YARN-5007 in MiniTezCluster

2017-04-24 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15981949#comment-15981949 ] Zhiyuan Yang edited comment on TEZ-3694 at 4/24/17 9:28 PM: Prev

[jira] [Commented] (TEZ-2049) Remove YARN references from Tez AsyncDispatcher

2017-04-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15981940#comment-15981940 ] Junping Du commented on TEZ-2049: - v2 patch LGTM. [~sseth], would you take a look? Thx! > R

[jira] [Updated] (TEZ-2049) Remove YARN references from Tez AsyncDispatcher

2017-04-24 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated TEZ-2049: -- Attachment: TEZ-2049.2.patch Thanks [~djp] for review! Bug fixed in new patch. > Remove YARN references f

[jira] [Updated] (TEZ-3697) Adding #output_record in vertex manager event payload

2017-04-24 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated TEZ-3697: -- Attachment: TEZ-3697.1.patch > Adding #output_record in vertex manager event payload > ---

Success: TEZ-3695 PreCommit Build #2390

2017-04-24 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3695 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2390/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Commented] (TEZ-3695) TestTezSharedExecutor fails sporadically

2017-04-24 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15981842#comment-15981842 ] TezQA commented on TEZ-3695: {color:green}+1 overall{color}. Here are the results of testing th

[jira] [Created] (TEZ-3697) Adding #output_record in vertex manager event payload

2017-04-24 Thread Zhiyuan Yang (JIRA)
Zhiyuan Yang created TEZ-3697: - Summary: Adding #output_record in vertex manager event payload Key: TEZ-3697 URL: https://issues.apache.org/jira/browse/TEZ-3697 Project: Apache Tez Issue Type: Bu

[jira] [Created] (TEZ-3696) Jobs can hang when both concurrency and speculation are enabled

2017-04-24 Thread Eric Badger (JIRA)
Eric Badger created TEZ-3696: Summary: Jobs can hang when both concurrency and speculation are enabled Key: TEZ-3696 URL: https://issues.apache.org/jira/browse/TEZ-3696 Project: Apache Tez Issue

[jira] [Commented] (TEZ-3690) Tez on hadoop 3 build failed due to hdfs client/server jar separation

2017-04-24 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15981624#comment-15981624 ] Siddharth Seth commented on TEZ-3690: - Can we remove the hadoop-hdfs dependency in the 2

[jira] [Commented] (TEZ-3694) Adopt YARN-5007 in MiniTezCluster

2017-04-24 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15981616#comment-15981616 ] Siddharth Seth commented on TEZ-3694: - +1, subject to precommit. > Adopt YARN-5007 in M

[jira] [Comment Edited] (TEZ-2049) Remove YARN references from Tez AsyncDispatcher

2017-04-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15981568#comment-15981568 ] Junping Du edited comment on TEZ-2049 at 4/24/17 5:47 PM: -- Thanks [

[jira] [Commented] (TEZ-2049) Remove YARN references from Tez AsyncDispatcher

2017-04-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15981568#comment-15981568 ] Junping Du commented on TEZ-2049: - Thanks [~aplusplus] for reporting the issue and deliverin

[jira] [Commented] (TEZ-3694) Adopt YARN-5007 in MiniTezCluster

2017-04-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15981556#comment-15981556 ] Junping Du commented on TEZ-3694: - +1. (no-binding) > Adopt YARN-5007 in MiniTezCluster > -

[jira] [Assigned] (TEZ-3695) TestTezSharedExecutor fails sporadically

2017-04-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned TEZ-3695: --- Assignee: Jason Lowe Affects Version/s: 0.9.0 Target Version/s: 0.9.0 > TestTezShared

[jira] [Updated] (TEZ-3695) TestTezSharedExecutor fails sporadically

2017-04-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated TEZ-3695: Attachment: TEZ-3695.001.patch Patch that uses a latch instead of the racy {{wait}}/{{notify}} pair. I also

[jira] [Commented] (TEZ-3695) TestTezSharedExecutor fails sporadically

2017-04-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15981188#comment-15981188 ] Jason Lowe commented on TEZ-3695: - {{testAwaitTermination}} looks like it could have similar

[jira] [Commented] (TEZ-3695) TestTezSharedExecutor fails sporadically

2017-04-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15981184#comment-15981184 ] Jason Lowe commented on TEZ-3695: - Looks like the test has an inherent race in it: {code}

[jira] [Created] (TEZ-3695) TestTezSharedExecutor fails sporadically

2017-04-24 Thread Jason Lowe (JIRA)
Jason Lowe created TEZ-3695: --- Summary: TestTezSharedExecutor fails sporadically Key: TEZ-3695 URL: https://issues.apache.org/jira/browse/TEZ-3695 Project: Apache Tez Issue Type: Bug Rep