[jira] [Commented] (TEZ-3673) Allocate smaller buffers in UnorderedPartitionedKVWriter

2017-04-25 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15984199#comment-15984199 ] Harish Jaiprakash commented on TEZ-3673: Thanks [~sseth]. Changed it to percentage, sorry I did not

[jira] [Updated] (TEZ-3699) For large dataset, pipelined shuffle throws exceptions in consumer side for UnorderedPartitioned edge

2017-04-25 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3699: -- Description: {noformat} 2017-04-25 21:16:18,179 [INFO] [Fetcher_B {Map_1} #1]

[jira] [Commented] (TEZ-3699) For large dataset, pipelined shuffle throws exceptions in consumer side for UnorderedPartitioned edge

2017-04-25 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15984171#comment-15984171 ] Rajesh Balamohan commented on TEZ-3699: --- E.g test query in hive which can simulate this. Add this

[jira] [Created] (TEZ-3699) For large dataset, pipelined shuffle throws exceptions in consumer side for UnorderedPartitioned edge

2017-04-25 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created TEZ-3699: - Summary: For large dataset, pipelined shuffle throws exceptions in consumer side for UnorderedPartitioned edge Key: TEZ-3699 URL: https://issues.apache.org/jira/browse/TEZ-3699

[jira] [Commented] (TEZ-3697) Adding #output_record in vertex manager event payload

2017-04-25 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15983988#comment-15983988 ] TezQA commented on TEZ-3697: {color:red}-1 overall{color}. Here are the results of testing the latest

Failed: TEZ-3697 PreCommit Build #2392

2017-04-25 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3697 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2392/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3673) Allocate smaller buffers in UnorderedPartitionedKVWriter

2017-04-25 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15983850#comment-15983850 ] Siddharth Seth commented on TEZ-3673: - bq. TEZ_RUNTIME_UNORDERED_PARTITIONED_KVWRITER_BUFFER_PARTS Think

[jira] [Commented] (TEZ-3697) Adding #output_record in vertex manager event payload

2017-04-25 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15983716#comment-15983716 ] Zhiyuan Yang commented on TEZ-3697: --- [~sseth] Sure. For now it should be impossible for a destination

[jira] [Commented] (TEZ-3697) Adding #output_record in vertex manager event payload

2017-04-25 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15983702#comment-15983702 ] Siddharth Seth commented on TEZ-3697: - [~aplusplus] - can you please add tests for this? Assuming

[jira] [Resolved] (TEZ-3685) ShuffleHandler completedInputSet off-by-one error

2017-04-25 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles resolved TEZ-3685. -- Resolution: Fixed Fix Version/s: TEZ-3334 > ShuffleHandler completedInputSet off-by-one

[jira] [Commented] (TEZ-3685) ShuffleHandler completedInputSet off-by-one error

2017-04-25 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15983558#comment-15983558 ] Jonathan Eagles commented on TEZ-3685: -- I'll commit this to the feature branch and then we can look in

[jira] [Commented] (TEZ-3690) Tez on hadoop 3 build failed due to hdfs client/server jar separation

2017-04-25 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15983417#comment-15983417 ] Siddharth Seth commented on TEZ-3690: - +1 for the addendum. Thanks [~aplusplus] > Tez on hadoop 3 build

[jira] [Commented] (TEZ-3698) UnorderedKV writer should be able to honor tez.runtime.enable.final-merge.in.output without pipelinedshuffle

2017-04-25 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15982731#comment-15982731 ] TezQA commented on TEZ-3698: {color:red}-1 overall{color}. Here are the results of testing the latest

Failed: TEZ-3698 PreCommit Build #2391

2017-04-25 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3698 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2391/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Assigned] (TEZ-3698) UnorderedKV writer should be able to honor tez.runtime.enable.final-merge.in.output without pipelinedshuffle

2017-04-25 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned TEZ-3698: - Assignee: Rajesh Balamohan > UnorderedKV writer should be able to honor >

[jira] [Updated] (TEZ-3698) UnorderedKV writer should be able to honor tez.runtime.enable.final-merge.in.output without pipelinedshuffle

2017-04-25 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3698: -- Attachment: TEZ-3698.1.patch > UnorderedKV writer should be able to honor >