[jira] [Commented] (TEZ-3754) With large ordered fetches, stalling shuffle could lead to slowdown of job

2017-07-10 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081281#comment-16081281 ] Rajesh Balamohan commented on TEZ-3754: --- Agreed that this would block the cases which could have

[jira] [Commented] (TEZ-3791) Failed/Killed task can throw InvalidStateTransitonException when a new attempt is launched

2017-07-10 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081231#comment-16081231 ] Kuhu Shukla commented on TEZ-3791: -- [~jeagles], request for any review/comments on the patch. Thanks a lot!

Success: TEZ-3791 PreCommit Build #2568

2017-07-10 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3791 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2568/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3791) Failed/Killed task can throw InvalidStateTransitonException when a new attempt is launched

2017-07-10 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081221#comment-16081221 ] TezQA commented on TEZ-3791: {color:green}+1 overall{color}. Here are the results of testing the latest

[jira] [Commented] (TEZ-3772) Allow slowstart for small vertices to be treated differently

2017-07-10 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081131#comment-16081131 ] Siddharth Seth commented on TEZ-3772: - The case of 1 downstream reducer should have already been

[jira] [Commented] (TEZ-3780) Fix ADDITIONAL_SPILLS_BYTES_WRITTEN counter in unordered case

2017-07-10 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081114#comment-16081114 ] Zhiyuan Yang commented on TEZ-3780: --- [~sseth] It's just inconsistency between docs and its real usage. >

[jira] [Commented] (TEZ-3780) Fix ADDITIONAL_SPILLS_BYTES_WRITTEN counter in unordered case

2017-07-10 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081110#comment-16081110 ] Siddharth Seth commented on TEZ-3780: - What needs to be changed with the counter? > Fix

[jira] [Commented] (TEZ-3791) Failed/Killed task can throw InvalidStateTransitonException when a new attempt is launched

2017-07-10 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081099#comment-16081099 ] Kuhu Shukla commented on TEZ-3791: -- {code} 2017-07-10 15:30:18,607 ERROR [Thread-1] impl.TaskImpl

[jira] [Updated] (TEZ-3791) Failed/Killed task can throw InvalidStateTransitonException when a new attempt is launched

2017-07-10 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated TEZ-3791: - Attachment: TEZ-3791.001.patch Attached patch that adds the launched event to ignore list for failed and

[jira] [Updated] (TEZ-3791) Failed/Killed task can throw InvalidStateTransitonException when a new attempt is launched

2017-07-10 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated TEZ-3791: - Attachment: (was: TEZ-3791.001.patch) > Failed/Killed task can throw InvalidStateTransitonException

[jira] [Updated] (TEZ-3791) Failed/Killed task can throw InvalidStateTransitonException when a new attempt is launched

2017-07-10 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated TEZ-3791: - Attachment: TEZ-3791.001.patch > Failed/Killed task can throw InvalidStateTransitonException when a new >

[jira] [Created] (TEZ-3791) Failed/Killed task can throw InvalidStateTransitonException when a new attempt is launched

2017-07-10 Thread Kuhu Shukla (JIRA)
Kuhu Shukla created TEZ-3791: Summary: Failed/Killed task can throw InvalidStateTransitonException when a new attempt is launched Key: TEZ-3791 URL: https://issues.apache.org/jira/browse/TEZ-3791

[jira] [Commented] (TEZ-3754) With large ordered fetches, stalling shuffle could lead to slowdown of job

2017-07-10 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080529#comment-16080529 ] Jonathan Eagles commented on TEZ-3754: -- The removal of drop behind also helps in the broadcast fetch

[jira] [Commented] (TEZ-3754) With large ordered fetches, stalling shuffle could lead to slowdown of job

2017-07-10 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080500#comment-16080500 ] Jason Lowe commented on TEZ-3754: - Note that we mitigated some of the effects of shuffle hammering in

[jira] [Commented] (TEZ-3754) With large ordered fetches, stalling shuffle could lead to slowdown of job

2017-07-10 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080464#comment-16080464 ] Jason Lowe commented on TEZ-3754: - bq. do you why mapreduce explicitly turned this off? As Zhiyuan

[jira] [Commented] (TEZ-3754) With large ordered fetches, stalling shuffle could lead to slowdown of job

2017-07-10 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080445#comment-16080445 ] Jonathan Eagles commented on TEZ-3754: -- [~jlowe], do you why mapreduce explicitly turned this off? I

[jira] [Commented] (TEZ-3754) With large ordered fetches, stalling shuffle could lead to slowdown of job

2017-07-10 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079940#comment-16079940 ] Rajesh Balamohan commented on TEZ-3754: --- Thanks for the review [~aplusplus]. Pinging the host in

[jira] [Created] (TEZ-3790) Unrecognized SSL message while building tez

2017-07-10 Thread Nagendra (JIRA)
Nagendra created TEZ-3790: - Summary: Unrecognized SSL message while building tez Key: TEZ-3790 URL: https://issues.apache.org/jira/browse/TEZ-3790 Project: Apache Tez Issue Type: Bug

[jira] [Commented] (TEZ-3754) With large ordered fetches, stalling shuffle could lead to slowdown of job

2017-07-10 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079913#comment-16079913 ] Zhiyuan Yang commented on TEZ-3754: --- One side-effect is single large fetch can block other small fetches,