[jira] [Commented] (TEZ-4265) Tez UI doesn't show Load Counters button if any of the Dags have them

2021-01-22 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17270486#comment-17270486 ] Eric Badger commented on TEZ-4265: -- Thanks, [~jeagles]! > Tez UI doesn't show Load Counte

[jira] [Commented] (TEZ-4265) Tez UI doesn't show Load Counters button if any of the Dags have them

2021-01-22 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17270439#comment-17270439 ] Eric Badger commented on TEZ-4265: -- Attaching a new patch to address [~jeagles]'s comments

[jira] [Updated] (TEZ-4265) Tez UI doesn't show Load Counters button if any of the Dags have them

2021-01-22 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-4265: - Attachment: TEZ-4265.002.patch > Tez UI doesn't show Load Counters button if any of the Dags have them > --

[jira] [Updated] (TEZ-4265) Tez UI doesn't show Load Counters button if any of the Dags have them

2021-01-21 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-4265: - Attachment: TEZ-4265.001.patch > Tez UI doesn't show Load Counters button if any of the Dags have them > --

[jira] [Created] (TEZ-4265) Tez UI doesn't show Load Counters button if any of the Dags have them

2021-01-21 Thread Eric Badger (Jira)
Eric Badger created TEZ-4265: Summary: Tez UI doesn't show Load Counters button if any of the Dags have them Key: TEZ-4265 URL: https://issues.apache.org/jira/browse/TEZ-4265 Project: Apache Tez

[jira] [Commented] (TEZ-4242) TEZ_DAG_ID/others loaded multiple times on various Tez UI pages

2021-01-19 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17268183#comment-17268183 ] Eric Badger commented on TEZ-4242: -- Can anybody pick this up? It is quite wasteful for the

[jira] [Updated] (TEZ-4242) TEZ_DAG_ID/others loaded multiple times on various Tez UI pages

2020-10-14 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-4242: - Description: I went into "inspect" mode on my Google Chrome browser and in the Network tab I saw that {{TE

[jira] [Commented] (TEZ-4242) TEZ_DAG_ID/others loaded multiple times on various Tez UI pages

2020-10-14 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214302#comment-17214302 ] Eric Badger commented on TEZ-4242: -- cc [~jeagles], [~Sreenath], [~harishjp] > TEZ_DAG_ID/

[jira] [Created] (TEZ-4242) TEZ_DAG_ID/others loaded multiple times on various Tez UI pages

2020-10-14 Thread Eric Badger (Jira)
Eric Badger created TEZ-4242: Summary: TEZ_DAG_ID/others loaded multiple times on various Tez UI pages Key: TEZ-4242 URL: https://issues.apache.org/jira/browse/TEZ-4242 Project: Apache Tez Issue

[jira] [Assigned] (TEZ-1069) Support ability to re-size a task attempt when previous attempts fail due to resource constraints

2017-09-05 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger reassigned TEZ-1069: Assignee: Jeff Zhang (was: Eric Badger) Sorry, hot keys on the jira search page accidentally assigne

[jira] [Assigned] (TEZ-1069) Support ability to re-size a task attempt when previous attempts fail due to resource constraints

2017-09-05 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger reassigned TEZ-1069: Assignee: Eric Badger (was: Jeff Zhang) > Support ability to re-size a task attempt when previous at

[jira] [Updated] (TEZ-3792) RootInputVertexManager doesn't drain queued source task completed events

2017-07-13 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3792: - Attachment: TEZ-3792.001.patch Attaching a patch with the fix and some simple unit tests for RootInput and

[jira] [Commented] (TEZ-3792) RootInputVertexManager doesn't drain queued source task completed events

2017-07-12 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16084838#comment-16084838 ] Eric Badger commented on TEZ-3792: -- I did confirm that the problem doesn't exist when slow

[jira] [Commented] (TEZ-3792) RootInputVertexManager doesn't drain queued source task completed events

2017-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16083094#comment-16083094 ] Eric Badger commented on TEZ-3792: -- I don't believe RootInputVertexManager is broken when s

[jira] [Updated] (TEZ-3792) RootInputVertexManager doesn't drain queued source task completed events

2017-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3792: - Attachment: TEZ-3792.001.patch Adding code to drain the {{completions}} events during {{onVertexStarted}}.

[jira] [Created] (TEZ-3792) RootInputVertexManager doesn't drain queued source task completed events

2017-07-11 Thread Eric Badger (JIRA)
Eric Badger created TEZ-3792: Summary: RootInputVertexManager doesn't drain queued source task completed events Key: TEZ-3792 URL: https://issues.apache.org/jira/browse/TEZ-3792 Project: Apache Tez

[jira] [Commented] (TEZ-3274) Vertex with MRInput and broadcast input does not respect slow start

2017-06-30 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16070654#comment-16070654 ] Eric Badger commented on TEZ-3274: -- Thanks, [~jeagles]! Glad this finally got in! Thanks fo

[jira] [Updated] (TEZ-3274) Vertex with MRInput and broadcast input does not respect slow start

2017-06-30 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3274: - Attachment: TEZ-3274.009.patch There's a test failure that came about from fixing a javac error. Talked with

[jira] [Commented] (TEZ-3274) Vertex with MRInput and broadcast input does not respect slow start

2017-06-30 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16070338#comment-16070338 ] Eric Badger commented on TEZ-3274: -- Filed TEZ-3781 and TEZ-3782 to add TEZ_ROOT_INPUT_VERT

[jira] [Created] (TEZ-3783) Cleanup findbugs, javac, style, etc. bugs in {Shuffle,RootInput}VertexManager

2017-06-30 Thread Eric Badger (JIRA)
Eric Badger created TEZ-3783: Summary: Cleanup findbugs, javac, style, etc. bugs in {Shuffle,RootInput}VertexManager Key: TEZ-3783 URL: https://issues.apache.org/jira/browse/TEZ-3783 Project: Apache Tez

[jira] [Created] (TEZ-3782) DeprecatedKeys doesn't support a single key mapping to multiple values

2017-06-30 Thread Eric Badger (JIRA)
Eric Badger created TEZ-3782: Summary: DeprecatedKeys doesn't support a single key mapping to multiple values Key: TEZ-3782 URL: https://issues.apache.org/jira/browse/TEZ-3782 Project: Apache Tez

[jira] [Created] (TEZ-3781) Add TEZ_ROOT_INPUT_VERTEX_MANAGER_MIN_SRC_FRACTION to DeprecatedKeys

2017-06-30 Thread Eric Badger (JIRA)
Eric Badger created TEZ-3781: Summary: Add TEZ_ROOT_INPUT_VERTEX_MANAGER_MIN_SRC_FRACTION to DeprecatedKeys Key: TEZ-3781 URL: https://issues.apache.org/jira/browse/TEZ-3781 Project: Apache Tez

[jira] [Commented] (TEZ-3274) Vertex with MRInput and broadcast input does not respect slow start

2017-06-30 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16070280#comment-16070280 ] Eric Badger commented on TEZ-3274: -- [~jeagles], I'll file followup jiras for the deprecated

[jira] [Updated] (TEZ-3274) Vertex with MRInput and broadcast input does not respect slow start

2017-06-29 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3274: - Attachment: TEZ-3274.008.patch [~jeagles], fixed the javac and findbugs in this patch. They were both bugs

[jira] [Updated] (TEZ-3274) Vertex with MRInput and broadcast input does not respect slow start

2017-06-28 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3274: - Attachment: TEZ-3274.007.patch New patch that removes the deprecated key. Spoke with [~jeagles] offline and

[jira] [Commented] (TEZ-3274) Vertex with MRInput and broadcast input does not respect slow start

2017-06-27 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065624#comment-16065624 ] Eric Badger commented on TEZ-3274: -- The test failure is related. Mapping the deprecated MR

[jira] [Updated] (TEZ-3274) Vertex with MRInput and broadcast input does not respect slow start

2017-06-27 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3274: - Attachment: TEZ-3274.006.patch Thanks for the review, [~sseth]! Addressed your comments in this new patch.

[jira] [Updated] (TEZ-3274) Vertex with MRInput and broadcast input does not respect slow start

2017-06-27 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3274: - Attachment: TEZ-3274.005.patch Thanks for the review, [~jeagles]! I addressed your comments in this new patc

[jira] [Updated] (TEZ-3274) Vertex with MRInput and broadcast input does not respect slow start

2017-05-25 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3274: - Attachment: TEZ-3274.004.patch Attaching a completely new patch that adds the relevant slow start code from

[jira] [Updated] (TEZ-3736) SubmittedDAGs is always 0 in Resource Manager UI

2017-05-24 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3736: - Fix Version/s: (was: 0.8.4) [~aplusplus], [~hitesh], could you review this as this is a fix for the Jira

[jira] [Commented] (TEZ-3736) SubmittedDAGs is always 0 in Resource Manager UI

2017-05-24 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022924#comment-16022924 ] Eric Badger commented on TEZ-3736: -- lgtm +1 (non-binding). However, we'll need a committer

[jira] [Commented] (TEZ-3736) SubmittedDAGs is always 0 in Resource Manager UI

2017-05-23 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16021424#comment-16021424 ] Eric Badger commented on TEZ-3736: -- Hey [~artemvel], thanks for the patch! Looks like you p

[jira] [Commented] (TEZ-3274) Vertex with MRInput and broadcast input does not respect slow start

2017-05-08 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16001681#comment-16001681 ] Eric Badger commented on TEZ-3274: -- [~sseth], in our offline discussion last Thursday, we a

[jira] [Commented] (TEZ-3696) Jobs can hang when both concurrency and speculation are enabled

2017-05-08 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16000862#comment-16000862 ] Eric Badger commented on TEZ-3696: -- Thanks, [~jlowe] for the commit and [~bikassaha] and [~

[jira] [Updated] (TEZ-3696) Jobs can hang when both concurrency and speculation are enabled

2017-05-05 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3696: - Attachment: TEZ-3696-branch-0.7.004.patch [~jlowe], here's a patch for branch-0.7 > Jobs can hang when bot

[jira] [Updated] (TEZ-3696) Jobs can hang when both concurrency and speculation are enabled

2017-05-03 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3696: - Attachment: TEZ-3696.004.patch bq. pendingAttempt can use TaskAttemptId as a key instead of TaskAttempt. Up

[jira] [Commented] (TEZ-3696) Jobs can hang when both concurrency and speculation are enabled

2017-05-02 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993729#comment-15993729 ] Eric Badger commented on TEZ-3696: -- Thanks for the response, [~bikassaha]! bq. If the abo

[jira] [Updated] (TEZ-3696) Jobs can hang when both concurrency and speculation are enabled

2017-04-28 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3696: - Attachment: TEZ-3696.003.patch Thanks, [~jeagles] for the review! I fixed the patch in regards to your comm

[jira] [Commented] (TEZ-3696) Jobs can hang when both concurrency and speculation are enabled

2017-04-27 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15987603#comment-15987603 ] Eric Badger commented on TEZ-3696: -- {noformat} diff --git a/tez-dag/src/main/java/org/apac

[jira] [Updated] (TEZ-3696) Jobs can hang when both concurrency and speculation are enabled

2017-04-27 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3696: - Attachment: TEZ-3696.002.patch Putting up a new patch with 2 new unit tests. 1 tests to make sure that we se

[jira] [Updated] (TEZ-3696) Jobs can hang when both concurrency and speculation are enabled

2017-04-26 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3696: - Attachment: TEZ-3696.001.patch Uploading first patch. It fixes the failure mode that I described in the sum

[jira] [Created] (TEZ-3696) Jobs can hang when both concurrency and speculation are enabled

2017-04-24 Thread Eric Badger (JIRA)
Eric Badger created TEZ-3696: Summary: Jobs can hang when both concurrency and speculation are enabled Key: TEZ-3696 URL: https://issues.apache.org/jira/browse/TEZ-3696 Project: Apache Tez Issue

[jira] [Commented] (TEZ-3274) Vertex with MRInput and shuffle input does not respect slow start

2017-04-19 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975524#comment-15975524 ] Eric Badger commented on TEZ-3274: -- bq. In what situation does Shuffle and MRInput go toget

[jira] [Updated] (TEZ-3274) Vertex with MRInput and shuffle input does not respect slow start

2017-04-19 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3274: - Attachment: TEZ-3274.003.patch Attaching new patch that only adds the root vertex functionality to {{Shuffl

[jira] [Commented] (TEZ-3274) Vertex with MRInput and shuffle input does not respect slow start

2017-04-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964912#comment-15964912 ] Eric Badger commented on TEZ-3274: -- [~aplusplus], yea that's what I'm testing out currently

[jira] [Commented] (TEZ-3274) Vertex with MRInput and shuffle input does not respect slow start

2017-04-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964427#comment-15964427 ] Eric Badger commented on TEZ-3274: -- [~aplusplus] bq. Although I don't know what algorithm

[jira] [Updated] (TEZ-3681) Improve UI error message while trying to sort running DAGs with Auto Refresh enabled

2017-04-04 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3681: - Attachment: TEZ-3681.001.patch Uploading patch to make the comment more accurate > Improve UI error message

[jira] [Updated] (TEZ-3681) Improve UI error message while trying to sort running DAGs with Auto Refresh enabled

2017-04-04 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3681: - Description: {noformat} Cannot sort: Sorting on Status is disabled for running DAGs! {noformat} The curren

[jira] [Moved] (TEZ-3681) Improve UI error message while trying to sort running DAGs with Auto Refresh enabled

2017-04-04 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger moved YARN-6441 to TEZ-3681: Key: TEZ-3681 (was: YARN-6441) Project: Apache Tez (was: Hadoop YARN) > Imp

[jira] [Commented] (TEZ-3274) Vertex with MRInput and shuffle input does not respect slow start

2017-03-23 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15939286#comment-15939286 ] Eric Badger commented on TEZ-3274: -- [~sseth], I think I have a pretty good understanding of

[jira] [Commented] (TEZ-3274) Vertex with MRInput and shuffle input does not respect slow start

2017-02-28 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15888199#comment-15888199 ] Eric Badger commented on TEZ-3274: -- [~sseth] bq. Guessing this isn't the final patch, sinc

[jira] [Commented] (TEZ-3274) Vertex with MRInput and shuffle input does not respect slow start

2017-02-24 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15883086#comment-15883086 ] Eric Badger commented on TEZ-3274: -- [~sseth], do you have any comments on the patch in its

[jira] [Commented] (TEZ-3274) Vertex with MRInput and shuffle input does not respect slow start

2017-02-10 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15861873#comment-15861873 ] Eric Badger commented on TEZ-3274: -- As I walk through the auto-parallelism code some more,

[jira] [Updated] (TEZ-3274) Vertex with MRInput and shuffle input does not respect slow start

2017-02-10 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3274: - Attachment: TEZ-3274.002.patch Adding a new patch that moves the functionality out of {{VertexManagerPlugin

[jira] [Comment Edited] (TEZ-3274) Vertex with MRInput and shuffle input does not respect slow start

2017-02-08 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15858256#comment-15858256 ] Eric Badger edited comment on TEZ-3274 at 2/8/17 10:28 PM: --- Upload

[jira] [Comment Edited] (TEZ-3274) Vertex with MRInput and shuffle input does not respect slow start

2017-02-08 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15858256#comment-15858256 ] Eric Badger edited comment on TEZ-3274 at 2/8/17 9:01 PM: -- Uploadin

[jira] [Updated] (TEZ-3274) Vertex with MRInput and shuffle input does not respect slow start

2017-02-08 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3274: - Attachment: TEZ-3274.001.patch Uploading a first-effort patch to get some feedback. In this patch I have re

[jira] [Commented] (TEZ-3554) Add a link to get to all logs from Tez UI while job is running

2017-01-26 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840478#comment-15840478 ] Eric Badger commented on TEZ-3554: -- Thanks, [~Sreenath]! > Add a link to get to all logs f

[jira] [Commented] (TEZ-3554) Add a link to get to all logs from Tez UI while job is running

2017-01-25 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838660#comment-15838660 ] Eric Badger commented on TEZ-3554: -- [~Sreenath], [~jeagles], could one of you review the la

[jira] [Commented] (TEZ-3274) Vertex with MRInput and shuffle input does not respect slow start

2017-01-24 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15836765#comment-15836765 ] Eric Badger commented on TEZ-3274: -- Apparently JIRA notifications were down when I wrote th

[jira] [Assigned] (TEZ-3274) Vertex with MRInput and shuffle input does not respect slow start

2017-01-19 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger reassigned TEZ-3274: Assignee: Eric Badger > Vertex with MRInput and shuffle input does not respect slow start > -

[jira] [Commented] (TEZ-3462) Task attempt failure during container shutdown loses useful container diagnostics

2017-01-17 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826649#comment-15826649 ] Eric Badger commented on TEZ-3462: -- [~hitesh], [~sseth], do you have any followup on this?

[jira] [Commented] (TEZ-3559) TEZ_LIB_URIS doesn't work with schemes different than the defaultFS

2016-12-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15754607#comment-15754607 ] Eric Badger commented on TEZ-3559: -- Thanks, [~jeagles]! > TEZ_LIB_URIS doesn't work with s

[jira] [Updated] (TEZ-3559) TEZ_LIB_URIS doesn't work with schemes different than the defaultFS

2016-12-15 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3559: - Target Version/s: 0.7.2, 0.9.0, 0.8.5 [~jeagles], yes this should be targeted all the way through 0.7, since

[jira] [Updated] (TEZ-3559) TEZ_LIB_URIS doesn't work with schemes different than the defaultFS

2016-12-15 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3559: - Attachment: TEZ-3559.001.patch Here's a patch that gets rid of the getFile() call that strips away the schem

[jira] [Created] (TEZ-3559) TEZ_LIB_URIS doesn't work with schemes different than the defaultFS

2016-12-15 Thread Eric Badger (JIRA)
Eric Badger created TEZ-3559: Summary: TEZ_LIB_URIS doesn't work with schemes different than the defaultFS Key: TEZ-3559 URL: https://issues.apache.org/jira/browse/TEZ-3559 Project: Apache Tez I

[jira] [Updated] (TEZ-3554) Add a link to get to all logs from Tez UI while job is running

2016-12-09 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3554: - Attachment: TEZ-3554.003.patch New patch updates the JSHint tests so that they're compatible with the change

[jira] [Commented] (TEZ-3537) ArrayIndexOutOfBoundsException with empty environment variables/Port YARN-3768 to Tez

2016-12-08 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15732398#comment-15732398 ] Eric Badger commented on TEZ-3537: -- Thanks, [~jeagles]! > ArrayIndexOutOfBoundsException w

[jira] [Commented] (TEZ-3554) Add a link to get to all logs from Tez UI while job is running

2016-12-07 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15728949#comment-15728949 ] Eric Badger commented on TEZ-3554: -- [~Sreenath], I didn't see YARN-3698 when I filed YARN-5

[jira] [Commented] (TEZ-3554) Add a link to get to all logs from Tez UI while job is running

2016-12-06 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15726617#comment-15726617 ] Eric Badger commented on TEZ-3554: -- Linking required YARN jira. This fix won't do anything

[jira] [Updated] (TEZ-3554) Add a link to get to all logs from Tez UI while job is running

2016-12-06 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3554: - Attachment: TEZ-3554.002.patch bq. Looks like the change in tez-ui/src/main/webapp/app/templates/dag/index.h

[jira] [Commented] (TEZ-3537) ArrayIndexOutOfBoundsException with empty environment variables/Port YARN-3768 to Tez

2016-12-01 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15712752#comment-15712752 ] Eric Badger commented on TEZ-3537: -- [~jeagles], can you review the latest patch? Thanks! >

[jira] [Updated] (TEZ-3554) Add a link to get to all logs from Tez UI while job is running

2016-12-01 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3554: - Attachment: TEZ-3554.001.patch Attaching patch that adds a new field to the Tez UI to allow for direct acces

[jira] [Created] (TEZ-3554) Add a link to get to all logs from Tez UI while job is running

2016-12-01 Thread Eric Badger (JIRA)
Eric Badger created TEZ-3554: Summary: Add a link to get to all logs from Tez UI while job is running Key: TEZ-3554 URL: https://issues.apache.org/jira/browse/TEZ-3554 Project: Apache Tez Issue

[jira] [Updated] (TEZ-3537) ArrayIndexOutOfBoundsException with empty environment variables/Port YARN-3768 to Tez

2016-11-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3537: - Attachment: TEZ-3537.002.patch Attaching new patch that passes the unit tests. The change is to leave env va

[jira] [Comment Edited] (TEZ-3537) ArrayIndexOutOfBoundsException with empty environment variables/Port YARN-3768 to Tez

2016-11-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668635#comment-15668635 ] Eric Badger edited comment on TEZ-3537 at 11/16/16 4:44 PM: -{{T

[jira] [Commented] (TEZ-3537) ArrayIndexOutOfBoundsException with empty environment variables/Port YARN-3768 to Tez

2016-11-15 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668635#comment-15668635 ] Eric Badger commented on TEZ-3537: -- {{TestMRHelpers}} does not fail for me locally and is u

[jira] [Updated] (TEZ-3537) ArrayIndexOutOfBoundsException with empty environment variables/Port YARN-3768 to Tez

2016-11-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3537: - Attachment: TEZ-3537.001.patch Attaching patch that ports YARN-3768. > ArrayIndexOutOfBoundsException with

[jira] [Assigned] (TEZ-3537) ArrayIndexOutOfBoundsException with empty environment variables/Port YARN-3768 to Tez

2016-11-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger reassigned TEZ-3537: Assignee: Eric Badger > ArrayIndexOutOfBoundsException with empty environment variables/Port > YARN-

[jira] [Created] (TEZ-3537) ArrayIndexOutOfBoundsException with empty environment variables/Port YARN-3768 to Tez

2016-11-11 Thread Eric Badger (JIRA)
Eric Badger created TEZ-3537: Summary: ArrayIndexOutOfBoundsException with empty environment variables/Port YARN-3768 to Tez Key: TEZ-3537 URL: https://issues.apache.org/jira/browse/TEZ-3537 Project: Apac

[jira] [Commented] (TEZ-3486) COMBINE_OUTPUT_RECORDS/COMBINE_INPUT_RECORDS are not correct

2016-11-03 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15633885#comment-15633885 ] Eric Badger commented on TEZ-3486: -- Thanks [~jeagles] and [~rohini]! > COMBINE_OUTPUT_RECO

[jira] [Commented] (TEZ-3486) COMBINE_OUTPUT_RECORDS/COMBINE_INPUT_RECORDS are not correct

2016-11-03 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15633629#comment-15633629 ] Eric Badger commented on TEZ-3486: -- [~jeagles], the current patch should apply cleanly to m

[jira] [Updated] (TEZ-3486) COMBINE_OUTPUT_RECORDS/COMBINE_INPUT_RECORDS are not correct

2016-10-28 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3486: - Attachment: TEZ-3486.003.patch Thanks, [~rohini]. Attaching new patch that addresses your comments. > COMBI

[jira] [Updated] (TEZ-3486) COMBINE_OUTPUT_RECORDS/COMBINE_INPUT_RECORDS are not correct

2016-10-25 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3486: - Attachment: TEZ-3486.002.patch Thanks for the review, [~rohini]! Attaching a new patch that addresses your

[jira] [Updated] (TEZ-3486) COMBINE_OUTPUT_RECORDS/COMBINE_INPUT_RECORDS are not correct

2016-10-21 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3486: - Attachment: TEZ-3486.001.patch Attaching a patch that fixes the calculation for COMBINE_INPUT_RECORDS/COMBI

[jira] [Created] (TEZ-3486) COMBINE_OUTPUT_RECORDS/COMBINE_INPUT_RECORDS are not correct

2016-10-21 Thread Eric Badger (JIRA)
Eric Badger created TEZ-3486: Summary: COMBINE_OUTPUT_RECORDS/COMBINE_INPUT_RECORDS are not correct Key: TEZ-3486 URL: https://issues.apache.org/jira/browse/TEZ-3486 Project: Apache Tez Issue Ty

[jira] [Updated] (TEZ-3462) Task attempt failure during container shutdown loses useful container diagnostics

2016-10-06 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3462: - Attachment: TEZ-3462.001.patch Attaching a patch that only communicates the task failure to the AM if the c

[jira] [Assigned] (TEZ-3462) Task attempt failure during container shutdown loses useful container diagnostics

2016-10-06 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger reassigned TEZ-3462: Assignee: Eric Badger > Task attempt failure during container shutdown loses useful container > diag

[jira] [Commented] (TEZ-3362) Delete intermediate data at DAG level for Shuffle Handler

2016-09-02 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15458757#comment-15458757 ] Eric Badger commented on TEZ-3362: -- Hi [~kshukla], thanks for the patch! I have just one co

[jira] [Commented] (TEZ-3326) Display JVM system properties in AM and task logs

2016-09-01 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15456721#comment-15456721 ] Eric Badger commented on TEZ-3326: -- Thanks for the review and commit, [~hitesh]! > Display

[jira] [Commented] (TEZ-3326) Display JVM system properties in AM and task logs

2016-09-01 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15455367#comment-15455367 ] Eric Badger commented on TEZ-3326: -- [~hitesh], looks good to me! > Display JVM system prop

[jira] [Updated] (TEZ-3326) Display JVM system properties in AM and task logs

2016-08-31 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3326: - Attachment: TEZ-3326.004.patch [~hitesh], I'm uploading a patch that I believe address all of your comments.

[jira] [Commented] (TEZ-3326) Display JVM system properties in AM and task logs

2016-08-30 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450372#comment-15450372 ] Eric Badger commented on TEZ-3326: -- [~hitesh], thanks for the comments and review! {quote

[jira] [Commented] (TEZ-3326) Display JVM system properties in AM and task logs

2016-08-30 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450111#comment-15450111 ] Eric Badger commented on TEZ-3326: -- [~hitesh], can you give me the YARN Jira number? I lik

[jira] [Updated] (TEZ-3378) Move Shuffle Handler configuration into the Tez namespace

2016-07-27 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3378: - Attachment: TEZ-3378.002.patch Attaching patch to move all Mapreduce namespace configurations over to Tez n

[jira] [Updated] (TEZ-3378) Move Shuffle Handler configuration into the Tez namespace

2016-07-26 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3378: - Attachment: TEZ-3378.001.patch Attaching a patch with initial changes to support the Tez Shuffle Handler, i

[jira] [Assigned] (TEZ-3362) Delete intermediate data at DAG level for Shuffle Handler

2016-07-20 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger reassigned TEZ-3362: Assignee: Eric Badger > Delete intermediate data at DAG level for Shuffle Handler > -

[jira] [Updated] (TEZ-3326) Display JVM system properties in AM and task logs

2016-07-08 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3326: - Attachment: TEZ-3326.003.patch bq. Scope.VERTEX reflects whether this config can be changed on a per dag/ve

[jira] [Updated] (TEZ-3326) Display JVM system properties in AM and task logs

2016-07-08 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3326: - Attachment: TEZ-3326.002.patch [~mingma] bq. should the ConfigurationScope be Scope.VERTEX given it applies

[jira] [Updated] (TEZ-3326) Display JVM system properties in AM and task logs

2016-07-07 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated TEZ-3326: - Attachment: TEZ-3326.001.patch Attaching patch that logs jvm system properties based on a new tez configura

  1   2   >