[jira] [Commented] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206564#comment-14206564 ] Jeff Zhang commented on TEZ-1642: - [~hitesh], I find another issue that it is not guaranteed

[jira] [Updated] (TEZ-1765) allow dropdown lists in table filters

2014-11-11 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prakash Ramachandran updated TEZ-1765: -- Attachment: TEZ-1765.2.patch - rebased - minor modification to re-use status across pages

[jira] [Created] (TEZ-1769) ContainerCompletedWhileRunningTransition should inherit from TerminatedWhileRunningTransition

2014-11-11 Thread Bikas Saha (JIRA)
Bikas Saha created TEZ-1769: --- Summary: ContainerCompletedWhileRunningTransition should inherit from TerminatedWhileRunningTransition Key: TEZ-1769 URL: https://issues.apache.org/jira/browse/TEZ-1769 Project

[jira] [Assigned] (TEZ-1606) Counters View for DAG, Vertex, and Task

2014-11-11 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prakash Ramachandran reassigned TEZ-1606: - Assignee: Prakash Ramachandran > Counters View for DAG, Vertex, and Task >

[jira] [Commented] (TEZ-1765) allow dropdown lists in table filters

2014-11-11 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207053#comment-14207053 ] Hitesh Shah commented on TEZ-1765: -- +1 committing. Minor note - the states handling will ne

[jira] [Commented] (TEZ-14) Support for speculation of slow tasks

2014-11-11 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-14?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207102#comment-14207102 ] Siddharth Seth commented on TEZ-14: --- Couple of other comments. - The TaskAttempt sending an

[jira] [Commented] (TEZ-1736) Add support for Inputs/Outputs in runtime-library to generate history text data

2014-11-11 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207182#comment-14207182 ] Siddharth Seth commented on TEZ-1736: - Looks good. Minor: The new tests need a timeout a

[jira] [Commented] (TEZ-1748) Refactoring - Conslidate the Transition in TaskAttemptImpl

2014-11-11 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207264#comment-14207264 ] Siddharth Seth commented on TEZ-1748: - [~zjffdu] - is there a reason this is required. T

[jira] [Commented] (TEZ-1737) Should add taskNum in VertexFinishedEvent

2014-11-11 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207313#comment-14207313 ] Siddharth Seth commented on TEZ-1737: - +1. Looks good. > Should add taskNum in VertexFi

[jira] [Commented] (TEZ-1769) ContainerCompletedWhileRunningTransition should inherit from TerminatedWhileRunningTransition

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207358#comment-14207358 ] Jeff Zhang commented on TEZ-1769: - [~bikassaha], I consolidate the common code into method

[jira] [Updated] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1642: Attachment: TEZ-1642-3.patch > TestAMRecovery sometimes fail > - > >

[jira] [Commented] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207421#comment-14207421 ] Jeff Zhang commented on TEZ-1642: - [~hitesh] Attach new patch. * Using the callback of Task

[jira] [Commented] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-11 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207465#comment-14207465 ] Hitesh Shah commented on TEZ-1642: -- This is probably a bad idea. A better approach may to b

[jira] [Updated] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1642: Description: TestAMRecovery fails sometimes on testVertexPartiallyFinished_XXX. The scenario is that we'd li

[jira] [Commented] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-11 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207481#comment-14207481 ] Hitesh Shah commented on TEZ-1642: -- Can testVertexPartiallyFinished_XXX be achieved by only

[jira] [Updated] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1642: Description: TestAMRecovery fails sometimes on testVertexPartiallyFinished_XXX. The scenario is that we'd li

[jira] [Updated] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1642: Description: TestAMRecovery fails sometimes on testVertexPartiallyFinished_XXX. The scenario is that we'd li

[jira] [Commented] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207494#comment-14207494 ] Jeff Zhang commented on TEZ-1642: - bq. Can testVertexPartiallyFinished_XXX be achieved by on

[jira] [Commented] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-11 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207497#comment-14207497 ] Hitesh Shah commented on TEZ-1642: -- Also, it looks for a DAG with V0 -> V1, the VM of V1 is

[jira] [Comment Edited] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-11 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207497#comment-14207497 ] Hitesh Shah edited comment on TEZ-1642 at 11/12/14 1:41 AM: Also

[jira] [Commented] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207505#comment-14207505 ] Jeff Zhang commented on TEZ-1642: - bq. Can testVertexPartiallyFinished_XXX be achieved by on

[jira] [Created] (TEZ-1770) Handle ConnectExceptions correctly when establishing connections to an NM which may be down

2014-11-11 Thread Siddharth Seth (JIRA)
Siddharth Seth created TEZ-1770: --- Summary: Handle ConnectExceptions correctly when establishing connections to an NM which may be down Key: TEZ-1770 URL: https://issues.apache.org/jira/browse/TEZ-1770 P

[jira] [Commented] (TEZ-1748) Refactoring - Conslidate the Transition in TaskAttemptImpl

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207539#comment-14207539 ] Jeff Zhang commented on TEZ-1748: - [~sseth], The reason I make this change is that I found c

[jira] [Updated] (TEZ-14) Support for speculation of slow tasks

2014-11-11 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-14?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-14: -- Attachment: TEZ-14.3.patch > Support for speculation of slow tasks > - > >

[jira] [Created] (TEZ-1771) Make DAGInitializedEvent as SummaryEvent

2014-11-11 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-1771: --- Summary: Make DAGInitializedEvent as SummaryEvent Key: TEZ-1771 URL: https://issues.apache.org/jira/browse/TEZ-1771 Project: Apache Tez Issue Type: Bug Rep

[jira] [Commented] (TEZ-14) Support for speculation of slow tasks

2014-11-11 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-14?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207618#comment-14207618 ] Bikas Saha commented on TEZ-14: --- Addressed the main comments from both reviews. I am going to k

[jira] [Updated] (TEZ-1770) Handle ConnectExceptions correctly when establishing connections to an NM which may be down

2014-11-11 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1770: Attachment: TEZ-1770.1.txt [~rajesh.balamohan] - review please. Probably a little more complicated tha

[jira] [Updated] (TEZ-1771) Make DAGInitializedEvent as SummaryEvent

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1771: Description: In the case that DAG is completed, but DAGInitializedEvent is not logged, we can not recover the

[jira] [Commented] (TEZ-1771) Make DAGInitializedEvent as SummaryEvent

2014-11-11 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207654#comment-14207654 ] Hitesh Shah commented on TEZ-1771: -- [~zjffdu] Do vertices really need to be recovered if th

[jira] [Comment Edited] (TEZ-1771) Make DAGInitializedEvent as SummaryEvent

2014-11-11 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207654#comment-14207654 ] Hitesh Shah edited comment on TEZ-1771 at 11/12/14 4:14 AM: [~zj

[jira] [Commented] (TEZ-1771) Make DAGInitializedEvent as SummaryEvent

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207671#comment-14207671 ] Jeff Zhang commented on TEZ-1771: - [~hitesh], I think the recovery should at least keep the

[jira] [Commented] (TEZ-1737) Should add taskNum in VertexFinishedEvent

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207686#comment-14207686 ] Jeff Zhang commented on TEZ-1737: - Thanks [~sseth] Committed to master & branch-0.5 > Shou

[jira] [Resolved] (TEZ-1737) Should add taskNum in VertexFinishedEvent

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang resolved TEZ-1737. - Resolution: Fixed Fix Version/s: 0.5.3 Assignee: Jeff Zhang Target Version/s: 0.

[jira] [Updated] (TEZ-1744) It is not necessary to check whether dag is commit in RecoveryTransition

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1744: Target Version/s: 0.6.0 > It is not necessary to check whether dag is commit in RecoveryTransition > -

[jira] [Commented] (TEZ-1770) Handle ConnectExceptions correctly when establishing connections to an NM which may be down

2014-11-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207703#comment-14207703 ] Junping Du commented on TEZ-1770: - Hi [~sseth], MapReduce has the same problem and I filed M

[jira] [Updated] (TEZ-1606) Counters View for DAG, Vertex, and Task

2014-11-11 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prakash Ramachandran updated TEZ-1606: -- Attachment: TEZ-1606.1.patch - combined all counter templates to one - added search functi