[jira] [Commented] (TEZ-1687) Use logIdentifier of Vertex for logging

2014-11-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201464#comment-14201464 ] Jeff Zhang commented on TEZ-1687: - [~bikassaha], do you have any concern about this ? If not

[jira] [Created] (TEZ-1748) Conslidate the Transition in TaskAttemptImpl

2014-11-06 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-1748: --- Summary: Conslidate the Transition in TaskAttemptImpl Key: TEZ-1748 URL: https://issues.apache.org/jira/browse/TEZ-1748 Project: Apache Tez Issue Type: Bug Affects

[jira] [Updated] (TEZ-1748) Refactoring - Conslidate the Transition in TaskAttemptImpl

2014-11-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1748: Summary: Refactoring - Conslidate the Transition in TaskAttemptImpl (was: Conslidate the Transition in TaskAt

[jira] [Updated] (TEZ-1746) Flaky test in TestVertexImpl and TestExceptionPropagation

2014-11-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1746: Attachment: TEZ-1746-2.patch Thanks [~sseth], update the patch, please help review it. > Flaky test in TestV

[jira] [Commented] (TEZ-1746) Flaky test in TestVertexImpl and TestExceptionPropagation

2014-11-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201552#comment-14201552 ] Jeff Zhang commented on TEZ-1746: - Committed to master & branch-0.5 > Flaky test in TestVer

[jira] [Updated] (TEZ-1761) TestRecoveryParser::testGetLastInProgressDAG fails in similar manner to TEZ-1686

2014-11-08 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1761: Attachment: TEZ-1761.patch [~hitesh] attach the patch, please help review. > TestRecoveryParser::testGetLastI

[jira] [Commented] (TEZ-1761) TestRecoveryParser::testGetLastInProgressDAG fails in similar manner to TEZ-1686

2014-11-08 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14203755#comment-14203755 ] Jeff Zhang commented on TEZ-1761: - Committed to master & branch-0.5 > TestRecoveryParser::t

[jira] [Commented] (TEZ-1761) TestRecoveryParser::testGetLastInProgressDAG fails in similar manner to TEZ-1686

2014-11-08 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14203756#comment-14203756 ] Jeff Zhang commented on TEZ-1761: - Sorry, [~hitesh], Is it shouldn't committed to branch-0.5

[jira] [Commented] (TEZ-1761) TestRecoveryParser::testGetLastInProgressDAG fails in similar manner to TEZ-1686

2014-11-08 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14203768#comment-14203768 ] Jeff Zhang commented on TEZ-1761: - Yes, I have committed it to branch-0.5. Change the targe

[jira] [Updated] (TEZ-1748) Refactoring - Conslidate the Transition in TaskAttemptImpl

2014-11-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1748: Attachment: TEZ-1748.patch > Refactoring - Conslidate the Transition in TaskAttemptImpl >

[jira] [Commented] (TEZ-1748) Refactoring - Conslidate the Transition in TaskAttemptImpl

2014-11-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14204535#comment-14204535 ] Jeff Zhang commented on TEZ-1748: - Attach the patch. * Move the common work into TaskAttemp

[jira] [Updated] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1642: Attachment: TEZ-1642.patch > TestAMRecovery sometimes fail > - > >

[jira] [Commented] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14204897#comment-14204897 ] Jeff Zhang commented on TEZ-1642: - Attach the patch. [~hitesh], please help review it Repro

[jira] [Commented] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14205578#comment-14205578 ] Jeff Zhang commented on TEZ-1642: - Run the test for the whole night. Unfortunately it fails

[jira] [Commented] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14205581#comment-14205581 ] Jeff Zhang commented on TEZ-1642: - bq. This can be controlled by using a custom vertex manag

[jira] [Commented] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14205641#comment-14205641 ] Jeff Zhang commented on TEZ-1642: - The original failure is that AM is killed when vertex is

[jira] [Commented] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14205736#comment-14205736 ] Jeff Zhang commented on TEZ-1642: - Committed to both master & branch-0.5 > TestAMRecovery s

[jira] [Comment Edited] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14205736#comment-14205736 ] Jeff Zhang edited comment on TEZ-1642 at 11/11/14 1:10 AM: --- Additi

[jira] [Updated] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1642: Attachment: TEZ-1642-2.patch > TestAMRecovery sometimes fail > - > >

[jira] [Commented] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14205817#comment-14205817 ] Jeff Zhang commented on TEZ-1642: - [~hitesh], attach the new patch. But it fails again in my

[jira] [Commented] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14205855#comment-14205855 ] Jeff Zhang commented on TEZ-1642: - commit reverted > TestAMRecovery sometimes fail > -

[jira] [Commented] (TEZ-1687) Use logIdentifier of Vertex for logging

2014-11-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14205938#comment-14205938 ] Jeff Zhang commented on TEZ-1687: - Committed to master & branch-0.5 > Use logIdentifier of

[jira] [Commented] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206564#comment-14206564 ] Jeff Zhang commented on TEZ-1642: - [~hitesh], I find another issue that it is not guaranteed

[jira] [Commented] (TEZ-1769) ContainerCompletedWhileRunningTransition should inherit from TerminatedWhileRunningTransition

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207358#comment-14207358 ] Jeff Zhang commented on TEZ-1769: - [~bikassaha], I consolidate the common code into method

[jira] [Updated] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1642: Attachment: TEZ-1642-3.patch > TestAMRecovery sometimes fail > - > >

[jira] [Commented] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207421#comment-14207421 ] Jeff Zhang commented on TEZ-1642: - [~hitesh] Attach new patch. * Using the callback of Task

[jira] [Updated] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1642: Description: TestAMRecovery fails sometimes on testVertexPartiallyFinished_XXX. The scenario is that we'd li

[jira] [Updated] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1642: Description: TestAMRecovery fails sometimes on testVertexPartiallyFinished_XXX. The scenario is that we'd li

[jira] [Updated] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1642: Description: TestAMRecovery fails sometimes on testVertexPartiallyFinished_XXX. The scenario is that we'd li

[jira] [Commented] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207494#comment-14207494 ] Jeff Zhang commented on TEZ-1642: - bq. Can testVertexPartiallyFinished_XXX be achieved by on

[jira] [Commented] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207505#comment-14207505 ] Jeff Zhang commented on TEZ-1642: - bq. Can testVertexPartiallyFinished_XXX be achieved by on

[jira] [Commented] (TEZ-1748) Refactoring - Conslidate the Transition in TaskAttemptImpl

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207539#comment-14207539 ] Jeff Zhang commented on TEZ-1748: - [~sseth], The reason I make this change is that I found c

[jira] [Created] (TEZ-1771) Make DAGInitializedEvent as SummaryEvent

2014-11-11 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-1771: --- Summary: Make DAGInitializedEvent as SummaryEvent Key: TEZ-1771 URL: https://issues.apache.org/jira/browse/TEZ-1771 Project: Apache Tez Issue Type: Bug Rep

[jira] [Updated] (TEZ-1771) Make DAGInitializedEvent as SummaryEvent

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1771: Description: In the case that DAG is completed, but DAGInitializedEvent is not logged, we can not recover the

[jira] [Commented] (TEZ-1771) Make DAGInitializedEvent as SummaryEvent

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207671#comment-14207671 ] Jeff Zhang commented on TEZ-1771: - [~hitesh], I think the recovery should at least keep the

[jira] [Commented] (TEZ-1737) Should add taskNum in VertexFinishedEvent

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207686#comment-14207686 ] Jeff Zhang commented on TEZ-1737: - Thanks [~sseth] Committed to master & branch-0.5 > Shou

[jira] [Resolved] (TEZ-1737) Should add taskNum in VertexFinishedEvent

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang resolved TEZ-1737. - Resolution: Fixed Fix Version/s: 0.5.3 Assignee: Jeff Zhang Target Version/s: 0.

[jira] [Updated] (TEZ-1744) It is not necessary to check whether dag is commit in RecoveryTransition

2014-11-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1744: Target Version/s: 0.6.0 > It is not necessary to check whether dag is commit in RecoveryTransition > -

[jira] [Commented] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-12 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207924#comment-14207924 ] Jeff Zhang commented on TEZ-1642: - It would be better to allow VM get the notification of Ta

[jira] [Commented] (TEZ-1737) Should add taskNum in VertexFinishedEvent

2014-11-12 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208959#comment-14208959 ] Jeff Zhang commented on TEZ-1737: - [~hitesh], it is about the TestAMRecovery fail (TEZ-1642)

[jira] [Commented] (TEZ-1772) Failing tests post TEZ-1737

2014-11-12 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209041#comment-14209041 ] Jeff Zhang commented on TEZ-1772: - BTW, why we recover both from the summary logs and non-su

[jira] [Updated] (TEZ-1772) Failing tests post TEZ-1737

2014-11-12 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1772: Attachment: TEZ-1772.patch > Failing tests post TEZ-1737 > --- > > Key

[jira] [Updated] (TEZ-1772) Failing tests post TEZ-1737

2014-11-12 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1772: Description: org.apache.tez.test.TestAMRecovery.testVertexCompletelyFinished_One2One org.apache.tez.test.TestA

[jira] [Updated] (TEZ-1772) Failing tests post TEZ-1737

2014-11-12 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1772: Description: org.apache.tez.test.TestAMRecovery.testVertexCompletelyFinished_One2One org.apache.tez.test.TestA

[jira] [Commented] (TEZ-1772) Failing tests post TEZ-1737

2014-11-12 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209031#comment-14209031 ] Jeff Zhang commented on TEZ-1772: - [~hitesh], Sorry for making this unit test failure. The c

[jira] [Commented] (TEZ-1772) Failing tests post TEZ-1737

2014-11-12 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209292#comment-14209292 ] Jeff Zhang commented on TEZ-1772: - bq. Is there a reason why numTasks is not written to both

[jira] [Commented] (TEZ-1772) Failing tests post TEZ-1737

2014-11-13 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209508#comment-14209508 ] Jeff Zhang commented on TEZ-1772: - bq. The problem is that there is no way to know if the ta

[jira] [Updated] (TEZ-1772) Failing tests post TEZ-1737

2014-11-13 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1772: Attachment: TEZ-1772-2.patch > Failing tests post TEZ-1737 > --- > > K

[jira] [Commented] (TEZ-1772) Failing tests post TEZ-1737

2014-11-13 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209527#comment-14209527 ] Jeff Zhang commented on TEZ-1772: - Attach a new patch which add numTasks also into non-summa

[jira] [Commented] (TEZ-1384) Move recovery related code into inner class

2014-11-13 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209681#comment-14209681 ] Jeff Zhang commented on TEZ-1384: - [~hitesh], I back to this jira. I plan to consolidate th

[jira] [Updated] (TEZ-1746) Flaky test in TestVertexImpl and TestExceptionPropagation

2014-11-13 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1746: Attachment: TEZ-1746-addendum.patch Attach the addendum patch. ( 300 seconds is not enough, increase the time

[jira] [Commented] (TEZ-1746) Flaky test in TestVertexImpl and TestExceptionPropagation

2014-11-13 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14211593#comment-14211593 ] Jeff Zhang commented on TEZ-1746: - Sorry for making the typo mistake. branch-0.5 has got th

[jira] [Updated] (TEZ-1744) It is not necessary to check whether dag is commit in RecoveryTransition

2014-11-13 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1744: Description: It is not necessary to check whether dag is commit in RecoveryTransition, because we already che

[jira] [Commented] (TEZ-1744) It is not necessary to check whether dag is commit in RecoveryTransition

2014-11-13 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14211885#comment-14211885 ] Jeff Zhang commented on TEZ-1744: - [~hitesh] I copy the comments about commit from TEZ-1737

[jira] [Updated] (TEZ-1687) Use logIdentifier of Vertex for logging

2014-11-13 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1687: Target Version/s: 0.6.0 (was: 0.5.3) Fix Version/s: (was: 0.5.3) 0.6.0 > Use

[jira] [Commented] (TEZ-1687) Use logIdentifier of Vertex for logging

2014-11-13 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14211942#comment-14211942 ] Jeff Zhang commented on TEZ-1687: - Revert it from branch-0.5 and make the target version to

[jira] [Updated] (TEZ-1737) Should add taskNum in VertexFinishedEvent

2014-11-13 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1737: Target Version/s: 0.6.0 (was: 0.5.3) Fix Version/s: (was: 0.5.3) 0.6.0 Rever

[jira] [Updated] (TEZ-1772) Failing tests post TEZ-1737

2014-11-13 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1772: Target Version/s: 0.6.0 (was: 0.6.0, 0.5.3) Fix Version/s: (was: 0.5.3) 0.6.0

[jira] [Commented] (TEZ-1773) Add attempt failure cause enum to the attempt failed/killed history record

2014-11-14 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14212076#comment-14212076 ] Jeff Zhang commented on TEZ-1773: - Is this for showing the task attempt failure cause in tez

[jira] [Commented] (TEZ-1773) Add attempt failure cause enum to the attempt failed/killed history record

2014-11-16 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14214357#comment-14214357 ] Jeff Zhang commented on TEZ-1773: - Comments: * Is the trySetErrorCause necessary in TaskAtt

[jira] [Commented] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-17 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14214433#comment-14214433 ] Jeff Zhang commented on TEZ-1642: - Attach a new patch, the main change in the patch is add t

[jira] [Comment Edited] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-17 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14214433#comment-14214433 ] Jeff Zhang edited comment on TEZ-1642 at 11/17/14 9:02 AM: --- Attach

[jira] [Updated] (TEZ-1642) TestAMRecovery sometimes fail

2014-11-17 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1642: Attachment: TEZ-1642-4.patch > TestAMRecovery sometimes fail > - > >

[jira] [Updated] (TEZ-1744) It is not necessary to check whether dag is commit in RecoveryTransition

2014-11-18 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1744: Attachment: TEZ-1744.patch > It is not necessary to check whether dag is commit in RecoveryTransition > --

[jira] [Commented] (TEZ-1744) It is not necessary to check whether dag is commit in RecoveryTransition

2014-11-18 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216073#comment-14216073 ] Jeff Zhang commented on TEZ-1744: - Attach patch. * Remove the commit-in-progress checking in

[jira] [Commented] (TEZ-1100) Evaluate DAG specification using a text format

2014-11-18 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216076#comment-14216076 ] Jeff Zhang commented on TEZ-1100: - dag.xsd is missing ? > Evaluate DAG specification using

[jira] [Comment Edited] (TEZ-1744) It is not necessary to check whether dag is commit in RecoveryTransition

2014-11-18 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216073#comment-14216073 ] Jeff Zhang edited comment on TEZ-1744 at 11/19/14 12:41 AM: Atta

[jira] [Created] (TEZ-1790) DeAllocationTaskRequest may happens before corresponding AllocationTaskRequest in local mode

2014-11-18 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-1790: --- Summary: DeAllocationTaskRequest may happens before corresponding AllocationTaskRequest in local mode Key: TEZ-1790 URL: https://issues.apache.org/jira/browse/TEZ-1790 Project:

[jira] [Updated] (TEZ-1790) DeallocationTaskRequest may happens before corresponding AllocationTaskRequest in local mode

2014-11-18 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1790: Summary: DeallocationTaskRequest may happens before corresponding AllocationTaskRequest in local mode (was: D

[jira] [Updated] (TEZ-1790) DeAllocationTaskRequest may happens before corresponding AllocationTaskRequest in local mode

2014-11-18 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1790: Description: In Tez Local mode, DeAllocationTask > DeAllocationTaskRequest may happens before corresponding >

[jira] [Updated] (TEZ-1790) DeallocationTaskRequest may happens before corresponding AllocationTaskRequest in local mode

2014-11-19 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1790: Description: In Tez Local mode, when dag is kiiled, DeallocationTaskRequest may been handled before correspon

[jira] [Updated] (TEZ-1790) DeallocationTaskRequest may been handled before corresponding AllocationTaskRequest in local mode

2014-11-19 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1790: Summary: DeallocationTaskRequest may been handled before corresponding AllocationTaskRequest in local mode (w

[jira] [Updated] (TEZ-1790) DeallocationTaskRequest may been handled before corresponding AllocationTaskRequest in local mode

2014-11-19 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1790: Description: In Tez Local mode, when dag is kiiled, DeallocationTaskRequest may been handled before correspon

[jira] [Updated] (TEZ-1790) DeallocationTaskRequest may been handled before corresponding AllocationTaskRequest in local mode

2014-11-19 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1790: Description: In Tez Local mode, when dag is kiiled, DeallocationTaskRequest may been handled before correspon

[jira] [Updated] (TEZ-1790) DeallocationTaskRequest may been handled before corresponding AllocationTaskRequest in local mode

2014-11-19 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1790: Attachment: TEZ-1790.patch > DeallocationTaskRequest may been handled before corresponding > AllocationTaskRe

[jira] [Commented] (TEZ-1790) DeallocationTaskRequest may been handled before corresponding AllocationTaskRequest in local mode

2014-11-19 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217863#comment-14217863 ] Jeff Zhang commented on TEZ-1790: - Attach the patch. [~seth.siddha...@gmail.com], [~bikassa

[jira] [Commented] (TEZ-1773) Add attempt failure cause enum to the attempt failed/killed history record

2014-11-19 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217868#comment-14217868 ] Jeff Zhang commented on TEZ-1773: - lgtm +1 > Add attempt failure cause enum to the attempt

[jira] [Commented] (TEZ-1793) Setting different container sizes for jobs in the same tez session can cause cluster underutilization

2014-11-19 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217878#comment-14217878 ] Jeff Zhang commented on TEZ-1793: - I think this can been resolved once YARN support containe

[jira] [Commented] (TEZ-992) Recovery data should not be written on AsyncDispatcher thread

2014-11-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14219187#comment-14219187 ] Jeff Zhang commented on TEZ-992: Seems this jira related to TEZ-714 closely, I try to resolve

[jira] [Updated] (TEZ-992) Recovery data should not be written on AsyncDispatcher thread

2014-11-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-992: --- Attachment: Vertex_2.gv DAG_2.gv > Recovery data should not be written on AsyncDispatcher thread

[jira] [Comment Edited] (TEZ-992) Recovery data should not be written on AsyncDispatcher thread

2014-11-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14219187#comment-14219187 ] Jeff Zhang edited comment on TEZ-992 at 11/20/14 9:55 AM: -- Seems thi

[jira] [Comment Edited] (TEZ-992) Recovery data should not be written on AsyncDispatcher thread

2014-11-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14219187#comment-14219187 ] Jeff Zhang edited comment on TEZ-992 at 11/20/14 9:57 AM: -- Seems thi

[jira] [Comment Edited] (TEZ-992) Recovery data should not be written on AsyncDispatcher thread

2014-11-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14219187#comment-14219187 ] Jeff Zhang edited comment on TEZ-992 at 11/20/14 9:58 AM: -- Seems thi

[jira] [Comment Edited] (TEZ-992) Recovery data should not be written on AsyncDispatcher thread

2014-11-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14219187#comment-14219187 ] Jeff Zhang edited comment on TEZ-992 at 11/20/14 9:59 AM: -- Seems thi

[jira] [Updated] (TEZ-992) Recovery data should not be written on AsyncDispatcher thread

2014-11-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-992: --- Attachment: (was: DAG_2.gv) > Recovery data should not be written on AsyncDispatcher thread > ---

[jira] [Updated] (TEZ-992) Recovery data should not be written on AsyncDispatcher thread

2014-11-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-992: --- Attachment: (was: Vertex_2.gv) > Recovery data should not be written on AsyncDispatcher thread >

[jira] [Updated] (TEZ-992) Recovery data should not be written on AsyncDispatcher thread

2014-11-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-992: --- Attachment: DAG_FinishSaving.gv Vertex_FinishSaving.gv Update the new state machines with minior

[jira] [Comment Edited] (TEZ-992) Recovery data should not be written on AsyncDispatcher thread

2014-11-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14219187#comment-14219187 ] Jeff Zhang edited comment on TEZ-992 at 11/20/14 10:56 AM: --- Seems t

[jira] [Updated] (TEZ-992) Recovery data should not be written on AsyncDispatcher thread

2014-11-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-992: --- Attachment: Vertex_FinishSaving.gv DAG_FinishSaving.gv > Recovery data should not be written on A

[jira] [Updated] (TEZ-992) Recovery data should not be written on AsyncDispatcher thread

2014-11-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-992: --- Attachment: (was: Vertex_FinishSaving.gv) > Recovery data should not be written on AsyncDispatcher thread > -

[jira] [Updated] (TEZ-992) Recovery data should not be written on AsyncDispatcher thread

2014-11-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-992: --- Attachment: (was: DAG_FinishSaving.gv) > Recovery data should not be written on AsyncDispatcher thread >

[jira] [Commented] (TEZ-1773) Add attempt failure cause enum to the attempt failed/killed history record

2014-11-21 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14220711#comment-14220711 ] Jeff Zhang commented on TEZ-1773: - Comments: * Would it be better change TaskAttemptImpl.tr

[jira] [Commented] (TEZ-992) Recovery data should not be written on AsyncDispatcher thread

2014-11-21 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14220720#comment-14220720 ] Jeff Zhang commented on TEZ-992: Update new state machines > Recovery data should not be wri

[jira] [Updated] (TEZ-992) Recovery data should not be written on AsyncDispatcher thread

2014-11-21 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-992: --- Attachment: DAG_FinishSaving_2.gv Vertex_FinishSaving_2.gv > Recovery data should not be written

[jira] [Comment Edited] (TEZ-1773) Add attempt failure cause enum to the attempt failed/killed history record

2014-11-21 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14220711#comment-14220711 ] Jeff Zhang edited comment on TEZ-1773 at 11/21/14 9:40 AM: --- Commen

[jira] [Updated] (TEZ-992) Recovery data should not be written on AsyncDispatcher thread

2014-11-21 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-992: --- Attachment: TEZ-992.patch > Recovery data should not be written on AsyncDispatcher thread > -

[jira] [Commented] (TEZ-992) Recovery data should not be written on AsyncDispatcher thread

2014-11-21 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14220767#comment-14220767 ] Jeff Zhang commented on TEZ-992: Attach one patch. It is one initial patch, should refine it

[jira] [Comment Edited] (TEZ-992) Recovery data should not be written on AsyncDispatcher thread

2014-11-21 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14220767#comment-14220767 ] Jeff Zhang edited comment on TEZ-992 at 11/21/14 10:49 AM: --- Attach

[jira] [Comment Edited] (TEZ-992) Recovery data should not be written on AsyncDispatcher thread

2014-11-21 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14220767#comment-14220767 ] Jeff Zhang edited comment on TEZ-992 at 11/21/14 10:49 AM: --- Attach

[jira] [Comment Edited] (TEZ-992) Recovery data should not be written on AsyncDispatcher thread

2014-11-21 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14220767#comment-14220767 ] Jeff Zhang edited comment on TEZ-992 at 11/21/14 10:50 AM: --- Attach

<    16   17   18   19   20   21   22   23   24   25   >