[jira] [Created] (TEZ-2376) Remove TaskAttemptEventType.TA_DIAGNOSTICS_UPDATE

2015-04-28 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2376: --- Summary: Remove TaskAttemptEventType.TA_DIAGNOSTICS_UPDATE Key: TEZ-2376 URL: https://issues.apache.org/jira/browse/TEZ-2376 Project: Apache Tez Issue Type: Bug

[jira] [Updated] (TEZ-2376) Remove TaskAttemptEventType.TA_DIAGNOSTICS_UPDATE

2015-04-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2376: Attachment: TEZ-2376-1.patch Remove TaskAttemptEventType.TA_DIAGNOSTICS_UPDATE

[jira] [Commented] (TEZ-1560) Invalid state machine transition in recovery

2015-04-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516395#comment-14516395 ] Jeff Zhang commented on TEZ-1560: - Upload a patch to fix this issue. The issue is that we

[jira] [Comment Edited] (TEZ-1560) Invalid state machine transition in recovery

2015-04-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516395#comment-14516395 ] Jeff Zhang edited comment on TEZ-1560 at 4/28/15 5:22 AM: -- Upload a

[jira] [Commented] (TEZ-1897) Create a concurrent version of AsyncDispatcher

2015-04-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516530#comment-14516530 ] Jeff Zhang commented on TEZ-1897: - Which one is the latest patch ? Saw 2 TEZ-1897.5.patch

[jira] [Commented] (TEZ-2221) VertexGroup name should be unqiue

2015-05-04 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14527869#comment-14527869 ] Jeff Zhang commented on TEZ-2221: - I think this is must to have to disallow {code}

[jira] [Created] (TEZ-2410) VertexGroupCommitFinishedEvent is not logged correctly

2015-05-04 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2410: --- Summary: VertexGroupCommitFinishedEvent is not logged correctly Key: TEZ-2410 URL: https://issues.apache.org/jira/browse/TEZ-2410 Project: Apache Tez Issue Type: Bug

[jira] [Commented] (TEZ-2221) VertexGroup name should be unqiue

2015-05-04 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14527937#comment-14527937 ] Jeff Zhang commented on TEZ-2221: - {code} If VertexGroup(A, v1) and VertexGroup(B, v1) and

[jira] [Commented] (TEZ-2412) Should kill vertex in DAGImpl#VertexRerunWhileCommitting

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528390#comment-14528390 ] Jeff Zhang commented on TEZ-2412: - [~bikassaha] Please help view it. Should kill vertex

[jira] [Commented] (TEZ-2221) VertexGroup name should be unqiue

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529628#comment-14529628 ] Jeff Zhang commented on TEZ-2221: - Thanks [~bikassaha] [~rohini] for clarifying it. I will

[jira] [Commented] (TEZ-2412) Should kill vertex in DAGImpl#VertexRerunWhileCommitting

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529762#comment-14529762 ] Jeff Zhang commented on TEZ-2412: - [~bikassaha] I'm afraid allow checkVerticesForCompletion

[jira] [Comment Edited] (TEZ-2412) Should kill vertex in DAGImpl#VertexRerunWhileCommitting

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529762#comment-14529762 ] Jeff Zhang edited comment on TEZ-2412 at 5/6/15 2:06 AM: -

[jira] [Commented] (TEZ-2221) VertexGroup name should be unqiue

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529691#comment-14529691 ] Jeff Zhang commented on TEZ-2221: - Attach a new patch to revert the part of the change. Now

[jira] [Updated] (TEZ-2221) VertexGroup name should be unqiue

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2221: Attachment: TEZ-2221-5-revert.patch VertexGroup name should be unqiue -

[jira] [Commented] (TEZ-2410) VertexGroupCommitFinishedEvent is not logged correctly

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529778#comment-14529778 ] Jeff Zhang commented on TEZ-2410: - bq. The new VertexGroupStatus enum is duplicating the

[jira] [Updated] (TEZ-2412) Should kill vertex in DAGImpl#VertexRerunWhileCommitting

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2412: Priority: Blocker (was: Major) Should kill vertex in DAGImpl#VertexRerunWhileCommitting

[jira] [Updated] (TEZ-2410) VertexGroupCommitFinishedEvent is not logged correctly

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2410: Attachment: TEZ-2410-1.patch VertexGroupCommitFinishedEvent is not logged correctly

[jira] [Updated] (TEZ-1961) Remove misleading exception No running dag from AM logs

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1961: Attachment: TEZ-1961-1.patch Upload the trivial patch (log the message instead of throw exception). [~sseth]

[jira] [Comment Edited] (TEZ-2404) Handle DataMovementEvent before its TaskAttemptCompletedEvent

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14530259#comment-14530259 ] Jeff Zhang edited comment on TEZ-2404 at 5/6/15 10:11 AM: -- bq. This

[jira] [Commented] (TEZ-1961) Remove misleading exception No running dag from AM logs

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14530064#comment-14530064 ] Jeff Zhang commented on TEZ-1961: - Right, thanks [~sseth], will upload a new patch to fix

[jira] [Commented] (TEZ-1961) Remove misleading exception No running dag from AM logs

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14530410#comment-14530410 ] Jeff Zhang commented on TEZ-1961: - [~sseth] indicating NoRunningDag via a valid RPC

[jira] [Commented] (TEZ-1961) Remove misleading exception No running dag from AM logs

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14533607#comment-14533607 ] Jeff Zhang commented on TEZ-1961: - bq. That was because it returns session status, which

[jira] [Commented] (TEZ-2221) VertexGroup name should be unqiue

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14533628#comment-14533628 ] Jeff Zhang commented on TEZ-2221: - [~rohini] It's been committed, suppose it won't affect

[jira] [Comment Edited] (TEZ-1961) Remove misleading exception No running dag from AM logs

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14533653#comment-14533653 ] Jeff Zhang edited comment on TEZ-1961 at 5/8/15 12:17 AM: -- I also

[jira] [Commented] (TEZ-1961) Remove misleading exception No running dag from AM logs

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14533653#comment-14533653 ] Jeff Zhang commented on TEZ-1961: - I also rename DAGClientHandler#getSessionState to

[jira] [Updated] (TEZ-2410) VertexGroupCommitFinishedEvent VertexCommitStartedEvent is not logged correctly

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2410: Attachment: TEZ-2410-3.patch VertexGroupCommitFinishedEvent VertexCommitStartedEvent is not logged

[jira] [Commented] (TEZ-2410) VertexGroupCommitFinishedEvent VertexCommitStartedEvent is not logged correctly

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14533733#comment-14533733 ] Jeff Zhang commented on TEZ-2410: - bq. Did not find any testDAGCommitSucceeded_OnDAGSuccess.

[jira] [Commented] (TEZ-2410) VertexGroupCommitFinishedEvent VertexCommitStartedEvent is not logged correctly

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14533677#comment-14533677 ] Jeff Zhang commented on TEZ-2410: - [~bikassaha] Sorry for my ugly mistake in my last patch.

[jira] [Comment Edited] (TEZ-1961) Remove misleading exception No running dag from AM logs

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14533653#comment-14533653 ] Jeff Zhang edited comment on TEZ-1961 at 5/8/15 12:48 AM: -- I also

[jira] [Comment Edited] (TEZ-1961) Remove misleading exception No running dag from AM logs

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14533653#comment-14533653 ] Jeff Zhang edited comment on TEZ-1961 at 5/8/15 12:47 AM: -- I also

[jira] [Commented] (TEZ-1961) Remove misleading exception No running dag from AM logs

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14532244#comment-14532244 ] Jeff Zhang commented on TEZ-1961: - [~sseth] Please help review it. * Wait for DAGAppMaster

[jira] [Updated] (TEZ-2412) Should kill vertex in DAGImpl#VertexRerunWhileCommitting

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2412: Attachment: TEZ-2412-2.patch Rebase the patch and add some comments in code. Should kill vertex in

[jira] [Comment Edited] (TEZ-2429) Tez AM does not die after hitting internal error

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14533776#comment-14533776 ] Jeff Zhang edited comment on TEZ-2429 at 5/8/15 2:47 AM: - Can

[jira] [Commented] (TEZ-2429) Tez AM does not die after hitting internal error

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14533776#comment-14533776 ] Jeff Zhang commented on TEZ-2429: - Can produce the InvalidTransition in TestFaultTolerance,

[jira] [Commented] (TEZ-2410) VertexGroupCommitFinishedEvent VertexCommitStartedEvent is not logged correctly

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14533851#comment-14533851 ] Jeff Zhang commented on TEZ-2410: - Committed to branch-0.7 master.

[jira] [Updated] (TEZ-2430) Add test for RecoveryEvent Spec

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2430: Target Version/s: 0.7.1 Add test for RecoveryEvent Spec ---

[jira] [Commented] (TEZ-2421) Deadlock in AM because attempt and vertex locking each other out

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14533904#comment-14533904 ] Jeff Zhang commented on TEZ-2421: - It cause the TestAMRecovery fail. {code} 2015-05-08

[jira] [Comment Edited] (TEZ-2410) VertexGroupCommitFinishedEvent is not logged correctly

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531728#comment-14531728 ] Jeff Zhang edited comment on TEZ-2410 at 5/7/15 12:00 AM: -- bq. Why

[jira] [Commented] (TEZ-2410) VertexGroupCommitFinishedEvent is not logged correctly

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531728#comment-14531728 ] Jeff Zhang commented on TEZ-2410: - bq. Why is this the case? Why do we not log vertex group

[jira] [Assigned] (TEZ-2427) TestFaultTolerance NPE in RecoveryService

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang reassigned TEZ-2427: --- Assignee: Jeff Zhang TestFaultTolerance NPE in RecoveryService

[jira] [Commented] (TEZ-2404) Handle DataMovementEvent before its TaskAttemptCompletedEvent

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531953#comment-14531953 ] Jeff Zhang commented on TEZ-2404: - Need to add some comment, and will commit soon. Handle

[jira] [Updated] (TEZ-2410) VertexGroupCommitFinishedEvent is not logged correctly

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2410: Attachment: TEZ-2410-2.patch VertexGroupCommitFinishedEvent is not logged correctly

[jira] [Updated] (TEZ-2410) VertexGroupCommitFinishedEvent VertexCommitStartedEvent is not logged correctly

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2410: Summary: VertexGroupCommitFinishedEvent VertexCommitStartedEvent is not logged correctly (was:

[jira] [Updated] (TEZ-2410) VertexGroupCommitFinishedEvent VertexCommitStartedEvent is not logged correctly

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2410: Description: VertexGroupCommitFinishedEvent may be logged for non-vertex group commits.

[jira] [Created] (TEZ-2430) Add test for RecoveryEvent Spec

2015-05-06 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2430: --- Summary: Add test for RecoveryEvent Spec Key: TEZ-2430 URL: https://issues.apache.org/jira/browse/TEZ-2430 Project: Apache Tez Issue Type: Improvement

[jira] [Commented] (TEZ-2410) VertexGroupCommitFinishedEvent VertexCommitStartedEvent is not logged correctly

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531903#comment-14531903 ] Jeff Zhang commented on TEZ-2410: - Upload new patch to address the issues in comments.

[jira] [Commented] (TEZ-2429) Tez AM does not die after hitting internal error

2015-05-08 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14534565#comment-14534565 ] Jeff Zhang commented on TEZ-2429: - The following case may cause the invalid transition (

[jira] [Updated] (TEZ-1529) ATS and TezClient integration in secure kerberos enabled cluster

2015-05-08 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1529: Target Version/s: 0.7.0, 0.5.4, 0.6.1 (was: 0.5.4, 0.6.1) ATS and TezClient integration in secure kerberos

[jira] [Commented] (TEZ-2421) Deadlock in AM because attempt and vertex locking each other out

2015-05-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14537617#comment-14537617 ] Jeff Zhang commented on TEZ-2421: - Thanks [~bikassaha], Committed to master branch-0.7

[jira] [Commented] (TEZ-2421) Deadlock in AM because attempt and vertex locking each other out

2015-05-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14537609#comment-14537609 ] Jeff Zhang commented on TEZ-2421: - Although couldn't reproduce the deadlock issue in

[jira] [Updated] (TEZ-2121) INPUT_BYTES counter to describe amount of data read by a task

2015-05-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2121: Fix Version/s: (was: 0.7.0) 0.7.1 INPUT_BYTES counter to describe amount of data

[jira] [Created] (TEZ-2435) Add public key to KEYS

2015-05-11 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2435: --- Summary: Add public key to KEYS Key: TEZ-2435 URL: https://issues.apache.org/jira/browse/TEZ-2435 Project: Apache Tez Issue Type: Improvement Reporter:

[jira] [Commented] (TEZ-2121) INPUT_BYTES counter to describe amount of data read by a task

2015-05-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14537752#comment-14537752 ] Jeff Zhang commented on TEZ-2121: - Move to 0.7.1 INPUT_BYTES counter to describe amount

[jira] [Updated] (TEZ-2121) INPUT_BYTES counter to describe amount of data read by a task

2015-05-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2121: Target Version/s: 0.7.1 (was: 0.7.0) INPUT_BYTES counter to describe amount of data read by a task

[jira] [Commented] (TEZ-2435) Add public key to KEYS

2015-05-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14537764#comment-14537764 ] Jeff Zhang commented on TEZ-2435: - Committed to master branch-0.7 Add public key to KEYS

[jira] [Resolved] (TEZ-2435) Add public key to KEYS

2015-05-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang resolved TEZ-2435. - Resolution: Fixed Target Version/s: 0.7.0 Add public key to KEYS --

[jira] [Updated] (TEZ-2435) Add public key to KEYS

2015-05-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2435: Attachment: TEZ-2435-1.patch Add public key to KEYS -- Key: TEZ-2435

[jira] [Commented] (TEZ-2435) Add public key to KEYS

2015-05-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14537759#comment-14537759 ] Jeff Zhang commented on TEZ-2435: - public key added to KEYS file, also publish it to

[jira] [Updated] (TEZ-2412) Should kill vertex if vertex rerun is failed in DAGImpl#VertexRerunWhileCommitting

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2412: Description: Actually 2 issues * When vertex rerun, it move to RUNNING state, so should kill it in

[jira] [Updated] (TEZ-2412) Should kill vertex if vertex rerun is failed in DAGImpl#VertexRerunWhileCommitting

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2412: Description: When vertex rerun, it move to RUNNING state, so should kill it in Should kill vertex if

[jira] [Updated] (TEZ-2413) No need to check whether vertex has been committed as shared output in DAGImpl#vertexreRunning

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2413: Description: * Vertex only send out DAGEventVertexReRunning when vertex.commitVertexOutputs is false, that

[jira] [Updated] (TEZ-2410) VertexGroupCommitFinishedEvent is not logged correctly

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2410: Attachment: TEZ-2410-1.patch VertexGroupCommitFinishedEvent is not logged correctly

[jira] [Updated] (TEZ-2412) Should kill vertex if vertex rerun is failed in DAGImpl#VertexRerunWhileCommitting

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2412: Description: * When vertex rerun, it move to RUNNING state, so should kill it in

[jira] [Updated] (TEZ-2413) No need to check whether vertex has been committed as shared output in DAGImpl#vertexreRunning

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2413: Target Version/s: 0.7.1 Fix Version/s: 0.7.1 No need to check whether vertex has been committed as

[jira] [Updated] (TEZ-2413) No need to check whether vertex has been committed as shared output in DAGImpl#vertexreRunning

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2413: Description: * Vertex only send out DAGEventVertexReRunning when vertex.commitVertexOutputs is false, that

[jira] [Created] (TEZ-2412) Should kill vertex if vertex rerun is failed in DAGImpl#VertexRerunWhileCommitting

2015-05-05 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2412: --- Summary: Should kill vertex if vertex rerun is failed in DAGImpl#VertexRerunWhileCommitting Key: TEZ-2412 URL: https://issues.apache.org/jira/browse/TEZ-2412 Project: Apache

[jira] [Created] (TEZ-2413) No need to check whether vertex has been committed as shared output in DAGImpl#vertexreRunning

2015-05-05 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2413: --- Summary: No need to check whether vertex has been committed as shared output in DAGImpl#vertexreRunning Key: TEZ-2413 URL: https://issues.apache.org/jira/browse/TEZ-2413

[jira] [Commented] (TEZ-2410) VertexGroupCommitFinishedEvent is not logged correctly

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528099#comment-14528099 ] Jeff Zhang commented on TEZ-2410: - [~bikassaha] Please help review it. Also create 2

[jira] [Updated] (TEZ-2412) Should kill vertex in DAGImpl#VertexRerunWhileCommitting

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2412: Summary: Should kill vertex in DAGImpl#VertexRerunWhileCommitting (was: Should kill vertex if vertex rerun

[jira] [Updated] (TEZ-2412) Should kill vertex in DAGImpl#VertexRerunWhileCommitting

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2412: Attachment: TEZ-2412-1.patch Should kill vertex in DAGImpl#VertexRerunWhileCommitting

[jira] [Commented] (TEZ-2421) Deadlock in AM because attempt and vertex locking each other out

2015-05-09 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14537013#comment-14537013 ] Jeff Zhang commented on TEZ-2421: - [~bikassaha] I guess you mean the following scenairo:

[jira] [Comment Edited] (TEZ-2421) Deadlock in AM because attempt and vertex locking each other out

2015-05-09 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14537013#comment-14537013 ] Jeff Zhang edited comment on TEZ-2421 at 5/10/15 3:26 AM: --

[jira] [Commented] (TEZ-2429) Tez AM does not die after hitting internal error

2015-05-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539050#comment-14539050 ] Jeff Zhang commented on TEZ-2429: - [~hitesh] [~bikassaha] AM shutdown is invoked according

[jira] [Created] (TEZ-2439) Should not throw exception in DAGClientHandler#getVertexStatus when DAG is not initialized

2015-05-11 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2439: --- Summary: Should not throw exception in DAGClientHandler#getVertexStatus when DAG is not initialized Key: TEZ-2439 URL: https://issues.apache.org/jira/browse/TEZ-2439 Project:

[jira] [Updated] (TEZ-2439) Should not throw exception in DAGClientHandler#getVertexStatus when DAG is not initialized

2015-05-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2439: Issue Type: Improvement (was: Bug) Should not throw exception in DAGClientHandler#getVertexStatus when DAG

[jira] [Updated] (TEZ-2439) Should not throw exception in DAGClientHandler#getVertexStatus when DAG is not initialized

2015-05-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2439: Target Version/s: 0.7.1 Should not throw exception in DAGClientHandler#getVertexStatus when DAG is not

[jira] [Commented] (TEZ-1529) ATS and TezClient integration in secure kerberos enabled cluster

2015-05-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539142#comment-14539142 ] Jeff Zhang commented on TEZ-1529: - This patch only pass with hadoop-2.6, don't work with

[jira] [Comment Edited] (TEZ-2437) FilterLinesByWord NPEs when run in Localmode

2015-05-12 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539347#comment-14539347 ] Jeff Zhang edited comment on TEZ-2437 at 5/12/15 6:31 AM: --

[jira] [Commented] (TEZ-2437) FilterLinesByWord NPEs when run in Localmode

2015-05-12 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539347#comment-14539347 ] Jeff Zhang commented on TEZ-2437: - [~tiwari] [~pramachandran] I think the fix is correct.

[jira] [Comment Edited] (TEZ-2437) FilterLinesByWord NPEs when run in Localmode

2015-05-12 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539347#comment-14539347 ] Jeff Zhang edited comment on TEZ-2437 at 5/12/15 6:34 AM: --

[jira] [Comment Edited] (TEZ-2437) FilterLinesByWord NPEs when run in Localmode

2015-05-12 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539347#comment-14539347 ] Jeff Zhang edited comment on TEZ-2437 at 5/12/15 6:35 AM: --

[jira] [Updated] (TEZ-2427) TestFaultTolerance NPE in RecoveryService

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2427: Target Version/s: 0.7.0 TestFaultTolerance NPE in RecoveryService -

[jira] [Updated] (TEZ-1961) Remove misleading exception No running dag from AM logs

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1961: Attachment: TEZ-1961-2.patch Remove misleading exception No running dag from AM logs

[jira] [Commented] (TEZ-2427) TestFaultTolerance NPE in RecoveryService

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14532048#comment-14532048 ] Jeff Zhang commented on TEZ-2427: - [~hitesh] Saw the app logs in TEZ-2429

[jira] [Commented] (TEZ-2427) TestFaultTolerance NPE in RecoveryService

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14532042#comment-14532042 ] Jeff Zhang commented on TEZ-2427: - The issue is due to DAGFinishedEvent is logged twice in

[jira] [Updated] (TEZ-2404) Handle DataMovementEvent before its TaskAttemptCompletedEvent

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2404: Attachment: TEZ-2404-3.patch Handle DataMovementEvent before its TaskAttemptCompletedEvent

[jira] [Commented] (TEZ-2404) Handle DataMovementEvent before its TaskAttemptCompletedEvent

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14532007#comment-14532007 ] Jeff Zhang commented on TEZ-2404: - Upload a new patch ( add some comments to highlight the

[jira] [Updated] (TEZ-1961) Remove misleading exception No running dag from AM logs

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1961: Attachment: TEZ-1961-3.patch Minor update on the patch to fix the findbugs issue and test failure Remove

[jira] [Updated] (TEZ-1776) TA_CONTAINER_TERMINATING event should not always fail the task attempt

2015-05-09 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1776: Target Version/s: 0.7.1 (was: 0.7.0) TA_CONTAINER_TERMINATING event should not always fail the task attempt

[jira] [Updated] (TEZ-2409) Allow different edges to have different routing plugins

2015-05-09 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2409: Target Version/s: 0.7.1 (was: 0.7.0) Allow different edges to have different routing plugins

[jira] [Updated] (TEZ-2429) Tez AM does not die after hitting internal error

2015-05-09 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2429: Target Version/s: 0.7.1 (was: 0.7.0) Tez AM does not die after hitting internal error

[jira] [Updated] (TEZ-1961) Remove misleading exception No running dag from AM logs

2015-05-09 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1961: Target Version/s: 0.7.1 (was: 0.7.0) Remove misleading exception No running dag from AM logs

[jira] [Updated] (TEZ-2427) TestFaultTolerance NPE in RecoveryService

2015-05-09 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2427: Target Version/s: 0.7.1 (was: 0.7.0) TestFaultTolerance NPE in RecoveryService

[jira] [Commented] (TEZ-2426) Task input not complete before sending Task completed event

2015-05-08 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14534404#comment-14534404 ] Jeff Zhang commented on TEZ-2426: - lgtm +1 Task input not complete before sending Task

[jira] [Commented] (TEZ-2426) Ensure the eventRouter thread completes before switching to a new task and thread safety fixes in IPOContexts.

2015-05-12 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539369#comment-14539369 ] Jeff Zhang commented on TEZ-2426: - [~daijy], This jira should not change that behavior,

[jira] [Comment Edited] (TEZ-2426) Ensure the eventRouter thread completes before switching to a new task and thread safety fixes in IPOContexts.

2015-05-12 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539369#comment-14539369 ] Jeff Zhang edited comment on TEZ-2426 at 5/12/15 6:50 AM: --

[jira] [Commented] (TEZ-2426) Ensure the eventRouter thread completes before switching to a new task and thread safety fixes in IPOContexts.

2015-05-13 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14541629#comment-14541629 ] Jeff Zhang commented on TEZ-2426: - Create TEZ-2445 for fix the object clean up issue.

[jira] [Updated] (TEZ-2437) FilterLinesByWord NPEs when run in Localmode

2015-05-13 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2437: Attachment: TEZ-2437-2.patch Attach the patch. FilterLinesByWord NPEs when run in Localmode

[jira] [Comment Edited] (TEZ-2437) FilterLinesByWord NPEs when run in Localmode

2015-05-13 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14541636#comment-14541636 ] Jeff Zhang edited comment on TEZ-2437 at 5/13/15 9:16 AM: --

[jira] [Commented] (TEZ-2437) FilterLinesByWord NPEs when run in Localmode

2015-05-13 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14541636#comment-14541636 ] Jeff Zhang commented on TEZ-2437: - [~pramachandran] [~tiwari] I think the simple solution is

<    7   8   9   10   11   12   13   14   15   16   >