[jira] [Commented] (TEZ-2305) MR compatibility sleep job fails with IOException: Undefined job output-path

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14519104#comment-14519104 ] Jeff Zhang commented on TEZ-2305: - Thanks [~hitesh] Committed to 0.5, 0.6 & master > MR com

[jira] [Updated] (TEZ-2384) Add warning message in the case of prewarn under non-session mode

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2384: Issue Type: Improvement (was: Bug) > Add warning message in the case of prewarn under non-session mode >

[jira] [Updated] (TEZ-1521) VertexDataMovementEventsGeneratedEvent may be logged twice in recovery log

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1521: Attachment: TEZ-1521-1.patch > VertexDataMovementEventsGeneratedEvent may be logged twice in recovery log > -

[jira] [Created] (TEZ-2385) branch-0.6 compile failure

2015-04-29 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2385: --- Summary: branch-0.6 compile failure Key: TEZ-2385 URL: https://issues.apache.org/jira/browse/TEZ-2385 Project: Apache Tez Issue Type: Bug Reporter: Jeff Zh

[jira] [Updated] (TEZ-2385) branch-0.6 compile failure

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2385: Description: due to TEZ-2226 > branch-0.6 compile failure > -- > > Key

[jira] [Updated] (TEZ-2385) branch-0.6 compile failure

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2385: Priority: Critical (was: Major) > branch-0.6 compile failure > -- > >

[jira] [Updated] (TEZ-2385) branch-0.6 compile failure

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2385: Affects Version/s: 0.6.1 > branch-0.6 compile failure > -- > > Key: TE

[jira] [Updated] (TEZ-2385) branch-0.6 compile failure

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2385: Target Version/s: 0.6.1 > branch-0.6 compile failure > -- > > Key: TEZ

[jira] [Updated] (TEZ-2385) branch-0.6 compile failure

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2385: Description: due to TEZ-2226. DAG/Vertex level configuration is not available in 0.6 (was: due to TEZ-2226.

[jira] [Updated] (TEZ-2385) branch-0.6 compile failure

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2385: Description: due to TEZ-2226. DAG/Vertex level configuration is not available in 0.6, may need to use the AM

[jira] [Updated] (TEZ-2385) branch-0.6 compile failure

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2385: Description: due to TEZ-2226. DAG/Vertex level configuration is not available in 00.6 (was: due to TEZ-2226)

[jira] [Updated] (TEZ-2385) branch-0.6 compile failure

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2385: Description: due to TEZ-2226. DAG/Vertex level configuration is not available in 0.6, may need to use the AM

[jira] [Updated] (TEZ-2305) MR compatibility sleep job fails with IOException: Undefined job output-path

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2305: Target Version/s: 0.7.0, 0.5.4, 0.6.1 (was: 0.5.4, 0.6.1) Fix Version/s: 0.7.0 > MR compatibility slee

[jira] [Commented] (TEZ-1560) Invalid state machine handling for V_SOURCE_VERTEX_RECOVERED in recovery

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520675#comment-14520675 ] Jeff Zhang commented on TEZ-1560: - [~hitesh] I have fix the conflict and committed to branch

[jira] [Comment Edited] (TEZ-1560) Invalid state machine handling for V_SOURCE_VERTEX_RECOVERED in recovery

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520675#comment-14520675 ] Jeff Zhang edited comment on TEZ-1560 at 4/30/15 1:28 AM: -- [~hitesh

[jira] [Commented] (TEZ-1521) VertexDataMovementEventsGeneratedEvent may be logged twice in recovery log

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520693#comment-14520693 ] Jeff Zhang commented on TEZ-1521: - [~hitesh] The root_input_data_information_event may be ro

[jira] [Updated] (TEZ-2221) VertexGroup name should be unqiue

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2221: Attachment: TEZ-2221-3.patch > VertexGroup name should be unqiue > - > >

[jira] [Commented] (TEZ-2221) VertexGroup name should be unqiue

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520714#comment-14520714 ] Jeff Zhang commented on TEZ-2221: - [~hitesh] Sorry for response late. Upload new patch to

[jira] [Commented] (TEZ-2386) Tez UI: Inconsistent usage of icon colors

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520717#comment-14520717 ] Jeff Zhang commented on TEZ-2386: - +1 on the java code part > Tez UI: Inconsistent usage of

[jira] [Updated] (TEZ-2221) VertexGroup name should be unqiue

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2221: Attachment: TEZ-2221-4.patch Upload new patch to address the review comments > VertexGroup name should be unq

[jira] [Commented] (TEZ-1521) VertexDataMovementEventsGeneratedEvent may be logged twice in recovery log

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520858#comment-14520858 ] Jeff Zhang commented on TEZ-1521: - Thanks [~hitesh] Committed to branch-0.5, branch-0.6 & ma

[jira] [Commented] (TEZ-2221) VertexGroup name should be unqiue

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520871#comment-14520871 ] Jeff Zhang commented on TEZ-2221: - Thanks [~hitesh] Committed to branch-0.5, branch-0.6 & ma

[jira] [Updated] (TEZ-2188) Verify vertex with bipartite source vertex and root input in client side

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2188: Attachment: TEZ-2188-2.patch Rebase the patch, [~bikassaha] Please help review it. > Verify vertex with bipar

[jira] [Created] (TEZ-2402) Handle DataMovementEvent before its TaskAttemptCompletedEvent

2015-05-03 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2402: --- Summary: Handle DataMovementEvent before its TaskAttemptCompletedEvent Key: TEZ-2402 URL: https://issues.apache.org/jira/browse/TEZ-2402 Project: Apache Tez Issue Typ

[jira] [Created] (TEZ-2403) Handle DataMovementEvent before its TaskAttemptCompletedEvent

2015-05-03 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2403: --- Summary: Handle DataMovementEvent before its TaskAttemptCompletedEvent Key: TEZ-2403 URL: https://issues.apache.org/jira/browse/TEZ-2403 Project: Apache Tez Issue Typ

[jira] [Created] (TEZ-2404) Handle DataMovementEvent before its TaskAttemptCompletedEvent

2015-05-03 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2404: --- Summary: Handle DataMovementEvent before its TaskAttemptCompletedEvent Key: TEZ-2404 URL: https://issues.apache.org/jira/browse/TEZ-2404 Project: Apache Tez Issue Typ

[jira] [Commented] (TEZ-2404) Handle DataMovementEvent before its TaskAttemptCompletedEvent

2015-05-03 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526248#comment-14526248 ] Jeff Zhang commented on TEZ-2404: - After rethinking, method 2 doesn't work. Because after TE

[jira] [Updated] (TEZ-2404) Handle DataMovementEvent before its TaskAttemptCompletedEvent

2015-05-03 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2404: Attachment: TEZ-2404-1.patch > Handle DataMovementEvent before its TaskAttemptCompletedEvent > ---

[jira] [Updated] (TEZ-2404) Handle DataMovementEvent before its TaskAttemptCompletedEvent

2015-05-04 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2404: Attachment: TEZ-2404-2.patch Rebase patch > Handle DataMovementEvent before its TaskAttemptCompletedEvent > -

[jira] [Updated] (TEZ-2404) Handle DataMovementEvent before its TaskAttemptCompletedEvent

2015-05-04 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2404: Attachment: (was: TEZ-2404-2.patch) > Handle DataMovementEvent before its TaskAttemptCompletedEvent >

[jira] [Updated] (TEZ-2404) Handle DataMovementEvent before its TaskAttemptCompletedEvent

2015-05-04 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2404: Attachment: TEZ-2404-2.patch > Handle DataMovementEvent before its TaskAttemptCompletedEvent > ---

[jira] [Commented] (TEZ-2404) Handle DataMovementEvent before its TaskAttemptCompletedEvent

2015-05-04 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526449#comment-14526449 ] Jeff Zhang commented on TEZ-2404: - [~hitesh] [~bikassaha] [~pramachandran] Please help revie

[jira] [Commented] (TEZ-2221) VertexGroup name should be unqiue

2015-05-04 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527869#comment-14527869 ] Jeff Zhang commented on TEZ-2221: - I think this is must to have to disallow {code} dag.creat

[jira] [Created] (TEZ-2410) VertexGroupCommitFinishedEvent is not logged correctly

2015-05-04 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2410: --- Summary: VertexGroupCommitFinishedEvent is not logged correctly Key: TEZ-2410 URL: https://issues.apache.org/jira/browse/TEZ-2410 Project: Apache Tez Issue Type: Bug

[jira] [Commented] (TEZ-2221) VertexGroup name should be unqiue

2015-05-04 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527937#comment-14527937 ] Jeff Zhang commented on TEZ-2221: - {code} If VertexGroup("A", v1) and VertexGroup("B", v1) a

[jira] [Updated] (TEZ-2410) VertexGroupCommitFinishedEvent is not logged correctly

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2410: Attachment: TEZ-2410-1.patch > VertexGroupCommitFinishedEvent is not logged correctly > --

[jira] [Created] (TEZ-2412) Should kill vertex if vertex rerun is failed in DAGImpl#VertexRerunWhileCommitting

2015-05-05 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2412: --- Summary: Should kill vertex if vertex rerun is failed in DAGImpl#VertexRerunWhileCommitting Key: TEZ-2412 URL: https://issues.apache.org/jira/browse/TEZ-2412 Project: Apache Te

[jira] [Updated] (TEZ-2412) Should kill vertex if vertex rerun is failed in DAGImpl#VertexRerunWhileCommitting

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2412: Description: When vertex rerun, it move to RUNNING state, so should kill it in > Should kill vertex if verte

[jira] [Updated] (TEZ-2412) Should kill vertex if vertex rerun is failed in DAGImpl#VertexRerunWhileCommitting

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2412: Description: Actually 2 issues * When vertex rerun, it move to RUNNING state, so should kill it in DAGImpl#Ve

[jira] [Updated] (TEZ-2412) Should kill vertex if vertex rerun is failed in DAGImpl#VertexRerunWhileCommitting

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2412: Description: * When vertex rerun, it move to RUNNING state, so should kill it in DAGImpl#VertexRerunWhileCom

[jira] [Updated] (TEZ-2413) No need to check whether vertex has been committed as shared output in DAGImpl#vertexreRunning

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2413: Description: * Vertex only send out DAGEventVertexReRunning when vertex.commitVertexOutputs is false, that m

[jira] [Created] (TEZ-2413) No need to check whether vertex has been committed as shared output in DAGImpl#vertexreRunning

2015-05-05 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2413: --- Summary: No need to check whether vertex has been committed as shared output in DAGImpl#vertexreRunning Key: TEZ-2413 URL: https://issues.apache.org/jira/browse/TEZ-2413 Projec

[jira] [Updated] (TEZ-2413) No need to check whether vertex has been committed as shared output in DAGImpl#vertexreRunning

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2413: Description: * Vertex only send out DAGEventVertexReRunning when vertex.commitVertexOutputs is false, that me

[jira] [Updated] (TEZ-2413) No need to check whether vertex has been committed as shared output in DAGImpl#vertexreRunning

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2413: Target Version/s: 0.7.1 Fix Version/s: 0.7.1 > No need to check whether vertex has been committed as sh

[jira] [Commented] (TEZ-2410) VertexGroupCommitFinishedEvent is not logged correctly

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14528099#comment-14528099 ] Jeff Zhang commented on TEZ-2410: - [~bikassaha] Please help review it. Also create 2 ticket

[jira] [Updated] (TEZ-2412) Should kill vertex in DAGImpl#VertexRerunWhileCommitting

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2412: Attachment: TEZ-2412-1.patch > Should kill vertex in DAGImpl#VertexRerunWhileCommitting >

[jira] [Updated] (TEZ-2412) Should kill vertex in DAGImpl#VertexRerunWhileCommitting

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2412: Summary: Should kill vertex in DAGImpl#VertexRerunWhileCommitting (was: Should kill vertex if vertex rerun is

[jira] [Commented] (TEZ-2412) Should kill vertex in DAGImpl#VertexRerunWhileCommitting

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14528390#comment-14528390 ] Jeff Zhang commented on TEZ-2412: - [~bikassaha] Please help view it. > Should kill vertex

[jira] [Updated] (TEZ-2412) Should kill vertex in DAGImpl#VertexRerunWhileCommitting

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2412: Priority: Blocker (was: Major) > Should kill vertex in DAGImpl#VertexRerunWhileCommitting > -

[jira] [Commented] (TEZ-2221) VertexGroup name should be unqiue

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14529628#comment-14529628 ] Jeff Zhang commented on TEZ-2221: - Thanks [~bikassaha] [~rohini] for clarifying it. I will r

[jira] [Updated] (TEZ-2221) VertexGroup name should be unqiue

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2221: Attachment: TEZ-2221-5-revert.patch > VertexGroup name should be unqiue > - >

[jira] [Commented] (TEZ-2221) VertexGroup name should be unqiue

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14529691#comment-14529691 ] Jeff Zhang commented on TEZ-2221: - Attach a new patch to revert the part of the change. Now

[jira] [Commented] (TEZ-2412) Should kill vertex in DAGImpl#VertexRerunWhileCommitting

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14529762#comment-14529762 ] Jeff Zhang commented on TEZ-2412: - [~bikassaha] I'm afraid allow checkVerticesForCompletion

[jira] [Comment Edited] (TEZ-2412) Should kill vertex in DAGImpl#VertexRerunWhileCommitting

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14529762#comment-14529762 ] Jeff Zhang edited comment on TEZ-2412 at 5/6/15 2:06 AM: - [~bikassah

[jira] [Commented] (TEZ-2410) VertexGroupCommitFinishedEvent is not logged correctly

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14529778#comment-14529778 ] Jeff Zhang commented on TEZ-2410: - bq. The new VertexGroupStatus enum is duplicating the log

[jira] [Updated] (TEZ-2410) VertexGroupCommitFinishedEvent is not logged correctly

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2410: Attachment: TEZ-2410-1.patch > VertexGroupCommitFinishedEvent is not logged correctly > --

[jira] [Updated] (TEZ-1961) Remove misleading exception "No running dag" from AM logs

2015-05-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1961: Attachment: TEZ-1961-1.patch Upload the trivial patch (log the message instead of throw exception). [~sseth]

[jira] [Commented] (TEZ-1961) Remove misleading exception "No running dag" from AM logs

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14530064#comment-14530064 ] Jeff Zhang commented on TEZ-1961: - Right, thanks [~sseth], will upload a new patch to fix it

[jira] [Commented] (TEZ-2404) Handle DataMovementEvent before its TaskAttemptCompletedEvent

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14530259#comment-14530259 ] Jeff Zhang commented on TEZ-2404: - bq. This does still give us most of the benefits of TEZ-2

[jira] [Comment Edited] (TEZ-2404) Handle DataMovementEvent before its TaskAttemptCompletedEvent

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14530259#comment-14530259 ] Jeff Zhang edited comment on TEZ-2404 at 5/6/15 10:11 AM: -- bq. This

[jira] [Commented] (TEZ-1961) Remove misleading exception "No running dag" from AM logs

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14530410#comment-14530410 ] Jeff Zhang commented on TEZ-1961: - [~sseth] indicating NoRunningDag via a valid RPC respons

[jira] [Commented] (TEZ-2410) VertexGroupCommitFinishedEvent is not logged correctly

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14531728#comment-14531728 ] Jeff Zhang commented on TEZ-2410: - bq. Why is this the case? Why do we not log vertex group

[jira] [Comment Edited] (TEZ-2410) VertexGroupCommitFinishedEvent is not logged correctly

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14531728#comment-14531728 ] Jeff Zhang edited comment on TEZ-2410 at 5/7/15 12:00 AM: -- bq. Why

[jira] [Updated] (TEZ-2410) VertexGroupCommitFinishedEvent & VertexCommitStartedEvent is not logged correctly

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2410: Summary: VertexGroupCommitFinishedEvent & VertexCommitStartedEvent is not logged correctly (was: VertexGroupC

[jira] [Updated] (TEZ-2410) VertexGroupCommitFinishedEvent is not logged correctly

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2410: Attachment: TEZ-2410-2.patch > VertexGroupCommitFinishedEvent is not logged correctly > --

[jira] [Updated] (TEZ-2410) VertexGroupCommitFinishedEvent & VertexCommitStartedEvent is not logged correctly

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2410: Description: VertexGroupCommitFinishedEvent may be logged for non-vertex group commits. VertexGroupCommitFinis

[jira] [Assigned] (TEZ-2427) TestFaultTolerance NPE in RecoveryService

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang reassigned TEZ-2427: --- Assignee: Jeff Zhang > TestFaultTolerance NPE in RecoveryService >

[jira] [Commented] (TEZ-2410) VertexGroupCommitFinishedEvent & VertexCommitStartedEvent is not logged correctly

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14531903#comment-14531903 ] Jeff Zhang commented on TEZ-2410: - Upload new patch to address the issues in comments. [~bik

[jira] [Commented] (TEZ-2404) Handle DataMovementEvent before its TaskAttemptCompletedEvent

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14531953#comment-14531953 ] Jeff Zhang commented on TEZ-2404: - Need to add some comment, and will commit soon. > Handl

[jira] [Created] (TEZ-2430) Add test for RecoveryEvent Spec

2015-05-06 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2430: --- Summary: Add test for RecoveryEvent Spec Key: TEZ-2430 URL: https://issues.apache.org/jira/browse/TEZ-2430 Project: Apache Tez Issue Type: Improvement Repo

[jira] [Updated] (TEZ-2427) TestFaultTolerance NPE in RecoveryService

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2427: Target Version/s: 0.7.0 > TestFaultTolerance NPE in RecoveryService >

[jira] [Commented] (TEZ-2404) Handle DataMovementEvent before its TaskAttemptCompletedEvent

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14532007#comment-14532007 ] Jeff Zhang commented on TEZ-2404: - Upload a new patch ( add some comments to highlight the e

[jira] [Updated] (TEZ-2404) Handle DataMovementEvent before its TaskAttemptCompletedEvent

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2404: Attachment: TEZ-2404-3.patch > Handle DataMovementEvent before its TaskAttemptCompletedEvent > ---

[jira] [Updated] (TEZ-1961) Remove misleading exception "No running dag" from AM logs

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1961: Attachment: TEZ-1961-2.patch > Remove misleading exception "No running dag" from AM logs > ---

[jira] [Commented] (TEZ-2427) TestFaultTolerance NPE in RecoveryService

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14532042#comment-14532042 ] Jeff Zhang commented on TEZ-2427: - The issue is due to DAGFinishedEvent is logged twice in t

[jira] [Updated] (TEZ-1961) Remove misleading exception "No running dag" from AM logs

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1961: Attachment: TEZ-1961-3.patch Minor update on the patch to fix the findbugs issue and test failure > Remove mi

[jira] [Commented] (TEZ-2427) TestFaultTolerance NPE in RecoveryService

2015-05-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14532048#comment-14532048 ] Jeff Zhang commented on TEZ-2427: - [~hitesh] Saw the app logs in TEZ-2429 > TestFaultTolera

[jira] [Commented] (TEZ-1961) Remove misleading exception "No running dag" from AM logs

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14532244#comment-14532244 ] Jeff Zhang commented on TEZ-1961: - [~sseth] Please help review it. * Wait for DAGAppMaster

[jira] [Commented] (TEZ-1961) Remove misleading exception "No running dag" from AM logs

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14533607#comment-14533607 ] Jeff Zhang commented on TEZ-1961: - bq. That was because it returns session status, which mak

[jira] [Commented] (TEZ-2221) VertexGroup name should be unqiue

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14533628#comment-14533628 ] Jeff Zhang commented on TEZ-2221: - [~rohini] It's been committed, suppose it won't affect pi

[jira] [Commented] (TEZ-1961) Remove misleading exception "No running dag" from AM logs

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14533653#comment-14533653 ] Jeff Zhang commented on TEZ-1961: - I also rename DAGClientHandler#getSessionState to DAGClie

[jira] [Comment Edited] (TEZ-1961) Remove misleading exception "No running dag" from AM logs

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14533653#comment-14533653 ] Jeff Zhang edited comment on TEZ-1961 at 5/8/15 12:17 AM: -- I also r

[jira] [Updated] (TEZ-2410) VertexGroupCommitFinishedEvent & VertexCommitStartedEvent is not logged correctly

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2410: Attachment: TEZ-2410-3.patch > VertexGroupCommitFinishedEvent & VertexCommitStartedEvent is not logged > corr

[jira] [Commented] (TEZ-2410) VertexGroupCommitFinishedEvent & VertexCommitStartedEvent is not logged correctly

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14533677#comment-14533677 ] Jeff Zhang commented on TEZ-2410: - [~bikassaha] Sorry for my ugly mistake in my last patch.

[jira] [Comment Edited] (TEZ-1961) Remove misleading exception "No running dag" from AM logs

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14533653#comment-14533653 ] Jeff Zhang edited comment on TEZ-1961 at 5/8/15 12:47 AM: -- I also r

[jira] [Comment Edited] (TEZ-1961) Remove misleading exception "No running dag" from AM logs

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14533653#comment-14533653 ] Jeff Zhang edited comment on TEZ-1961 at 5/8/15 12:48 AM: -- I also r

[jira] [Commented] (TEZ-2410) VertexGroupCommitFinishedEvent & VertexCommitStartedEvent is not logged correctly

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14533733#comment-14533733 ] Jeff Zhang commented on TEZ-2410: - bq. Did not find any testDAGCommitSucceeded_OnDAGSuccess.

[jira] [Updated] (TEZ-2430) Add test for RecoveryEvent Spec

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2430: Target Version/s: 0.7.1 > Add test for RecoveryEvent Spec > --- > >

[jira] [Comment Edited] (TEZ-2429) Tez AM does not die after hitting internal error

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14533776#comment-14533776 ] Jeff Zhang edited comment on TEZ-2429 at 5/8/15 2:47 AM: - Can reprod

[jira] [Commented] (TEZ-2429) Tez AM does not die after hitting internal error

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14533776#comment-14533776 ] Jeff Zhang commented on TEZ-2429: - Can produce the InvalidTransition in TestFaultTolerance,

[jira] [Commented] (TEZ-2421) Deadlock in AM because attempt and vertex locking each other out

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14533847#comment-14533847 ] Jeff Zhang commented on TEZ-2421: - [~bikassaha], I look at the jstack trace, not sure where'

[jira] [Commented] (TEZ-2410) VertexGroupCommitFinishedEvent & VertexCommitStartedEvent is not logged correctly

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14533851#comment-14533851 ] Jeff Zhang commented on TEZ-2410: - Committed to branch-0.7 & master. > VertexGroupCommitFi

[jira] [Updated] (TEZ-2412) Should kill vertex in DAGImpl#VertexRerunWhileCommitting

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2412: Attachment: TEZ-2412-2.patch Rebase the patch and add some comments in code. > Should kill vertex in DAGImpl

[jira] [Commented] (TEZ-2421) Deadlock in AM because attempt and vertex locking each other out

2015-05-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14533904#comment-14533904 ] Jeff Zhang commented on TEZ-2421: - It cause the TestAMRecovery fail. {code} 2015-05-08 13

[jira] [Commented] (TEZ-2412) Should kill vertex in DAGImpl#VertexRerunWhileCommitting

2015-05-08 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14534393#comment-14534393 ] Jeff Zhang commented on TEZ-2412: - Committed to master & branch-0.7. > Should kill vertex i

[jira] [Commented] (TEZ-2426) Task input not complete before sending Task completed event

2015-05-08 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14534404#comment-14534404 ] Jeff Zhang commented on TEZ-2426: - lgtm +1 > Task input not complete before sending Task co

[jira] [Commented] (TEZ-2429) Tez AM does not die after hitting internal error

2015-05-08 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14534565#comment-14534565 ] Jeff Zhang commented on TEZ-2429: - The following case may cause the invalid transition ( Inv

[jira] [Updated] (TEZ-1529) ATS and TezClient integration in secure kerberos enabled cluster

2015-05-08 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1529: Target Version/s: 0.7.0, 0.5.4, 0.6.1 (was: 0.5.4, 0.6.1) > ATS and TezClient integration in secure kerberos

[jira] [Updated] (TEZ-1961) Remove misleading exception "No running dag" from AM logs

2015-05-08 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1961: Target Version/s: 0.7.1 (was: 0.7.0) > Remove misleading exception "No running dag" from AM logs > --

[jira] [Updated] (TEZ-2427) TestFaultTolerance NPE in RecoveryService

2015-05-08 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2427: Target Version/s: 0.7.1 (was: 0.7.0) > TestFaultTolerance NPE in RecoveryService > --

<    1   2   3   4   5   6   7   8   9   10   >