[jira] [Updated] (TEZ-2561) Port for TaskAttemptListenerImpTezDag should be configurable

2015-06-18 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2561: Attachment: TEZ-2561-1.patch Upload a patch to allow specify port range between AM and task communication. [~

[jira] [Updated] (TEZ-2561) Port for TaskAttemptListenerImpTezDag should be configurable

2015-06-18 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2561: Attachment: TEZ-2561-2.patch Upload new patch to address the review comment > Port for TaskAttemptListenerImp

[jira] [Created] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-19 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2568: --- Summary: V_INPUT_DATA_INFORMATION may happen after vertex is initialized Key: TEZ-2568 URL: https://issues.apache.org/jira/browse/TEZ-2568 Project: Apache Tez Issue T

[jira] [Updated] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-19 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2568: Description: {code} 2015-06-19 15:57:28,462 ERROR [Dispatcher thread: Central] impl.VertexImpl: Can't handle

[jira] [Updated] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-19 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2568: Description: {code} 2015-06-19 15:57:28,462 ERROR [Dispatcher thread: Central] impl.VertexImpl: Can't handle

[jira] [Updated] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-19 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2568: Attachment: a.log attach AM log > V_INPUT_DATA_INFORMATION may happen after vertex is initialized > -

[jira] [Commented] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-19 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594254#comment-14594254 ] Jeff Zhang commented on TEZ-2568: - VertexImpl#setParallelism {code} LOG.info("Vertex

[jira] [Comment Edited] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-19 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594254#comment-14594254 ] Jeff Zhang edited comment on TEZ-2568 at 6/20/15 1:29 AM: -- check Ve

[jira] [Commented] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-19 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594283#comment-14594283 ] Jeff Zhang commented on TEZ-2568: - InputDataInformationTransition may also cause issue. One

[jira] [Comment Edited] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-19 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594283#comment-14594283 ] Jeff Zhang edited comment on TEZ-2568 at 6/20/15 1:53 AM: -- InputDat

[jira] [Updated] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-19 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2568: Description: {code} 2015-06-19 15:57:28,462 ERROR [Dispatcher thread: Central] impl.VertexImpl: Can't handle

[jira] [Updated] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-19 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2568: Description: {code} 2015-06-19 15:57:28,462 ERROR [Dispatcher thread: Central] impl.VertexImpl: Can't handle

[jira] [Commented] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-19 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594391#comment-14594391 ] Jeff Zhang commented on TEZ-2568: - Agree with [~sseth], it's VM's responsibility to send In

[jira] [Comment Edited] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-19 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594283#comment-14594283 ] Jeff Zhang edited comment on TEZ-2568 at 6/20/15 4:30 AM: -- InputDat

[jira] [Updated] (TEZ-2561) Port for TaskAttemptListenerImpTezDag should be configurable

2015-06-21 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2561: Attachment: TEZ-2561-3.patch Upload new patch to address comments > Port for TaskAttemptListenerImpTezDag sho

[jira] [Updated] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-21 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2568: Attachment: TEZ-2568-1.patch > V_INPUT_DATA_INFORMATION may happen after vertex is initialized > -

[jira] [Commented] (TEZ-2561) Port for TaskAttemptListenerImpTezDag should be configurable

2015-06-21 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14595380#comment-14595380 ] Jeff Zhang commented on TEZ-2561: - Thanks [~hitesh] for review, committed to 0.5,0.6,0.7 & m

[jira] [Updated] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-22 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2568: Attachment: (was: TEZ-2568-1.patch) > V_INPUT_DATA_INFORMATION may happen after vertex is initialized > --

[jira] [Updated] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-22 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2568: Attachment: TEZ-2568-1.patch > V_INPUT_DATA_INFORMATION may happen after vertex is initialized > -

[jira] [Updated] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-22 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2568: Attachment: (was: TEZ-2568-1.patch) > V_INPUT_DATA_INFORMATION may happen after vertex is initialized > --

[jira] [Updated] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-22 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2568: Attachment: TEZ-2568-1.patch > V_INPUT_DATA_INFORMATION may happen after vertex is initialized > -

[jira] [Commented] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-22 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14595781#comment-14595781 ] Jeff Zhang commented on TEZ-2568: - Upload one patch to fix the issue. [~bikassaha] Please he

[jira] [Commented] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-22 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14595828#comment-14595828 ] Jeff Zhang commented on TEZ-2568: - Please ignore the last patch, it doesn't solve the issue

[jira] [Updated] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-22 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2568: Attachment: TEZ-2568-2.patch > V_INPUT_DATA_INFORMATION may happen after vertex is initialized > -

[jira] [Commented] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-22 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14595866#comment-14595866 ] Jeff Zhang commented on TEZ-2568: - Upload new patch with minor change. * Only drain the Inp

[jira] [Comment Edited] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-22 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14596825#comment-14596825 ] Jeff Zhang edited comment on TEZ-2568 at 6/22/15 11:12 PM: --- Upload

[jira] [Updated] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-22 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2568: Attachment: TEZ-2568-3.patch Upload new patch (handling the login in Vertex side), unit test will be added so

[jira] [Updated] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-22 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2568: Attachment: TEZ-2568-4.patch Upload new patch with unit test added. * It's hard to simulate the case since we

[jira] [Updated] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-22 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2568: Attachment: TEZ-2568-5.patch Thanks for review [~bikassaha] Upload a patch to address it. Will commit it soon

[jira] [Commented] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-22 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14597037#comment-14597037 ] Jeff Zhang commented on TEZ-2568: - Committed to 0.7 & master > V_INPUT_DATA_INFORMATION may

[jira] [Updated] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-22 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2568: Target Version/s: 0.8.0, 0.7.1 (was: 0.7.1) > V_INPUT_DATA_INFORMATION may happen after vertex is initialized

[jira] [Commented] (TEZ-2570) Fix license header issue for eps image files

2015-06-23 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14598721#comment-14598721 ] Jeff Zhang commented on TEZ-2570: - +1 > Fix license header issue for eps image files >

[jira] [Commented] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-23 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14598788#comment-14598788 ] Jeff Zhang commented on TEZ-2568: - We can't control when and how many times user will call

[jira] [Comment Edited] (TEZ-2568) V_INPUT_DATA_INFORMATION may happen after vertex is initialized

2015-06-23 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14598788#comment-14598788 ] Jeff Zhang edited comment on TEZ-2568 at 6/24/15 3:20 AM: -- We can't

[jira] [Commented] (TEZ-2572) VertexManagerPlugins should be able to send RootInformationEvents outside of the onRootVertexInitialized inocation

2015-06-23 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14598821#comment-14598821 ] Jeff Zhang commented on TEZ-2572: - I think this is an internal risk on VertexManager not on

[jira] [Resolved] (TEZ-2550) DAGAppMaster gets locked up due to ATS

2015-06-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang resolved TEZ-2550. - Resolution: Duplicate Resolved in TEZ-2548 > DAGAppMaster gets locked up due to ATS > -

[jira] [Created] (TEZ-2573) Reuse readFields in method readTezXXXID for TezXXXID

2015-06-24 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2573: --- Summary: Reuse readFields in method readTezXXXID for TezXXXID Key: TEZ-2573 URL: https://issues.apache.org/jira/browse/TEZ-2573 Project: Apache Tez Issue Type: Improv

[jira] [Updated] (TEZ-2573) Reuse readFields in method readTezXXXID for TezXXXID

2015-06-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2573: Description: We have read related logic both in method readFields and readTezXXXID. We should reuse the same c

[jira] [Resolved] (TEZ-2573) Reuse readFields in method readTezXXXID for TezXXXID

2015-06-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang resolved TEZ-2573. - Resolution: Invalid Looks like it is for id cache > Reuse readFields in method readTezXXXID for TezXXXID >

[jira] [Issue Comment Deleted] (TEZ-2573) Reuse readFields in method readTezXXXID for TezXXXID

2015-06-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2573: Comment: was deleted (was: Looks like it is for id cache) > Reuse readFields in method readTezXXXID for TezXX

[jira] [Reopened] (TEZ-2573) Reuse readFields in method readTezXXXID for TezXXXID

2015-06-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang reopened TEZ-2573: - > Reuse readFields in method readTezXXXID for TezXXXID > -

[jira] [Updated] (TEZ-2573) Reuse readFields in method readTezXXXID for TezXXXID

2015-06-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2573: Assignee: (was: Jeff Zhang) > Reuse readFields in method readTezXXXID for TezXXXID >

[jira] [Updated] (TEZ-2573) Reuse readFields in method readTezXXXID for TezXXXID

2015-06-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2573: Priority: Minor (was: Major) > Reuse readFields in method readTezXXXID for TezXXXID > --

[jira] [Commented] (TEZ-2296) Add option to print counters for tez-examples

2015-06-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14600467#comment-14600467 ] Jeff Zhang commented on TEZ-2296: - [~saikatr] sorry for late response. The patch format is c

[jira] [Created] (TEZ-2576) It is not necessary to send NodeFailureEvent to task attempt of completed DAG

2015-06-24 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2576: --- Summary: It is not necessary to send NodeFailureEvent to task attempt of completed DAG Key: TEZ-2576 URL: https://issues.apache.org/jira/browse/TEZ-2576 Project: Apache Tez

[jira] [Commented] (TEZ-2576) It is not necessary to send NodeFailureEvent to task attempt of completed DAG

2015-06-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14600667#comment-14600667 ] Jeff Zhang commented on TEZ-2576: - This might cause state machine error when node failure ha

[jira] [Comment Edited] (TEZ-2576) It is not necessary to send NodeFailureEvent to task attempt of completed DAG

2015-06-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14600667#comment-14600667 ] Jeff Zhang edited comment on TEZ-2576 at 6/25/15 4:27 AM: -- This mig

[jira] [Comment Edited] (TEZ-2576) It is not necessary to send NodeFailureEvent to task attempt of completed DAG

2015-06-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14600667#comment-14600667 ] Jeff Zhang edited comment on TEZ-2576 at 6/25/15 4:28 AM: -- This wil

[jira] [Updated] (TEZ-2296) Add option to print counters for tez-examples

2015-06-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2296: Target Version/s: 0.8.0 > Add option to print counters for tez-examples >

[jira] [Commented] (TEZ-2296) Add option to print counters for tez-examples

2015-06-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14600765#comment-14600765 ] Jeff Zhang commented on TEZ-2296: - Thanks [~saikatr] Will commit it after prebuild > Add op

[jira] [Commented] (TEZ-2296) Add option to print counters for tez-examples

2015-06-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14600766#comment-14600766 ] Jeff Zhang commented on TEZ-2296: - Thanks [~saikatr] Will commit it after prebuild > Add op

[jira] [Created] (TEZ-2577) Create TaskAttemptScheduledEvent to track schedule started time.

2015-06-25 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2577: --- Summary: Create TaskAttemptScheduledEvent to track schedule started time. Key: TEZ-2577 URL: https://issues.apache.org/jira/browse/TEZ-2577 Project: Apache Tez Issue

[jira] [Updated] (TEZ-2577) Create TaskAttemptScheduledEvent to track scheduling started time.

2015-06-25 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2577: Summary: Create TaskAttemptScheduledEvent to track scheduling started time. (was: Create TaskAttemptSchedule

[jira] [Commented] (TEZ-2296) Add option to print counters for tez-examples

2015-06-25 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14600810#comment-14600810 ] Jeff Zhang commented on TEZ-2296: - Thanks for your contribution [~saikatr]. Committed to mas

[jira] [Created] (TEZ-2579) Incorrect comparison of TaskAttemptId

2015-06-29 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2579: --- Summary: Incorrect comparison of TaskAttemptId Key: TEZ-2579 URL: https://issues.apache.org/jira/browse/TEZ-2579 Project: Apache Tez Issue Type: Bug Report

[jira] [Updated] (TEZ-2579) Incorrect comparison of TaskAttemptId

2015-06-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2579: Description: TaskImpl#AttemptSucceededTransition {code} // issue kill to all other attempts for (T

[jira] [Updated] (TEZ-2579) Incorrect comparison of TaskAttemptId

2015-06-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2579: Description: TaskImpl#AttemptSucceededTransition {code} // issue kill to all other attempts for (T

[jira] [Updated] (TEZ-2579) Incorrect comparison of TaskAttemptId

2015-06-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2579: Attachment: TEZ-2579-1.patch > Incorrect comparison of TaskAttemptId > - >

[jira] [Commented] (TEZ-2579) Incorrect comparison of TaskAttemptId

2015-06-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605272#comment-14605272 ] Jeff Zhang commented on TEZ-2579: - Although it is incorrect comparison, it won't affect the

[jira] [Commented] (TEZ-2579) Incorrect comparison of TaskAttemptId

2015-06-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606615#comment-14606615 ] Jeff Zhang commented on TEZ-2579: - But the successful attempt should also be finished, right

[jira] [Comment Edited] (TEZ-2579) Incorrect comparison of TaskAttemptId

2015-06-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606615#comment-14606615 ] Jeff Zhang edited comment on TEZ-2579 at 6/29/15 11:17 PM: --- bq.

[jira] [Comment Edited] (TEZ-2579) Incorrect comparison of TaskAttemptId

2015-06-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606615#comment-14606615 ] Jeff Zhang edited comment on TEZ-2579 at 6/29/15 11:17 PM: --- bq. b

[jira] [Comment Edited] (TEZ-2579) Incorrect comparison of TaskAttemptId

2015-06-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606615#comment-14606615 ] Jeff Zhang edited comment on TEZ-2579 at 6/29/15 11:17 PM: --- bq. b

[jira] [Updated] (TEZ-2579) Incorrect comparison of TaskAttemptId

2015-06-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2579: Attachment: TEZ-2579-2.patch Make sense, post another patch to change it to "equals" > Incorrect comparison o

[jira] [Commented] (TEZ-2579) Incorrect comparison of TaskAttemptId

2015-06-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606765#comment-14606765 ] Jeff Zhang commented on TEZ-2579: - Committed to 0.6, 0.7 & master > Incorrect comparison of

[jira] [Updated] (TEZ-2581) Umbrella for Tez Recovery Redesign

2015-06-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2581: Issue Type: Improvement (was: Bug) > Umbrella for Tez Recovery Redesign > --

[jira] [Created] (TEZ-2581) Umbrella for Tez Recovery Redesign

2015-06-29 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2581: --- Summary: Umbrella for Tez Recovery Redesign Key: TEZ-2581 URL: https://issues.apache.org/jira/browse/TEZ-2581 Project: Apache Tez Issue Type: Bug Reporter:

[jira] [Updated] (TEZ-2581) Umbrella for Tez Recovery Redesign

2015-06-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2581: Attachment: TezRecoveryRedesignProposal.pdf Attach the design doc > Umbrella for Tez Recovery Redesign >

[jira] [Created] (TEZ-2583) Allow RecoveryService Pluggable

2015-06-29 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2583: --- Summary: Allow RecoveryService Pluggable Key: TEZ-2583 URL: https://issues.apache.org/jira/browse/TEZ-2583 Project: Apache Tez Issue Type: Sub-task Report

[jira] [Updated] (TEZ-2583) Allow RecoveryService Pluggable

2015-06-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2583: Description: RecoveryService is the component to write recovery logs. The purpose of allowing RecoveryService

[jira] [Created] (TEZ-2585) Use one event for each phase

2015-06-30 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2585: --- Summary: Use one event for each phase Key: TEZ-2585 URL: https://issues.apache.org/jira/browse/TEZ-2585 Project: Apache Tez Issue Type: Sub-task Reporter:

[jira] [Updated] (TEZ-2585) Use one event for each phase

2015-06-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2585: Description: Candidates * Attach InputDataInformationEvent to VertexInitializedEvent * Attach VertexParallelis

[jira] [Updated] (TEZ-1657) Consolite recovery logs to XXXRecoveryData for DAG/Vertex/Task/TaskAttempt

2015-06-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1657: Issue Type: Sub-task (was: Bug) Parent: TEZ-2581 > Consolite recovery logs to XXXRecoveryData for DAG

[jira] [Created] (TEZ-2586) Simplify the recovery process

2015-06-30 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2586: --- Summary: Simplify the recovery process Key: TEZ-2586 URL: https://issues.apache.org/jira/browse/TEZ-2586 Project: Apache Tez Issue Type: Sub-task Reporter:

[jira] [Updated] (TEZ-2586) Simplify the recovery process

2015-06-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2586: Description: There's totally 2 steps for recovery. * restoreFromEvent * RecoveryTransition This ticket is to m

[jira] [Updated] (TEZ-2586) Simplify the recovery process

2015-06-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2586: Description: There's totally 2 steps for recovery restoreFromEvent & RecoveryTransition This ticket is to make

[jira] [Updated] (TEZ-2586) Simplify the recovery process

2015-06-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2586: Description: There's totally 2 steps for recovery restoreFromEvent & RecoveryTransition This ticket is to make

[jira] [Updated] (TEZ-2588) Inproper argument name

2015-06-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2588: Labels: newbie (was: ) > Inproper argument name > -- > > Key: TEZ-2588 >

[jira] [Updated] (TEZ-2588) Inproper argument name

2015-06-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2588: Priority: Trivial (was: Major) > Inproper argument name > -- > > Key: TEZ

[jira] [Created] (TEZ-2588) Inproper argument name

2015-06-30 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2588: --- Summary: Inproper argument name Key: TEZ-2588 URL: https://issues.apache.org/jira/browse/TEZ-2588 Project: Apache Tez Issue Type: Improvement Reporter: Jef

[jira] [Created] (TEZ-2589) Define the completeness of VertexManager

2015-06-30 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2589: --- Summary: Define the completeness of VertexManager Key: TEZ-2589 URL: https://issues.apache.org/jira/browse/TEZ-2589 Project: Apache Tez Issue Type: Sub-task

[jira] [Created] (TEZ-2590) V_TASK_ATTEMPT_COMPLETED is added as both ignorable events and normal state machine transition

2015-06-30 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2590: --- Summary: V_TASK_ATTEMPT_COMPLETED is added as both ignorable events and normal state machine transition Key: TEZ-2590 URL: https://issues.apache.org/jira/browse/TEZ-2590 Proje

[jira] [Updated] (TEZ-2589) Define the completeness of VertexManager

2015-07-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2589: Description: VertexManager is one part of Vertex and it is a user-facing API. Task's recovery not only depend

[jira] [Updated] (TEZ-2589) Define the completeness of VertexManager

2015-07-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2589: Description: VertexManager is one part of Vertex and it is a user-facing API. Task's recovery not only depend

[jira] [Updated] (TEZ-2589) Define the completeness of VertexManager

2015-07-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2589: Description: VertexManager is one part of Vertex and it is a user-facing API. Task's recovery not only depend

[jira] [Updated] (TEZ-2589) Define the completeness of VertexManager

2015-07-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2589: Description: VertexManager is one part of Vertex and it is a user-facing API. Task's recovery not only depend

[jira] [Updated] (TEZ-2583) Allow RecoveryService Pluggable

2015-07-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2583: Attachment: TEZ-2583-1.patch > Allow RecoveryService Pluggable > > >

[jira] [Commented] (TEZ-2583) Allow RecoveryService Pluggable

2015-07-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14609935#comment-14609935 ] Jeff Zhang commented on TEZ-2583: - Attach patch. * Make RecoveryService pluggable. Use Reco

[jira] [Updated] (TEZ-2589) Define the completeness of VertexManager

2015-07-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2589: Description: VertexManager is one part of Vertex and it is a user-facing API. Task's recovery not only depend

[jira] [Updated] (TEZ-2583) Allow RecoveryService Pluggable

2015-07-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2583: Attachment: TEZ-2583-2.patch > Allow RecoveryService Pluggable > > >

[jira] [Comment Edited] (TEZ-2583) Allow RecoveryService Pluggable

2015-07-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14609935#comment-14609935 ] Jeff Zhang edited comment on TEZ-2583 at 7/1/15 12:45 PM: -- Attach p

[jira] [Commented] (TEZ-2583) Allow RecoveryService Pluggable

2015-07-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14610340#comment-14610340 ] Jeff Zhang commented on TEZ-2583: - The test fails due to the issue in the current recovery c

[jira] [Updated] (TEZ-2589) Define the completeness of VertexManager

2015-07-03 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2589: Description: VertexManager is one part of Vertex and it is a user-facing API. Task's recovery not only depend

[jira] [Updated] (TEZ-2589) Define the completeness of VertexManager

2015-07-03 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2589: Description: VertexManager is one part of Vertex and it is a user-facing API. Task's recovery not only depend

[jira] [Commented] (TEZ-2588) Inproper argument name

2015-07-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14614467#comment-14614467 ] Jeff Zhang commented on TEZ-2588: - [~gliptak] Not sure how you generate the patch. But the p

[jira] [Commented] (TEZ-2588) Inproper argument name

2015-07-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14614481#comment-14614481 ] Jeff Zhang commented on TEZ-2588: - +1, will commit it soon > Inproper argument name >

[jira] [Updated] (TEZ-2588) Improper argument name

2015-07-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2588: Summary: Improper argument name (was: Inproper argument name) > Improper argument name >

[jira] [Commented] (TEZ-2588) Improper argument name

2015-07-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14614482#comment-14614482 ] Jeff Zhang commented on TEZ-2588: - Thanks for your contribution. [~gliptak] Committed to mas

[jira] [Created] (TEZ-2601) Define the completness of EdgeManager

2015-07-05 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2601: --- Summary: Define the completness of EdgeManager Key: TEZ-2601 URL: https://issues.apache.org/jira/browse/TEZ-2601 Project: Apache Tez Issue Type: Sub-task R

[jira] [Updated] (TEZ-2601) Define the completness of EdgeManager

2015-07-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2601: Description: Same as TEZ-2589, EdgeManagerPlugin is a user-facing API which would make the recovery complicat

<    4   5   6   7   8   9   10   11   12   13   >