[jira] [Commented] (TEZ-853) Support counters recovery

2014-08-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14108693#comment-14108693 ] Jeff Zhang commented on TEZ-853: [~hitesh] Attach the patch. * Fix one small bug in DAGStatu

[jira] [Created] (TEZ-1493) WordCount example fails in recovery

2014-08-25 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-1493: --- Summary: WordCount example fails in recovery Key: TEZ-1493 URL: https://issues.apache.org/jira/browse/TEZ-1493 Project: Apache Tez Issue Type: Bug Reporter

[jira] [Updated] (TEZ-1493) WordCount example fails in recovery

2014-08-25 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1493: Description: {code} 14/08/25 17:37:03 INFO client.TezClient: Submitting DAG to YARN, applicationId=applicati

[jira] [Updated] (TEZ-1493) WordCount example fails in recovery

2014-08-25 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1493: Attachment: Tez-1493.patch > WordCount example fails in recovery > --- > >

[jira] [Commented] (TEZ-1493) WordCount example fails in recovery

2014-08-25 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14109015#comment-14109015 ] Jeff Zhang commented on TEZ-1493: - Attach the patch. The reason of this issue is that when

[jira] [Commented] (TEZ-1493) WordCount example fails in recovery

2014-08-25 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110248#comment-14110248 ] Jeff Zhang commented on TEZ-1493: - [~hitesh] Yes, I check other examples, they all have the

[jira] [Updated] (TEZ-1493) Tez examples fail in recovery sometimes

2014-08-25 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1493: Summary: Tez examples fail in recovery sometimes (was: WordCount example fails in recovery) > Tez examples

[jira] [Created] (TEZ-1498) Usage info is not printed when error number of arguments for JoinExample

2014-08-25 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-1498: --- Summary: Usage info is not printed when error number of arguments for JoinExample Key: TEZ-1498 URL: https://issues.apache.org/jira/browse/TEZ-1498 Project: Apache Tez

[jira] [Updated] (TEZ-1498) Usage info is not printed when error number of arguments for JoinExample

2014-08-25 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1498: Description: If no arguments is provided, it should print the usage info rather than throw exception as foll

[jira] [Updated] (TEZ-1498) Usage info is not printed when error number of arguments for JoinExample

2014-08-25 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1498: Attachment: Tez-1498.patch Attach the patch ( check whether there are 4 or 5 arguments for JoinExample ) > U

[jira] [Created] (TEZ-1499) Add OrderedJoinExample to tez-examples

2014-08-25 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-1499: --- Summary: Add OrderedJoinExample to tez-examples Key: TEZ-1499 URL: https://issues.apache.org/jira/browse/TEZ-1499 Project: Apache Tez Issue Type: Bug Repor

[jira] [Updated] (TEZ-1498) Usage info is not printed when wrong number of arguments is provided for JoinExample

2014-08-25 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1498: Summary: Usage info is not printed when wrong number of arguments is provided for JoinExample (was: Usage in

[jira] [Updated] (TEZ-1499) Add OrderedJoinExample to tez-examples

2014-08-25 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1499: Description: In the current join example, the inputs of JoinProcessor is unordered so that it will always nee

[jira] [Commented] (TEZ-1501) Add a test dag to generate load on the getTask RPC

2014-08-26 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110598#comment-14110598 ] Jeff Zhang commented on TEZ-1501: - [~sseth] The TexExampleBase is very helpful, and I notice

[jira] [Commented] (TEZ-853) Support counters recovery

2014-08-26 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111540#comment-14111540 ] Jeff Zhang commented on TEZ-853: [~hitesh] The task attempt counters is recovered from TaskFi

[jira] [Commented] (TEZ-1493) Tez examples fail in recovery sometimes

2014-08-26 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111553#comment-14111553 ] Jeff Zhang commented on TEZ-1493: - [~hitesh] bq. Also, is there some other change that nee

[jira] [Commented] (TEZ-1493) Tez examples fail in recovery sometimes

2014-08-26 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111558#comment-14111558 ] Jeff Zhang commented on TEZ-1493: - [~hitesh] Please try the new patch (Tez-1493-2.patch) >

[jira] [Updated] (TEZ-1493) Tez examples fail in recovery sometimes

2014-08-26 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1493: Attachment: Tez-1493-2.patch > Tez examples fail in recovery sometimes >

[jira] [Commented] (TEZ-853) Support counters recovery

2014-08-26 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111581#comment-14111581 ] Jeff Zhang commented on TEZ-853: [~hitesh] Sorry for the typo in my last comment, it should b

[jira] [Commented] (TEZ-1506) Possible statemachine bug : TaskAttemptImpl.handle()-->Invalid event: TA_FAILED at SUCCEEDED

2014-08-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112117#comment-14112117 ] Jeff Zhang commented on TEZ-1506: - [~rajesh.balamohan] I check the logs and find that *atte

[jira] [Comment Edited] (TEZ-1506) Possible statemachine bug : TaskAttemptImpl.handle()-->Invalid event: TA_FAILED at SUCCEEDED

2014-08-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112117#comment-14112117 ] Jeff Zhang edited comment on TEZ-1506 at 8/27/14 10:39 AM: --- [~raje

[jira] [Comment Edited] (TEZ-1506) Possible statemachine bug : TaskAttemptImpl.handle()-->Invalid event: TA_FAILED at SUCCEEDED

2014-08-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112117#comment-14112117 ] Jeff Zhang edited comment on TEZ-1506 at 8/27/14 10:49 AM: --- [~raje

[jira] [Comment Edited] (TEZ-1506) Possible statemachine bug : TaskAttemptImpl.handle()-->Invalid event: TA_FAILED at SUCCEEDED

2014-08-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112117#comment-14112117 ] Jeff Zhang edited comment on TEZ-1506 at 8/27/14 10:49 AM: --- [~raje

[jira] [Commented] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

2014-08-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112176#comment-14112176 ] Jeff Zhang commented on TEZ-1345: - [~hitesh] Attach the new patch. * Move the route events

[jira] [Updated] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

2014-08-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1345: Attachment: Tez-1345-2.patch > Add checks to guarantee all init events are written to recovery to consider >

[jira] [Commented] (TEZ-1358) Display better diagnostics when tasks fail to launch

2014-08-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113161#comment-14113161 ] Jeff Zhang commented on TEZ-1358: - [~hitesh] In what kind of situation that the container fa

[jira] [Commented] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

2014-08-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113363#comment-14113363 ] Jeff Zhang commented on TEZ-1345: - [~bikassaha] bq. Why are we calling VertexImpl method dir

[jira] [Comment Edited] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

2014-08-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113363#comment-14113363 ] Jeff Zhang edited comment on TEZ-1345 at 8/28/14 5:35 AM: -- [~bikass

[jira] [Commented] (TEZ-853) Support counters recovery

2014-08-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113433#comment-14113433 ] Jeff Zhang commented on TEZ-853: [~hitesh] bq. Do TaskImpl and VertexImpl write counters to r

[jira] [Commented] (TEZ-1358) Display better diagnostics when tasks fail to launch

2014-08-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113442#comment-14113442 ] Jeff Zhang commented on TEZ-1358: - [~hitesh] verify it that it will show up in the RM UI.

[jira] [Comment Edited] (TEZ-853) Support counters recovery

2014-08-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113433#comment-14113433 ] Jeff Zhang edited comment on TEZ-853 at 8/28/14 7:06 AM: - [~hitesh] b

[jira] [Assigned] (TEZ-1357) Display better diagnostics when AM fails to launch

2014-08-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang reassigned TEZ-1357: --- Assignee: Jeff Zhang > Display better diagnostics when AM fails to launch > ---

[jira] [Created] (TEZ-1521) VertexDataMovementEventsGeneratedEvent is logged twice in recovery log for InputDataInformation

2014-08-28 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-1521: --- Summary: VertexDataMovementEventsGeneratedEvent is logged twice in recovery log for InputDataInformation Key: TEZ-1521 URL: https://issues.apache.org/jira/browse/TEZ-1521 Proje

[jira] [Updated] (TEZ-1521) VertexDataMovementEventsGeneratedEvent may be logged twice in recovery log

2014-08-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1521: Summary: VertexDataMovementEventsGeneratedEvent may be logged twice in recovery log (was: VertexDataMovemen

[jira] [Updated] (TEZ-1521) VertexDataMovementEventsGeneratedEvent may be logged twice in recovery log

2014-08-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1521: Description: The TezEvents may be added to pendingTaskEvents when task is not scheduled. In this case, > Ve

[jira] [Updated] (TEZ-1521) VertexDataMovementEventsGeneratedEvent may be logged twice in recovery log

2014-08-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1521: Description: The TezEvents may be added to pendingTaskEvents when task is not scheduled. In this case, Vertex

[jira] [Updated] (TEZ-1521) VertexDataMovementEventsGeneratedEvent may be logged twice in recovery log

2014-08-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1521: Description: The TezEvents may be added to pendingTaskEvents and route again later when task is not scheduled

[jira] [Commented] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

2014-08-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14115230#comment-14115230 ] Jeff Zhang commented on TEZ-1345: - [~bikassaha][~hitesh] I think maybe we could add the inp

[jira] [Comment Edited] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

2014-08-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14115230#comment-14115230 ] Jeff Zhang edited comment on TEZ-1345 at 8/29/14 1:10 PM: -- [~bikass

[jira] [Commented] (TEZ-1476) DAGClient waitForCompletion output is confusing

2014-08-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14115300#comment-14115300 ] Jeff Zhang commented on TEZ-1476: - [~seth.siddha...@gmail.com], [~jeagles] I notice that aft

[jira] [Created] (TEZ-1527) Improvement on waitForCompletion API

2014-08-31 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-1527: --- Summary: Improvement on waitForCompletion API Key: TEZ-1527 URL: https://issues.apache.org/jira/browse/TEZ-1527 Project: Apache Tez Issue Type: Bug Reporte

[jira] [Updated] (TEZ-1527) Improvement on waitForCompletion API

2014-08-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1527: Description: After [TEZ-1476|https://issues.apache.org/jira/browse/TEZ-1476], the waitForCompletion API has s

[jira] [Updated] (TEZ-1527) Improvement on waitForCompletion API

2014-08-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1527: Description: After [TEZ-1476|https://issues.apache.org/jira/browse/TEZ-1476], the waitForCompletion API has s

[jira] [Commented] (TEZ-1476) DAGClient waitForCompletion output is confusing

2014-08-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14117079#comment-14117079 ] Jeff Zhang commented on TEZ-1476: - [~seth.siddha...@gmail.com] After checking again, found a

[jira] [Updated] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

2014-09-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1345: Attachment: Tez-1345-3.patch > Add checks to guarantee all init events are written to recovery to consider >

[jira] [Commented] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

2014-09-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14117135#comment-14117135 ] Jeff Zhang commented on TEZ-1345: - Attach the patch. * add inputName in InputDataInformatio

[jira] [Comment Edited] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

2014-09-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14117135#comment-14117135 ] Jeff Zhang edited comment on TEZ-1345 at 9/1/14 8:01 AM: - Attach the

[jira] [Updated] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

2014-09-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1345: Attachment: Tez-1345-4.patch Attach new patch to fix NPE in unit test > Add checks to guarantee all init even

[jira] [Updated] (TEZ-1521) VertexDataMovementEventsGeneratedEvent may be logged twice in recovery log

2014-09-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1521: Issue Type: Sub-task (was: Bug) Parent: TEZ-15 > VertexDataMovementEventsGeneratedEvent may be logged

[jira] [Commented] (TEZ-1527) Improvement on waitForCompletion API

2014-09-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118997#comment-14118997 ] Jeff Zhang commented on TEZ-1527: - [~sseth] I was afraid that someone may use this api to pr

[jira] [Updated] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

2014-09-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1345: Attachment: Tez-1345-6.patch Tez-1345-5.patch > Add checks to guarantee all init events are wr

[jira] [Commented] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

2014-09-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119403#comment-14119403 ] Jeff Zhang commented on TEZ-1345: - [~hitesh] Attach 2 patches for the following 2 solutions:

[jira] [Updated] (TEZ-1527) Improvement on waitForCompletion API

2014-09-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1527: Attachment: Tez-1527.patch > Improvement on waitForCompletion API > > >

[jira] [Commented] (TEZ-1527) Improvement on waitForCompletion API

2014-09-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119434#comment-14119434 ] Jeff Zhang commented on TEZ-1527: - [~seth.siddha...@gmail.com] Attach the patch. * add inde

[jira] [Updated] (TEZ-1527) Improvement on waitForCompletion API

2014-09-03 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1527: Attachment: Tez-1521-2.patch > Improvement on waitForCompletion API > > >

[jira] [Commented] (TEZ-1527) Improvement on waitForCompletion API

2014-09-03 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119477#comment-14119477 ] Jeff Zhang commented on TEZ-1527: - [~sseth] Revert the indention for Vertex Counter output,

[jira] [Updated] (TEZ-1527) Improvement on waitForCompletion API

2014-09-03 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1527: Attachment: Tez-1527-2.patch Attach the file with right name > Improvement on waitForCompletion API > ---

[jira] [Updated] (TEZ-1499) Add OrderedJoinExample to tez-examples

2014-09-03 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1499: Attachment: Tez-1499.patch > Add OrderedJoinExample to tez-examples > -- >

[jira] [Commented] (TEZ-1499) Add OrderedJoinExample to tez-examples

2014-09-03 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119668#comment-14119668 ] Jeff Zhang commented on TEZ-1499: - Attach the patch. * Add OrderedJoinExample in a separate

[jira] [Commented] (TEZ-1499) Add OrderedJoinExample to tez-examples

2014-09-03 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120670#comment-14120670 ] Jeff Zhang commented on TEZ-1499: - [~bikassaha] IMO, broadcast vs non-broadcast is very simi

[jira] [Updated] (TEZ-850) Recovery unit tests

2014-09-04 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-850: --- Attachment: Tez-850-2.patch Attach the new patch (rebase it to latest commit) > Recovery unit tests > --

[jira] [Commented] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

2014-09-04 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14121307#comment-14121307 ] Jeff Zhang commented on TEZ-1345: - [~bikassaha], [~hitesh] Thanks for your comments. The eff

[jira] [Updated] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

2014-09-04 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1345: Attachment: Tez-1345-7.patch > Add checks to guarantee all init events are written to recovery to consider >

[jira] [Updated] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

2014-09-04 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1345: Attachment: Tez-1345-8.patch Attach new patch (revert the api compatibility issue of last patch) > Add checks

[jira] [Updated] (TEZ-1384) Move recovery related code into inner class

2014-09-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1384: Attachment: Tez-1384-2.patch > Move recovery related code into inner class > -

[jira] [Commented] (TEZ-1384) Move recovery related code into inner class

2014-09-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122840#comment-14122840 ] Jeff Zhang commented on TEZ-1384: - [~hitesh] Attach the patch * Create a base class EntityR

[jira] [Commented] (TEZ-1539) Allow a FIRE_ONCE_ON_SUCCESS model for events generated by user code

2014-09-08 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14126311#comment-14126311 ] Jeff Zhang commented on TEZ-1539: - [~hitesh] Will look at it today > Allow a FIRE_ONCE_ON_S

[jira] [Created] (TEZ-1559) System tests for AM recovery

2014-09-08 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-1559: --- Summary: System tests for AM recovery Key: TEZ-1559 URL: https://issues.apache.org/jira/browse/TEZ-1559 Project: Apache Tez Issue Type: Bug Reporter: Jeff

[jira] [Updated] (TEZ-1559) System tests for AM recovery

2014-09-08 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1559: Issue Type: Sub-task (was: Bug) Parent: TEZ-15 > System tests for AM recovery > -

[jira] [Updated] (TEZ-1559) System tests for AM recovery

2014-09-08 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1559: Description: * [Fine-grained recovery task-level] In a vertex, task 0 is done task 1 is running. History flus

[jira] [Updated] (TEZ-853) Support counters recovery

2014-09-08 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-853: --- Attachment: Tez-853-2.patch > Support counters recovery > - > > Key: TEZ-

[jira] [Commented] (TEZ-853) Support counters recovery

2014-09-08 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14126479#comment-14126479 ] Jeff Zhang commented on TEZ-853: Attach the new patch. * remove counters from VertexFinished

[jira] [Updated] (TEZ-1559) Add system tests for AM recovery

2014-09-09 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1559: Summary: Add system tests for AM recovery (was: System tests for AM recovery) > Add system tests for AM reco

[jira] [Created] (TEZ-1560) Invalid state machine transition in recovery

2014-09-09 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-1560: --- Summary: Invalid state machine transition in recovery Key: TEZ-1560 URL: https://issues.apache.org/jira/browse/TEZ-1560 Project: Apache Tez Issue Type: Bug

[jira] [Updated] (TEZ-1560) Invalid state machine transition in recovery

2014-09-09 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1560: Description: {code} 2014-09-04 16:08:25,504 INFO [main] org.apache.tez.dag.app.dag.impl.DAGImpl: dag_14098180

[jira] [Commented] (TEZ-1539) Allow a FIRE_ONCE_ON_SUCCESS model for events generated by user code

2014-09-09 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14126920#comment-14126920 ] Jeff Zhang commented on TEZ-1539: - First I'd like to confirm that where does InputInitialize

[jira] [Commented] (TEZ-853) Support counters recovery

2014-09-09 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14127830#comment-14127830 ] Jeff Zhang commented on TEZ-853: [~hitesh] bq. Why is job1 being compared against job2? Base

[jira] [Updated] (TEZ-850) Recovery unit tests

2014-09-09 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-850: --- Attachment: Tez-850-3.patch > Recovery unit tests > --- > > Key: TEZ-850 >

[jira] [Created] (TEZ-1561) Add unit test for critical events that are logged out of band

2014-09-09 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-1561: --- Summary: Add unit test for critical events that are logged out of band Key: TEZ-1561 URL: https://issues.apache.org/jira/browse/TEZ-1561 Project: Apache Tez Issue Typ

[jira] [Commented] (TEZ-850) Recovery unit tests

2014-09-09 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14127876#comment-14127876 ] Jeff Zhang commented on TEZ-850: Attach the new patch (add VisibleForTesting annotation) Cre

[jira] [Commented] (TEZ-993) Remove application logic from RecoveryService

2014-09-09 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14127905#comment-14127905 ] Jeff Zhang commented on TEZ-993: [~bikassaha] Agree that delay it will make it harder to get

[jira] [Commented] (TEZ-992) Recovery data should not be written on AsyncDispatcher thread

2014-09-09 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14127907#comment-14127907 ] Jeff Zhang commented on TEZ-992: [~bikassaha] Agree that delay it will make it harder to get

[jira] [Commented] (TEZ-1019) Re-factor routing of events to use common code path for normal and recovery flow.

2014-09-09 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14127908#comment-14127908 ] Jeff Zhang commented on TEZ-1019: - [~bikassaha] Agree that delay it will make it harder to g

[jira] [Updated] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

2014-09-09 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1345: Attachment: Tez-1345-9.patch > Add checks to guarantee all init events are written to recovery to consider >

[jira] [Commented] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

2014-09-09 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14128105#comment-14128105 ] Jeff Zhang commented on TEZ-1345: - bq. The changes in RecoveryParser.java - not sure why the

[jira] [Updated] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

2014-09-09 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1345: Attachment: Tez-1345-10.patch Attach the new patch > Add checks to guarantee all init events are written to r

[jira] [Updated] (TEZ-1559) Add system tests for AM recovery

2014-09-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1559: Attachment: Tez-1559.patch > Add system tests for AM recovery > > >

[jira] [Commented] (TEZ-1559) Add system tests for AM recovery

2014-09-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14128583#comment-14128583 ] Jeff Zhang commented on TEZ-1559: - Attach the patch. * Add unit test covering the case in t

[jira] [Created] (TEZ-1568) Add system test for propagation of diagnostics for errors

2014-09-10 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-1568: --- Summary: Add system test for propagation of diagnostics for errors Key: TEZ-1568 URL: https://issues.apache.org/jira/browse/TEZ-1568 Project: Apache Tez Issue Type: Bu

[jira] [Updated] (TEZ-1568) Add system test for propagation of diagnostics for errors

2014-09-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1568: Issue Type: Sub-task (was: Bug) Parent: TEZ-1240 > Add system test for propagation of diagnostics for

[jira] [Commented] (TEZ-1559) Add system tests for AM recovery

2014-09-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14129409#comment-14129409 ] Jeff Zhang commented on TEZ-1559: - bq. in the future, it will be helpful to reviewers if whi

[jira] [Updated] (TEZ-1559) Add system tests for AM recovery

2014-09-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1559: Attachment: Tez-1559-2.patch > Add system tests for AM recovery > > >

[jira] [Commented] (TEZ-1559) Add system tests for AM recovery

2014-09-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14129472#comment-14129472 ] Jeff Zhang commented on TEZ-1559: - [~hitesh] Attach the new patch. * add counter verificat

[jira] [Updated] (TEZ-850) Recovery unit tests

2014-09-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-850: --- Attachment: Tez-850-4.patch > Recovery unit tests > --- > > Key: TEZ-850 >

[jira] [Commented] (TEZ-850) Recovery unit tests

2014-09-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14129566#comment-14129566 ] Jeff Zhang commented on TEZ-850: Attach the new patch. * rebase it * remove MockVertexImpl w

[jira] [Comment Edited] (TEZ-850) Recovery unit tests

2014-09-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14129566#comment-14129566 ] Jeff Zhang edited comment on TEZ-850 at 9/11/14 3:13 AM: - Attach the

[jira] [Updated] (TEZ-1559) Add system tests for AM recovery

2014-09-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1559: Attachment: Tez-1559-3.patch > Add system tests for AM recovery > > >

[jira] [Commented] (TEZ-1559) Add system tests for AM recovery

2014-09-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14129592#comment-14129592 ] Jeff Zhang commented on TEZ-1559: - Attach the new patch. bq. Recovery data is meant to be i

[jira] [Updated] (TEZ-850) Recovery unit tests

2014-09-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-850: --- Attachment: Tez-850-5.patch > Recovery unit tests > --- > > Key: TEZ-850 >

[jira] [Commented] (TEZ-850) Recovery unit tests

2014-09-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14129615#comment-14129615 ] Jeff Zhang commented on TEZ-850: [~hitesh] Attach the patch. BTW, could you let me know what

<    12   13   14   15   16   17   18   19   20   21   >