[jira] [Commented] (TEZ-978) Enhance auto parallelism tuning for queries having empty outputs or data skewness

[ https://issues.apache.org/jira/browse/TEZ-978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120893#comment-14120893 ] Bikas Saha commented on TEZ-978: ; is not consistent with the existing text in that log line

[jira] [Comment Edited] (TEZ-1494) DAG hangs waiting for ShuffleManager.getNextInput()

[ https://issues.apache.org/jira/browse/TEZ-1494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120889#comment-14120889 ] Bikas Saha edited comment on TEZ-1494 at 9/4/14 2:58 AM: - Alternativ

[jira] [Commented] (TEZ-1494) DAG hangs waiting for ShuffleManager.getNextInput()

[ https://issues.apache.org/jira/browse/TEZ-1494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120889#comment-14120889 ] Bikas Saha commented on TEZ-1494: - Overall, I feel we should wait for TEZ-1494. Then we can

[jira] [Updated] (TEZ-1447) Provide notification mechanism for user code to know about interesting Vertex state changes

[ https://issues.apache.org/jira/browse/TEZ-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1447: Summary: Provide notification mechanism for user code to know about interesting Vertex state changes (was: Ha

[jira] [Commented] (TEZ-1447) Handle parallelism updates and versioning w/ custom InputInitializerEvents

[ https://issues.apache.org/jira/browse/TEZ-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120874#comment-14120874 ] Bikas Saha commented on TEZ-1447: - bq. Advantages of an event is that additional informatio

[jira] [Commented] (TEZ-703) Simplify input initialization in Vertex

[ https://issues.apache.org/jira/browse/TEZ-703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120832#comment-14120832 ] Bikas Saha commented on TEZ-703: It is problematic because the initialization complete does n

[jira] [Commented] (TEZ-1499) Add OrderedJoinExample to tez-examples

[ https://issues.apache.org/jira/browse/TEZ-1499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120670#comment-14120670 ] Jeff Zhang commented on TEZ-1499: - [~bikassaha] IMO, broadcast vs non-broadcast is very simi

[jira] [Commented] (TEZ-1538) Tez Local Mode fails if "fs.defaultFS" is not set to be "file:///' in core-site.xml

[ https://issues.apache.org/jira/browse/TEZ-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120604#comment-14120604 ] Chen He commented on TEZ-1538: -- [~sseth], we find this error when we are testing local mode. I

[jira] [Created] (TEZ-1539) Allow a FIRE_ONCE_ON_SUCCESS model for events generated by user code

Siddharth Seth created TEZ-1539: --- Summary: Allow a FIRE_ONCE_ON_SUCCESS model for events generated by user code Key: TEZ-1539 URL: https://issues.apache.org/jira/browse/TEZ-1539 Project: Apache Tez

[jira] [Commented] (TEZ-1447) Handle parallelism updates and versioning w/ custom InputInitializerEvents

[ https://issues.apache.org/jira/browse/TEZ-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120576#comment-14120576 ] Siddharth Seth commented on TEZ-1447: - bq. I am sorry I dont agree with that. It would n

[jira] [Commented] (TEZ-1538) Tez Local Mode fails if "fs.defaultFS" is not set to be "file:///' in core-site.xml

[ https://issues.apache.org/jira/browse/TEZ-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120555#comment-14120555 ] Siddharth Seth commented on TEZ-1538: - [~airbots] - is this related to TEZ-1348 ? If I

[jira] [Commented] (TEZ-703) Simplify input initialization in Vertex

[ https://issues.apache.org/jira/browse/TEZ-703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120546#comment-14120546 ] Siddharth Seth commented on TEZ-703: bq. 1) Vertex starts IIs 2) IIs sends Vertex events

[jira] [Commented] (TEZ-703) Simplify input initialization in Vertex

[ https://issues.apache.org/jira/browse/TEZ-703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120540#comment-14120540 ] Siddharth Seth commented on TEZ-703: Pasting comment from [~bikassaha] on TEZ-1345 to con

[jira] [Commented] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120399#comment-14120399 ] Bikas Saha commented on TEZ-1345: - Here is a summary from an offline discussion with Hitesh.

[jira] [Assigned] (TEZ-703) Simplify input initialization in Vertex

[ https://issues.apache.org/jira/browse/TEZ-703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha reassigned TEZ-703: -- Assignee: Bikas Saha > Simplify input initialization in Vertex > --- >

[jira] [Updated] (TEZ-1538) Tez Local Mode fails if "fs.defaultFS" is not set to be "file:///' in core-site.xml

[ https://issues.apache.org/jira/browse/TEZ-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1538: - Attachment: TEZ-1538.patch > Tez Local Mode fails if "fs.defaultFS" is not set to be "file:///' in > core-site.xml

[jira] [Created] (TEZ-1538) Tez Local Mode fails if "fs.defaultFS" is not set to be "file:///' in core-site.xml

Chen He created TEZ-1538: Summary: Tez Local Mode fails if "fs.defaultFS" is not set to be "file:///' in core-site.xml Key: TEZ-1538 URL: https://issues.apache.org/jira/browse/TEZ-1538 Project: Apache Tez

[jira] [Created] (TEZ-1537) Expose edge information in I/P/IContexts

Siddharth Seth created TEZ-1537: --- Summary: Expose edge information in I/P/IContexts Key: TEZ-1537 URL: https://issues.apache.org/jira/browse/TEZ-1537 Project: Apache Tez Issue Type: Improvement

[jira] [Commented] (TEZ-1310) Update website documentation framework

[ https://issues.apache.org/jira/browse/TEZ-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120235#comment-14120235 ] Bikas Saha commented on TEZ-1310: - Jonathan. This migration looks fine to me. Can you please

[jira] [Commented] (TEZ-247) Fix warnings due to service not being closed after change in YARN abstract service

[ https://issues.apache.org/jira/browse/TEZ-247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120231#comment-14120231 ] Bikas Saha commented on TEZ-247: This may not be an issue any more. > Fix warnings due to se

[jira] [Commented] (TEZ-1447) Handle parallelism updates and versioning w/ custom InputInitializerEvents

[ https://issues.apache.org/jira/browse/TEZ-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120221#comment-14120221 ] Bikas Saha commented on TEZ-1447: - bq. A registration API with arguments can be added at a l

[jira] [Commented] (TEZ-247) Fix warnings due to service not being closed after change in YARN abstract service

[ https://issues.apache.org/jira/browse/TEZ-247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120203#comment-14120203 ] Hitesh Shah commented on TEZ-247: - [~bikassaha] Was the intention to log another warn message

[jira] [Commented] (TEZ-1478) TestContainerReuse.testReuseNonLocalRequest test is unstable

[ https://issues.apache.org/jira/browse/TEZ-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120199#comment-14120199 ] Hitesh Shah commented on TEZ-1478: -- [~sseth] Mind taking a look? > TestContainerReuse.tes

[jira] [Commented] (TEZ-853) Support counters recovery

[ https://issues.apache.org/jira/browse/TEZ-853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120211#comment-14120211 ] Hitesh Shah commented on TEZ-853: - bq. There's no counter written from VertexImpl and TaskImp

[jira] [Resolved] (TEZ-1536) Fix spelling typo "configurartion" in TezClientUtils

[ https://issues.apache.org/jira/browse/TEZ-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-1536. -- Resolution: Fixed Fix Version/s: 0.5.1 > Fix spelling typo "configurartion" in TezClientUtils > ---

[jira] [Updated] (TEZ-1536) Fix spelling typo "configurartion" in TezClientUtils

[ https://issues.apache.org/jira/browse/TEZ-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1536: - Attachment: TEZ-1536.1.patch > Fix spelling typo "configurartion" in TezClientUtils > --

[jira] [Created] (TEZ-1536) Fix spelling typo "configurartion" in TezClientUtils

Hitesh Shah created TEZ-1536: Summary: Fix spelling typo "configurartion" in TezClientUtils Key: TEZ-1536 URL: https://issues.apache.org/jira/browse/TEZ-1536 Project: Apache Tez Issue Type: Bug

[jira] [Commented] (TEZ-1522) Scheduling can result in out of order execution and slowdown of upstream work

[ https://issues.apache.org/jira/browse/TEZ-1522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120171#comment-14120171 ] Bikas Saha commented on TEZ-1522: - I agree. We could fix TEZ-1494 separately and leave this

[jira] [Commented] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120151#comment-14120151 ] Hitesh Shah commented on TEZ-1345: -- Comments: Regard patch 6: - I am not sure this is

[jira] [Commented] (TEZ-1499) Add OrderedJoinExample to tez-examples

[ https://issues.apache.org/jira/browse/TEZ-1499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120140#comment-14120140 ] Bikas Saha commented on TEZ-1499: - In that case please also separate the broadcast vs non-br

[jira] [Commented] (TEZ-1508) Log a warning if Xmx is configured incorrectly.

[ https://issues.apache.org/jira/browse/TEZ-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120102#comment-14120102 ] Hitesh Shah commented on TEZ-1508: -- [~jeagles] I don't think the vertex verification is cor

[jira] [Created] (TEZ-1535) Minor bug in computing min-time the reducer should run without getting killed

Rajesh Balamohan created TEZ-1535: - Summary: Minor bug in computing min-time the reducer should run without getting killed Key: TEZ-1535 URL: https://issues.apache.org/jira/browse/TEZ-1535 Project: Ap

[jira] [Commented] (TEZ-1522) Scheduling can result in out of order execution and slowdown of upstream work

[ https://issues.apache.org/jira/browse/TEZ-1522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119672#comment-14119672 ] Rajesh Balamohan commented on TEZ-1522: --- Update: Patch for TEZ-1494 would not complet

[jira] [Commented] (TEZ-1499) Add OrderedJoinExample to tez-examples

[ https://issues.apache.org/jira/browse/TEZ-1499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119668#comment-14119668 ] Jeff Zhang commented on TEZ-1499: - Attach the patch. * Add OrderedJoinExample in a separate

[jira] [Updated] (TEZ-1499) Add OrderedJoinExample to tez-examples

[ https://issues.apache.org/jira/browse/TEZ-1499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1499: Attachment: Tez-1499.patch > Add OrderedJoinExample to tez-examples > -- >

[jira] [Commented] (TEZ-1447) Handle parallelism updates and versioning w/ custom InputInitializerEvents

[ https://issues.apache.org/jira/browse/TEZ-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119492#comment-14119492 ] Siddharth Seth commented on TEZ-1447: - bq. Interested parties should be able to register

[jira] [Updated] (TEZ-1527) Improvement on waitForCompletion API

[ https://issues.apache.org/jira/browse/TEZ-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1527: Attachment: Tez-1527-2.patch Attach the file with right name > Improvement on waitForCompletion API > ---

[jira] [Commented] (TEZ-1527) Improvement on waitForCompletion API

[ https://issues.apache.org/jira/browse/TEZ-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119477#comment-14119477 ] Jeff Zhang commented on TEZ-1527: - [~sseth] Revert the indention for Vertex Counter output,

[jira] [Updated] (TEZ-1527) Improvement on waitForCompletion API

[ https://issues.apache.org/jira/browse/TEZ-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1527: Attachment: Tez-1521-2.patch > Improvement on waitForCompletion API > > >