[jira] [Reopened] (TEZ-1337) Handling of local-dirs for Local Mode

2014-08-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reopened TEZ-1337: - [~airbots] - apologies for not updating this jira after TEZ-1393. The earlier comments aren't valid an

[jira] [Commented] (TEZ-1072) Consolidate monitoring APIs in DAGClient

2014-08-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096616#comment-14096616 ] Siddharth Seth commented on TEZ-1072: - +1. Looks good. > Consolidate monitoring APIs in

[jira] [Updated] (TEZ-1416) tez-api project javadoc/annotations review and clean up.

2014-08-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1416: Attachment: TEZ-1416.1.patch.review Patch file with comments / questions marked with XXX. Also, Te

[jira] [Updated] (TEZ-1400) Reducers stuck when enabling auto-reduce parallelism (MRR case)

2014-08-13 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-1400: -- Attachment: TEZ-1400.2.patch Yes, "key":"tez.am.shuffle-vertex-manager.enable.auto-parallel","val

[jira] [Commented] (TEZ-1416) tez-api project javadoc/annotations review and clean up.

2014-08-13 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096574#comment-14096574 ] Hitesh Shah commented on TEZ-1416: -- Mostly looks good. Should likely wait for [~sseth] to s

[jira] [Commented] (TEZ-1411) Address initial feedback on swimlanes

2014-08-13 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096528#comment-14096528 ] Gopal V commented on TEZ-1411: -- #1 - this can only be done if everyone runs ATS in their cluste

[jira] [Updated] (TEZ-1418) Provide Default value for TEZ_AM_LAUNCH_ENV and TEZ_TASK_LAUNCH

2014-08-13 Thread Subroto Sanyal (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subroto Sanyal updated TEZ-1418: Summary: Provide Default value for TEZ_AM_LAUNCH_ENV and TEZ_TASK_LAUNCH (was: Default value for TEZ

[jira] [Created] (TEZ-1418) Default value for TEZ_AM_LAUNCH_ENV and TEZ_TASK_LAUNCH

2014-08-13 Thread Subroto Sanyal (JIRA)
Subroto Sanyal created TEZ-1418: --- Summary: Default value for TEZ_AM_LAUNCH_ENV and TEZ_TASK_LAUNCH Key: TEZ-1418 URL: https://issues.apache.org/jira/browse/TEZ-1418 Project: Apache Tez Issue Ty

[jira] [Commented] (TEZ-1337) Handling of local-dirs for Local Mode

2014-08-13 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096517#comment-14096517 ] Chen He commented on TEZ-1337: -- I am confused about some comments in previous discussion: On

[jira] [Commented] (TEZ-1390) Replace byte[] with ByteBuffer as the type of user payload in the API

2014-08-13 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096516#comment-14096516 ] Tsuyoshi OZAWA commented on TEZ-1390: - Thanks for sharing, Jonathan! [~bikassaha], I at

[jira] [Updated] (TEZ-1390) Replace byte[] with ByteBuffer as the type of user payload in the API

2014-08-13 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated TEZ-1390: Attachment: TEZ-1390.1.patch > Replace byte[] with ByteBuffer as the type of user payload in the API

[jira] [Commented] (TEZ-1390) Replace byte[] with ByteBuffer as the type of user payload in the API

2014-08-13 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096513#comment-14096513 ] Tsuyoshi OZAWA commented on TEZ-1390: - ByteString#asReadOnlyByteBuffer offers the featur

[jira] [Commented] (TEZ-1072) Consolidate monitoring APIs in DAGClient

2014-08-13 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096511#comment-14096511 ] Jonathan Eagles commented on TEZ-1072: -- [~sseth], [~bikassaha], Incorporating the feedb

[jira] [Updated] (TEZ-1072) Consolidate monitoring APIs in DAGClient

2014-08-13 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-1072: - Attachment: TEZ-1072-v1.patch > Consolidate monitoring APIs in DAGClient >

[jira] [Updated] (TEZ-1409) Change MRInputConfigurer, MROutputConfigurer to accept specific classes, isntead of a generic class

2014-08-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1409: Attachment: TEZ-1409.1.txt Patch makes the following changes. - InputFormat and path nullable - Inpu

[jira] [Commented] (TEZ-1334) Annotate all non public classes in tez-runtime-library with @private

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096493#comment-14096493 ] Bikas Saha commented on TEZ-1334: - I am guessing this covers MRInput/MROutput that are in te

[jira] [Commented] (TEZ-1416) tez-api project javadoc/annotations review and clean up.

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096492#comment-14096492 ] Bikas Saha commented on TEZ-1416: - [~sseth] [~hitesh] please review. > tez-api project java

[jira] [Created] (TEZ-1417) Rename *Configurer

2014-08-13 Thread Siddharth Seth (JIRA)
Siddharth Seth created TEZ-1417: --- Summary: Rename *Configurer Key: TEZ-1417 URL: https://issues.apache.org/jira/browse/TEZ-1417 Project: Apache Tez Issue Type: Sub-task Reporter: Si

[jira] [Updated] (TEZ-1416) tez-api project javadoc/annotations review and clean up.

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1416: Attachment: TEZ-1416.1.patch Attached patch cleans up the javadoc. Adds public annotation for all public clas

[jira] [Commented] (TEZ-1334) Annotate all non public classes in tez-runtime-library with @private

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096488#comment-14096488 ] Bikas Saha commented on TEZ-1334: - TEZ-1416 covers API. This can cover runtime-library. > A

[jira] [Commented] (TEZ-1330) Create a dist target which contains required jars

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096487#comment-14096487 ] Bikas Saha commented on TEZ-1330: - minimal - since this is the minimal set of jars needed to

[jira] [Updated] (TEZ-1334) Annotate all non public classes in tez-runtime-library with @private

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1334: Summary: Annotate all non public classes in tez-runtime-library with @private (was: Annotate all non public

[jira] [Comment Edited] (TEZ-684) Uber/Local modes for Tez

2014-08-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096467#comment-14096467 ] Siddharth Seth edited comment on TEZ-684 at 8/14/14 2:28 AM: - Loc

[jira] [Comment Edited] (TEZ-1337) Handling of local-dirs for Local Mode

2014-08-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096462#comment-14096462 ] Siddharth Seth edited comment on TEZ-1337 at 8/14/14 2:29 AM: --

[jira] [Commented] (TEZ-684) Uber/Local modes for Tez

2014-08-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096467#comment-14096467 ] Siddharth Seth commented on TEZ-684: LocalResources are not handled in local mode. I'm no

[jira] [Commented] (TEZ-1132) Consistent naming of Input and Outputs

2014-08-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096463#comment-14096463 ] Siddharth Seth commented on TEZ-1132: - bq. Change KV to KeyValue in all names. Optional,

[jira] [Updated] (TEZ-1337) Handling of local-dirs for Local Mode

2014-08-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1337: Priority: Major (was: Blocker) > Handling of local-dirs for Local Mode > ---

[jira] [Commented] (TEZ-1337) Handling of local-dirs for Local Mode

2014-08-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096462#comment-14096462 ] Siddharth Seth commented on TEZ-1337: - Not a blocker after TEZ-1397. The main issue user

[jira] [Created] (TEZ-1416) tez-api project javadoc/annotations review and clean up.

2014-08-13 Thread Bikas Saha (JIRA)
Bikas Saha created TEZ-1416: --- Summary: tez-api project javadoc/annotations review and clean up. Key: TEZ-1416 URL: https://issues.apache.org/jira/browse/TEZ-1416 Project: Apache Tez Issue Type: Bug

[jira] [Commented] (TEZ-1330) Create a dist target which contains required jars

2014-08-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096461#comment-14096461 ] Siddharth Seth commented on TEZ-1330: - suggestions ? -withoutHadoop ? > Create a dist t

[jira] [Updated] (TEZ-1246) Replace constructors with create() methods for DAG, Vertex, Edge etc in the API

2014-08-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1246: Priority: Blocker (was: Major) Target Version/s: 0.5.0 I think this change is worth maki

[jira] [Updated] (TEZ-1334) Annotate all non public classes in tez-api/tez-runtime-library with @private

2014-08-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1334: Target Version/s: 0.5.0 > Annotate all non public classes in tez-api/tez-runtime-library with @privat

[jira] [Updated] (TEZ-1334) Annotate all non public classes in tez-api/tez-runtime-library with @private

2014-08-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1334: Priority: Blocker (was: Major) > Annotate all non public classes in tez-api/tez-runtime-library with

[jira] [Updated] (TEZ-1316) Document public interfaces/classes which are not meant to be implemented/extended

2014-08-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1316: Priority: Blocker (was: Critical) > Document public interfaces/classes which are not meant to be >

[jira] [Commented] (TEZ-1414) Disable TestTezClientUtils.testLocalResourceVisibility to make builds pass.

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096429#comment-14096429 ] Bikas Saha commented on TEZ-1414: - There is no clear solution for the actual dirs on the jen

[jira] [Commented] (TEZ-1414) Disable TestTezClientUtils.testLocalResourceVisibility to make builds pass.

2014-08-13 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096389#comment-14096389 ] Hitesh Shah commented on TEZ-1414: -- [~pramachandran] The other approach would be to use a l

[jira] [Created] (TEZ-1415) Merge various Util classes in Tez

2014-08-13 Thread Bikas Saha (JIRA)
Bikas Saha created TEZ-1415: --- Summary: Merge various Util classes in Tez Key: TEZ-1415 URL: https://issues.apache.org/jira/browse/TEZ-1415 Project: Apache Tez Issue Type: Bug Reporter:

[jira] [Commented] (TEZ-1414) Disable TestTezClientUtils.testLocalResourceVisibility to make builds pass.

2014-08-13 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096377#comment-14096377 ] Prakash Ramachandran commented on TEZ-1414: --- Working on this. the reason for faili

[jira] [Commented] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

2014-08-13 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096356#comment-14096356 ] Jeff Zhang commented on TEZ-1345: - Attach the patch. [~hitesh] I make the following change

[jira] [Commented] (TEZ-684) Uber/Local modes for Tez

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096355#comment-14096355 ] Bikas Saha commented on TEZ-684: What happens to local resources that are part of the vertex

[jira] [Updated] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

2014-08-13 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1345: Attachment: Tez-1345.patch > Add checks to guarantee all init events are written to recovery to consider > v

[jira] [Commented] (TEZ-1222) Add examples for uses of the API

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096333#comment-14096333 ] Bikas Saha commented on TEZ-1222: - WordCount, OrderededWordCount and SimpleSessionExample ar

[jira] [Updated] (TEZ-1222) Add examples for uses of the API

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1222: Priority: Major (was: Blocker) > Add examples for uses of the API > > >

[jira] [Commented] (TEZ-671) Support View/Modify ACLs for DAGs

2014-08-13 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096328#comment-14096328 ] Hitesh Shah commented on TEZ-671: - API introductions involved. [~bikassaha] [~sseth] please r

[jira] [Updated] (TEZ-1072) Consolidate monitoring APIs in DAGClient

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1072: Assignee: Jonathan Eagles > Consolidate monitoring APIs in DAGClient > --

[jira] [Comment Edited] (TEZ-1132) Consistent naming of Input and Outputs

2014-08-13 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096298#comment-14096298 ] Jeff Zhang edited comment on TEZ-1132 at 8/13/14 11:29 PM: --- [~bika

[jira] [Commented] (TEZ-1132) Consistent naming of Input and Outputs

2014-08-13 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096298#comment-14096298 ] Jeff Zhang commented on TEZ-1132: - [~bikassaha] Sure, please take this. > Consistent naming

[jira] [Updated] (TEZ-1132) Consistent naming of Input and Outputs

2014-08-13 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1132: Assignee: Bikas Saha (was: Jeff Zhang) > Consistent naming of Input and Outputs > --

[jira] [Resolved] (TEZ-1414) Disable TestTezClientUtils.testLocalResourceVisibility to make builds pass.

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha resolved TEZ-1414. - Resolution: Fixed Fix Version/s: 0.5.0 commit e2692f7cacd56fd2e8d2734f79ecfbb447e2fc2c Author: Bikas

[jira] [Updated] (TEZ-1414) Disable TestTezClientUtils.testLocalResourceVisibility to make builds pass.

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1414: Attachment: TEZ-1414.1.patch Committing trivial patch. > Disable TestTezClientUtils.testLocalResourceVisibil

[jira] [Commented] (TEZ-1337) Handling of local-dirs for Local Mode

2014-08-13 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096284#comment-14096284 ] Chen He commented on TEZ-1337: -- No need, I can submit patch today. > Handling of local-dirs f

[jira] [Created] (TEZ-1414) Disable TestTezClientUtils.testLocalResourceVisibility to make builds pass.

2014-08-13 Thread Bikas Saha (JIRA)
Bikas Saha created TEZ-1414: --- Summary: Disable TestTezClientUtils.testLocalResourceVisibility to make builds pass. Key: TEZ-1414 URL: https://issues.apache.org/jira/browse/TEZ-1414 Project: Apache Tez

[jira] [Created] (TEZ-1413) Fix build for TestTezClientUtils.testLocalResourceVisibility

2014-08-13 Thread Bikas Saha (JIRA)
Bikas Saha created TEZ-1413: --- Summary: Fix build for TestTezClientUtils.testLocalResourceVisibility Key: TEZ-1413 URL: https://issues.apache.org/jira/browse/TEZ-1413 Project: Apache Tez Issue Type

[jira] [Commented] (TEZ-1337) Handling of local-dirs for Local Mode

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096278#comment-14096278 ] Bikas Saha commented on TEZ-1337: - Is this a 0.5 blocker or can be followed up in 0.5.1? >

[jira] [Commented] (TEZ-1072) Consolidate monitoring APIs in DAGClient

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096276#comment-14096276 ] Bikas Saha commented on TEZ-1072: - +1 on just removing. public abstract DAGStatus waitForCom

[jira] [Commented] (TEZ-1320) Remove getApplicationId from DAGClient

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096271#comment-14096271 ] Bikas Saha commented on TEZ-1320: - The patch looks fine except for the following that should

[jira] [Commented] (TEZ-1330) Create a dist target which contains required jars

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096258#comment-14096258 ] Bikas Saha commented on TEZ-1330: - Tried it. Works for me. +1. Super useful for dev. Can we

[jira] [Updated] (TEZ-269) Fix ResourceMgrDelegate#getDelegationToken after YARN-868 is fixed

2014-08-13 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated TEZ-269: - Attachment: TEZ-269.patch Patch can be submitted once YARN-868 is committed > Fix ResourceMgrDelegate#getDe

[jira] [Updated] (TEZ-671) Support View/Modify ACLs for DAGs

2014-08-13 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-671: Attachment: TEZ-671.3.patch Comments addressed. > Support View/Modify ACLs for DAGs > --

[jira] [Commented] (TEZ-1132) Consistent naming of Input and Outputs

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096248#comment-14096248 ] Bikas Saha commented on TEZ-1132: - LocalOnFileSorterOutput should probably be removed. OnFil

[jira] [Comment Edited] (TEZ-1132) Consistent naming of Input and Outputs

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096248#comment-14096248 ] Bikas Saha edited comment on TEZ-1132 at 8/13/14 10:41 PM: --- LocalO

[jira] [Commented] (TEZ-1347) Consolidate MRHelpers

2014-08-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096219#comment-14096219 ] Siddharth Seth commented on TEZ-1347: - Committing. > Consolidate MRHelpers > --

[jira] [Created] (TEZ-1412) Create a KeyValue(s)Reader hierarchy to show properties

2014-08-13 Thread Bikas Saha (JIRA)
Bikas Saha created TEZ-1412: --- Summary: Create a KeyValue(s)Reader hierarchy to show properties Key: TEZ-1412 URL: https://issues.apache.org/jira/browse/TEZ-1412 Project: Apache Tez Issue Type: Bug

[jira] [Updated] (TEZ-1347) Consolidate MRHelpers

2014-08-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1347: Attachment: TEZ-1347.2.txt Updated patch with comments addressed. Renamed TezAPIHelpers to TezUtils

[jira] [Commented] (TEZ-1055) Rename tez-mapreduce-examples to tez-examples

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096187#comment-14096187 ] Bikas Saha commented on TEZ-1055: - [~rekhajoshm] Can I take up this blocker jira since we ar

[jira] [Assigned] (TEZ-1361) Move SimpleMRProcessor, MRInput and MROutput into runtime-library

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha reassigned TEZ-1361: --- Assignee: Bikas Saha > Move SimpleMRProcessor, MRInput and MROutput into runtime-library >

[jira] [Commented] (TEZ-1361) Move SimpleMRProcessor, MRInput and MROutput into runtime-library

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096179#comment-14096179 ] Bikas Saha commented on TEZ-1361: - I am leaning towards leaving this in tez-mapreduce but mo

[jira] [Resolved] (TEZ-1361) Move SimpleMRProcessor, MRInput and MROutput into runtime-library

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha resolved TEZ-1361. - Resolution: Not a Problem > Move SimpleMRProcessor, MRInput and MROutput into runtime-library > ---

[jira] [Created] (TEZ-1411) Address initial feedback on swimlanes

2014-08-13 Thread Bikas Saha (JIRA)
Bikas Saha created TEZ-1411: --- Summary: Address initial feedback on swimlanes Key: TEZ-1411 URL: https://issues.apache.org/jira/browse/TEZ-1411 Project: Apache Tez Issue Type: Bug Report

[jira] [Updated] (TEZ-1402) MRoutput configurer should disable committer

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1402: Summary: MRoutput configurer should disable committer (was: MRoutput configurer should allow other committer

[jira] [Updated] (TEZ-1402) MRoutput configurer should allow disabling the committer

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1402: Summary: MRoutput configurer should allow disabling the committer (was: MRoutput configurer should disable c

[jira] [Commented] (TEZ-1402) MRoutput configurer should allow other committers and no committer

2014-08-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096148#comment-14096148 ] Siddharth Seth commented on TEZ-1402: - Looks good. > MRoutput configurer should allow o

[jira] [Updated] (TEZ-1402) MRoutput configurer should allow other committers and no committer

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1402: Attachment: TEZ-1402.3.patch Thanks. Attaching commit patch. > MRoutput configurer should allow other commit

[jira] [Commented] (TEZ-1347) Consolidate MRHelpers

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096093#comment-14096093 ] Bikas Saha commented on TEZ-1347: - TezAPIHelpers Why does it have to have API is the name. I

[jira] [Resolved] (TEZ-817) TEZ_LIB_URI are always uploaded as public Local Resource

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha resolved TEZ-817. Resolution: Fixed Fix Version/s: 0.5.0 Hadoop Flags: Reviewed Thanks for your contribution. Commi

[jira] [Commented] (TEZ-1390) Replace byte[] with ByteBuffer as the type of user payload in the API

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14095827#comment-14095827 ] Bikas Saha commented on TEZ-1390: - We do not have a strong case right now except that some o

[jira] [Commented] (TEZ-1400) Reducers stuck when enabling auto-reduce parallelism (MRR case)

2014-08-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14095816#comment-14095816 ] Bikas Saha commented on TEZ-1400: - Can you confirm that ShuffleVertexManager is being explic

[jira] [Comment Edited] (TEZ-1390) Replace byte[] with ByteBuffer as the type of user payload in the API

2014-08-13 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14095579#comment-14095579 ] Jonathan Eagles edited comment on TEZ-1390 at 8/13/14 3:24 PM: ---

[jira] [Updated] (TEZ-1390) Replace byte[] with ByteBuffer as the type of user payload in the API

2014-08-13 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-1390: - Attachment: pig.payload.txt These are the usages of Payload in pig. > Replace byte[] with ByteBuf

[jira] [Commented] (TEZ-1331) Investigate : interrupts being swallowed by TezClient/DAGClient methods

2014-08-13 Thread Johannes Zillmann (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14095503#comment-14095503 ] Johannes Zillmann commented on TEZ-1331: Had a look at the code base. Only crucial s

[jira] [Updated] (TEZ-1410) DAGClient#waitForCompletion() methods should not swallow interrupts

2014-08-13 Thread Johannes Zillmann (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johannes Zillmann updated TEZ-1410: --- Attachment: TEZ-1410.1.patch > DAGClient#waitForCompletion() methods should not swallow interru

[jira] [Created] (TEZ-1410) DAGClient#waitForCompletion() methods should not swallow interrupts

2014-08-13 Thread Johannes Zillmann (JIRA)
Johannes Zillmann created TEZ-1410: -- Summary: DAGClient#waitForCompletion() methods should not swallow interrupts Key: TEZ-1410 URL: https://issues.apache.org/jira/browse/TEZ-1410 Project: Apache Tez

[jira] [Commented] (TEZ-1390) Replace byte[] with ByteBuffer as the type of user payload in the API

2014-08-13 Thread Johannes Zillmann (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14095485#comment-14095485 ] Johannes Zillmann commented on TEZ-1390: Just curious, whats the benefit of using By

[jira] [Updated] (TEZ-1347) Consolidate MRHelpers

2014-08-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1347: Attachment: TEZ-1347.1.txt The last bit of cleanup in MRHelpers (not related to MRInput etc). Change

[jira] [Commented] (TEZ-1390) Replace byte[] with ByteBuffer as the type of user payload in the API

2014-08-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14095226#comment-14095226 ] Siddharth Seth commented on TEZ-1390: - Sounds good. > Replace byte[] with ByteBuffer as