[jira] [Commented] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14087259#comment-14087259 ] Jeff Zhang commented on TEZ-1345: - [~hitesh] I found that there're 2 places where logging Ve

[jira] [Updated] (TEZ-1368) TestSecureShuffle failing

[ https://issues.apache.org/jira/browse/TEZ-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-1368: -- Fix Version/s: 0.5.0 > TestSecureShuffle failing > - > >

[jira] [Updated] (TEZ-1368) TestSecureShuffle failing

[ https://issues.apache.org/jira/browse/TEZ-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-1368: -- Attachment: TEZ-1368.3.rebase.patch Rebasing the patch (post https://issues.apache.org/jira/brows

[jira] [Commented] (TEZ-1372) Fix preWarm to work after recent API changes

[ https://issues.apache.org/jira/browse/TEZ-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14087212#comment-14087212 ] Thaddeus Diamond commented on TEZ-1372: --- Very nice. It's working. Got it to run with

[jira] [Commented] (TEZ-1382) Change ObjectRegistry API to allow for future extensions

[ https://issues.apache.org/jira/browse/TEZ-1382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14087211#comment-14087211 ] Rohini Palaniswamy commented on TEZ-1382: - bq. If a task add an object to the cache

[jira] [Updated] (TEZ-1194) Make TezUserPayload user facing for payload specification and change to ByteBuffer

[ https://issues.apache.org/jira/browse/TEZ-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated TEZ-1194: Attachment: TEZ-1194.3-wip.patch Attached WIP patch which changed the semantics of *ContextImpl. In t

[jira] [Commented] (TEZ-1372) Fix preWarm to work after recent API changes

[ https://issues.apache.org/jira/browse/TEZ-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14087176#comment-14087176 ] Thaddeus Diamond commented on TEZ-1372: --- Okay, could we up those two tests? Once I com

[jira] [Commented] (TEZ-1372) Fix preWarm to work after recent API changes

[ https://issues.apache.org/jira/browse/TEZ-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14087174#comment-14087174 ] Bikas Saha commented on TEZ-1372: - TestContainerReuse is known to occasionally fail. The tim

[jira] [Commented] (TEZ-1372) Fix preWarm to work after recent API changes

[ https://issues.apache.org/jira/browse/TEZ-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14087168#comment-14087168 ] Thaddeus Diamond commented on TEZ-1372: --- Varies every time but they typically are in t

[jira] [Commented] (TEZ-1153) Allow object caching for more than one vertex

[ https://issues.apache.org/jira/browse/TEZ-1153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14087164#comment-14087164 ] Bikas Saha commented on TEZ-1153: - TEZ-1382 allows this jira to become major as an API exten

[jira] [Updated] (TEZ-1153) Allow object caching for more than one vertex

[ https://issues.apache.org/jira/browse/TEZ-1153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1153: Priority: Major (was: Blocker) > Allow object caching for more than one vertex > ---

[jira] [Commented] (TEZ-1372) Fix preWarm to work after recent API changes

[ https://issues.apache.org/jira/browse/TEZ-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14087165#comment-14087165 ] Bikas Saha commented on TEZ-1372: - Which tests? TestSecureShuffle is known and is being trac

[jira] [Updated] (TEZ-1382) Change ObjectRegistry API to allow for future extensions

[ https://issues.apache.org/jira/browse/TEZ-1382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1382: Attachment: (was: TEZ-1382.1.patch) > Change ObjectRegistry API to allow for future extensions >

[jira] [Updated] (TEZ-1382) Change ObjectRegistry API to allow for future extensions

[ https://issues.apache.org/jira/browse/TEZ-1382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1382: Attachment: TEZ-1382.1.patch > Change ObjectRegistry API to allow for future extensions > ---

[jira] [Updated] (TEZ-1382) Change ObjectRegistry API to allow for future extensions

[ https://issues.apache.org/jira/browse/TEZ-1382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1382: Attachment: TEZ-1382.1.patch Straightforward patch. Please review. > Change ObjectRegistry API to allow for

[jira] [Commented] (TEZ-1372) Fix preWarm to work after recent API changes

[ https://issues.apache.org/jira/browse/TEZ-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14087162#comment-14087162 ] Thaddeus Diamond commented on TEZ-1372: --- Sorry, grabbed the first one accidentally. G

[jira] [Comment Edited] (TEZ-1372) Fix preWarm to work after recent API changes

[ https://issues.apache.org/jira/browse/TEZ-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14087162#comment-14087162 ] Thaddeus Diamond edited comment on TEZ-1372 at 8/6/14 2:44 AM: ---

[jira] [Updated] (TEZ-1153) Allow object caching for more than one vertex

[ https://issues.apache.org/jira/browse/TEZ-1153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1153: Assignee: (was: Bikas Saha) > Allow object caching for more than one vertex > ---

[jira] [Created] (TEZ-1382) Change ObjectRegistry API to allow for future extensions

Bikas Saha created TEZ-1382: --- Summary: Change ObjectRegistry API to allow for future extensions Key: TEZ-1382 URL: https://issues.apache.org/jira/browse/TEZ-1382 Project: Apache Tez Issue Type: Imp

[jira] [Commented] (TEZ-1372) Fix preWarm to work after recent API changes

[ https://issues.apache.org/jira/browse/TEZ-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14087139#comment-14087139 ] Bikas Saha commented on TEZ-1372: - That latest patch builds fine for me. > Fix preWarm to w

[jira] [Comment Edited] (TEZ-1372) Fix preWarm to work after recent API changes

[ https://issues.apache.org/jira/browse/TEZ-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14087139#comment-14087139 ] Bikas Saha edited comment on TEZ-1372 at 8/6/14 2:21 AM: - That lates

[jira] [Commented] (TEZ-1372) Fix preWarm to work after recent API changes

[ https://issues.apache.org/jira/browse/TEZ-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14087133#comment-14087133 ] Thaddeus Diamond commented on TEZ-1372: --- This fails to build because the {{OrderedWord

[jira] [Assigned] (TEZ-1153) Allow object caching for more than one vertex

[ https://issues.apache.org/jira/browse/TEZ-1153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha reassigned TEZ-1153: --- Assignee: Bikas Saha > Allow object caching for more than one vertex >

[jira] [Commented] (TEZ-1381) Set EditLogFileOutputStream.setShouldSkipFsyncForTesting(true) for MiniTezCluster

[ https://issues.apache.org/jira/browse/TEZ-1381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14087112#comment-14087112 ] Bikas Saha commented on TEZ-1381: - Nope. [~daijy] [~hagleitn] Can you try this out with your

[jira] [Updated] (TEZ-1372) Fix preWarm to work after recent API changes

[ https://issues.apache.org/jira/browse/TEZ-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1372: Attachment: TEZ-1372.2.patch Patch with unit tests. > Fix preWarm to work after recent API changes > ---

[jira] [Commented] (TEZ-1153) Allow object caching for more than one vertex

[ https://issues.apache.org/jira/browse/TEZ-1153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14087081#comment-14087081 ] Rohini Palaniswamy commented on TEZ-1153: - +1 for Option 2. Will make it more easy t

[jira] [Commented] (TEZ-1153) Allow object caching for more than one vertex

[ https://issues.apache.org/jira/browse/TEZ-1153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14087076#comment-14087076 ] Bikas Saha commented on TEZ-1153: - Option 1) Add a new API called add(Key, Value, List). Thi

[jira] [Commented] (TEZ-1379) EdgeConfigurers should accept a Partitioner configuration, accept parameters for compression and secure shuffle

[ https://issues.apache.org/jira/browse/TEZ-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14087074#comment-14087074 ] Bikas Saha commented on TEZ-1379: - Looks like a reasonable middle ground that also allows us

[jira] [Updated] (TEZ-1379) EdgeConfigurers should accept a Partitioner configuration, accept parameters for compression and secure shuffle

[ https://issues.apache.org/jira/browse/TEZ-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1379: Attachment: TEZ-1379.3.txt Correct version of the final patch. > EdgeConfigurers should accept a Par

[jira] [Updated] (TEZ-1379) EdgeConfigurers should accept a Partitioner configuration, accept parameters for compression and secure shuffle

[ https://issues.apache.org/jira/browse/TEZ-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1379: Attachment: (was: TEZ-1379.3.txt) > EdgeConfigurers should accept a Partitioner configuration, ac

[jira] [Commented] (TEZ-671) Support View/Modify ACLs for DAGs

[ https://issues.apache.org/jira/browse/TEZ-671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14087055#comment-14087055 ] Siddharth Seth commented on TEZ-671: With session mode, and support for credentials per D

[jira] [Commented] (TEZ-1381) Set EditLogFileOutputStream.setShouldSkipFsyncForTesting(true) for MiniTezCluster

[ https://issues.apache.org/jira/browse/TEZ-1381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14087051#comment-14087051 ] Hitesh Shah commented on TEZ-1381: -- [~bikassaha] Any feedback from the Hive or Pig folks on

[jira] [Updated] (TEZ-1379) EdgeConfigurers should accept a Partitioner configuration, accept parameters for compression and secure shuffle

[ https://issues.apache.org/jira/browse/TEZ-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1379: Attachment: TEZ-1379.3.without_renames.txt TEZ-1379.3.txt Updated patch. TEZ-1379.3.w

[jira] [Commented] (TEZ-1372) Fix preWarm to work after recent API changes

[ https://issues.apache.org/jira/browse/TEZ-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14087045#comment-14087045 ] Bikas Saha commented on TEZ-1372: - [~gopalv] Let me know if creating a new class called PreW

[jira] [Resolved] (TEZ-1381) Set EditLogFileOutputStream.setShouldSkipFsyncForTesting(true) for MiniTezCluster

[ https://issues.apache.org/jira/browse/TEZ-1381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha resolved TEZ-1381. - Resolution: Won't Fix Tried it out. Did not show much gain for us because we are probably not writing much

[jira] [Commented] (TEZ-671) Support View/Modify ACLs for DAGs

[ https://issues.apache.org/jira/browse/TEZ-671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14087029#comment-14087029 ] Hitesh Shah commented on TEZ-671: - [~sseth] Do you see a need to have both AM level ACLs as w

[jira] [Assigned] (TEZ-671) Support View/Modify ACLs for DAGs

[ https://issues.apache.org/jira/browse/TEZ-671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah reassigned TEZ-671: --- Assignee: Hitesh Shah > Support View/Modify ACLs for DAGs > - > >

[jira] [Commented] (TEZ-1379) EdgeConfigurers should accept a Partitioner configuration, accept parameters for compression and secure shuffle

[ https://issues.apache.org/jira/browse/TEZ-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086976#comment-14086976 ] Siddharth Seth commented on TEZ-1379: - That definitely helps with giant configuration in

[jira] [Commented] (TEZ-1379) EdgeConfigurers should accept a Partitioner configuration, accept parameters for compression and secure shuffle

[ https://issues.apache.org/jira/browse/TEZ-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086969#comment-14086969 ] Bikas Saha commented on TEZ-1379: - Sounds good. For the individual entities would the Map op

[jira] [Commented] (TEZ-1379) EdgeConfigurers should accept a Partitioner configuration, accept parameters for compression and secure shuffle

[ https://issues.apache.org/jira/browse/TEZ-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086965#comment-14086965 ] Siddharth Seth commented on TEZ-1379: - bq. If we simply accept Configuration then we mak

[jira] [Updated] (TEZ-1372) Fix preWarm to work after recent API changes

[ https://issues.apache.org/jira/browse/TEZ-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1372: Attachment: (was: TEZ-1372.1.patch) > Fix preWarm to work after recent API changes >

[jira] [Updated] (TEZ-1372) Fix preWarm to work after recent API changes

[ https://issues.apache.org/jira/browse/TEZ-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1372: Attachment: TEZ-1372.1.patch > Fix preWarm to work after recent API changes > ---

[jira] [Updated] (TEZ-1372) Fix preWarm to work after recent API changes

[ https://issues.apache.org/jira/browse/TEZ-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1372: Attachment: TEZ-1372.1.patch Re-attaching patch because it missed a new file. > Fix preWarm to work after re

[jira] [Updated] (TEZ-1372) Fix preWarm to work after recent API changes

[ https://issues.apache.org/jira/browse/TEZ-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1372: Attachment: (was: TEZ-1372.1.patch) > Fix preWarm to work after recent API changes >

[jira] [Created] (TEZ-1381) Set EditLogFileOutputStream.setShouldSkipFsyncForTesting(true) for MiniTezCluster

Bikas Saha created TEZ-1381: --- Summary: Set EditLogFileOutputStream.setShouldSkipFsyncForTesting(true) for MiniTezCluster Key: TEZ-1381 URL: https://issues.apache.org/jira/browse/TEZ-1381 Project: Apache Tez

[jira] [Commented] (TEZ-1379) EdgeConfigurers should accept a Partitioner configuration, accept parameters for compression and secure shuffle

[ https://issues.apache.org/jira/browse/TEZ-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086952#comment-14086952 ] Bikas Saha commented on TEZ-1379: - We might be trying to do 2 things that are potentially at

[jira] [Commented] (TEZ-1368) TestSecureShuffle failing

[ https://issues.apache.org/jira/browse/TEZ-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086949#comment-14086949 ] Rajesh Balamohan commented on TEZ-1368: --- setConfiguration works without issues. > Tes

[jira] [Commented] (TEZ-1368) TestSecureShuffle failing

[ https://issues.apache.org/jira/browse/TEZ-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086947#comment-14086947 ] Siddharth Seth commented on TEZ-1368: - It should just work after setFromConfiguration is

[jira] [Commented] (TEZ-1380) Refactor SpecificBuilder's enableEncryption / enableCompression to accept parameters (which then allows them to be used via conditionals)

[ https://issues.apache.org/jira/browse/TEZ-1380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086945#comment-14086945 ] Siddharth Seth commented on TEZ-1380: - Yep. TEZ-1379 should take care of this. > Refact

[jira] [Resolved] (TEZ-1380) Refactor SpecificBuilder's enableEncryption / enableCompression to accept parameters (which then allows them to be used via conditionals)

[ https://issues.apache.org/jira/browse/TEZ-1380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved TEZ-1380. - Resolution: Duplicate > Refactor SpecificBuilder's enableEncryption / enableCompression to accept

[jira] [Commented] (TEZ-1380) Refactor SpecificBuilder's enableEncryption / enableCompression to accept parameters (which then allows them to be used via conditionals)

[ https://issues.apache.org/jira/browse/TEZ-1380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086943#comment-14086943 ] Rajesh Balamohan commented on TEZ-1380: --- Patch for https://issues.apache.org/jira/brow

[jira] [Comment Edited] (TEZ-1368) TestSecureShuffle failing

[ https://issues.apache.org/jira/browse/TEZ-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086930#comment-14086930 ] Rajesh Balamohan edited comment on TEZ-1368 at 8/5/14 10:49 PM: --

[jira] [Updated] (TEZ-1368) TestSecureShuffle failing

[ https://issues.apache.org/jira/browse/TEZ-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-1368: -- Attachment: TEZ-1368.3.patch Thanks [~sseth]. setFromConfiguration() was already in the patch.

[jira] [Commented] (TEZ-1379) EdgeConfigurers should accept a Partitioner configuration, accept parameters for compression and secure shuffle

[ https://issues.apache.org/jira/browse/TEZ-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086926#comment-14086926 ] Siddharth Seth commented on TEZ-1379: - bq. configurations since the free-form Configurat

[jira] [Updated] (TEZ-1347) Consolidate MRHelpers

[ https://issues.apache.org/jira/browse/TEZ-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1347: Attachment: TEZ-1347-initial-review.txt Took a first pass at the various methods in MRHelpers, and ha

[jira] [Commented] (TEZ-1379) EdgeConfigurers should accept a Partitioner configuration, accept parameters for compression and secure shuffle

[ https://issues.apache.org/jira/browse/TEZ-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086907#comment-14086907 ] Bikas Saha commented on TEZ-1379: - bq. setComparator(String comparator), setComparator(Stri

[jira] [Updated] (TEZ-1360) Provide vertex parallelism to each vertex task

[ https://issues.apache.org/jira/browse/TEZ-1360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated TEZ-1360: - Attachment: (was: TEZ-1332.1.patch) > Provide vertex parallelism to each vertex task >

[jira] [Updated] (TEZ-1360) Provide vertex parallelism to each vertex task

[ https://issues.apache.org/jira/browse/TEZ-1360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated TEZ-1360: - Attachment: TEZ-1360.1.patch > Provide vertex parallelism to each vertex task > ---

[jira] [Created] (TEZ-1380) Refactor SpecificBuilder's enableEncryption / enableCompression to accept parameters (which then allows them to be used via conditionals)

Rajesh Balamohan created TEZ-1380: - Summary: Refactor SpecificBuilder's enableEncryption / enableCompression to accept parameters (which then allows them to be used via conditionals) Key: TEZ-1380 URL: https://is

[jira] [Updated] (TEZ-1379) EdgeConfigurers should accept a Partitioner configuration, accept parameters for compression and secure shuffle

[ https://issues.apache.org/jira/browse/TEZ-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1379: Attachment: TEZ-1379.2.txt Updated patch based on previous comments. > EdgeConfigurers should accept

[jira] [Updated] (TEZ-1360) Provide vertex parallelism to each vertex task

[ https://issues.apache.org/jira/browse/TEZ-1360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated TEZ-1360: - Attachment: TEZ-1332.1.patch > Provide vertex parallelism to each vertex task > ---

[jira] [Commented] (TEZ-1360) Provide vertex parallelism to each vertex task

[ https://issues.apache.org/jira/browse/TEZ-1360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086858#comment-14086858 ] Gopal V commented on TEZ-1360: -- [~oae]: Can you give this one a try? I'm still writing test-ca

[jira] [Commented] (TEZ-1379) EdgeConfigurers should accept a Partitioner configuration, accept parameters for compression and secure shuffle

[ https://issues.apache.org/jira/browse/TEZ-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086857#comment-14086857 ] Siddharth Seth commented on TEZ-1379: - bq. Ideally, enabling or disabling compression sh

[jira] [Commented] (TEZ-1372) Fix preWarm to work after recent API changes

[ https://issues.apache.org/jira/browse/TEZ-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086839#comment-14086839 ] Thaddeus Diamond commented on TEZ-1372: --- This looks right on. I'll try it tomorrow (o

[jira] [Commented] (TEZ-1379) EdgeConfigurers should accept a Partitioner configuration, accept parameters for compression and secure shuffle

[ https://issues.apache.org/jira/browse/TEZ-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086738#comment-14086738 ] Bikas Saha commented on TEZ-1379: - Looks good for the rest. At some point, we need to write

[jira] [Commented] (TEZ-1379) EdgeConfigurers should accept a Partitioner configuration, accept parameters for compression and secure shuffle

[ https://issues.apache.org/jira/browse/TEZ-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086735#comment-14086735 ] Bikas Saha commented on TEZ-1379: - Some tabs are not formatted correctly. Ideally, enabling

[jira] [Commented] (TEZ-1317) Simplify MRinput/MROutput configuration

[ https://issues.apache.org/jira/browse/TEZ-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086679#comment-14086679 ] Bikas Saha commented on TEZ-1317: - After this jira, parallelism, credentials, location hints

[jira] [Updated] (TEZ-1379) EdgeConfigurers should accept a Partitioner configuration, accept parameters for compression and secure shuffle

[ https://issues.apache.org/jira/browse/TEZ-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1379: Attachment: TEZ-1379.1.txt Patch makes the following changes - Allows a comparator configuration to b

[jira] [Created] (TEZ-1379) EdgeConfigurers should accept a Partitioner configuration, accept parameters for compression and secure shuffle

Siddharth Seth created TEZ-1379: --- Summary: EdgeConfigurers should accept a Partitioner configuration, accept parameters for compression and secure shuffle Key: TEZ-1379 URL: https://issues.apache.org/jira/browse/TEZ

[jira] [Commented] (TEZ-1317) Simplify MRinput/MROutput configuration

[ https://issues.apache.org/jira/browse/TEZ-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086620#comment-14086620 ] Siddharth Seth commented on TEZ-1317: - We can fix that in a follow up jira after investi

[jira] [Commented] (TEZ-1372) Fix preWarm to work after recent API changes

[ https://issues.apache.org/jira/browse/TEZ-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086600#comment-14086600 ] Bikas Saha commented on TEZ-1372: - Attaching patch. [~thaddeus.diamond] Perhaps you can try

[jira] [Updated] (TEZ-1372) Fix preWarm to work after recent API changes

[ https://issues.apache.org/jira/browse/TEZ-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1372: Attachment: TEZ-1372.1.patch > Fix preWarm to work after recent API changes > ---

[jira] [Commented] (TEZ-1317) Simplify MRinput/MROutput configuration

[ https://issues.apache.org/jira/browse/TEZ-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086599#comment-14086599 ] Bikas Saha commented on TEZ-1317: - Those examples are using generate splits in client and pa

[jira] [Commented] (TEZ-1372) Fix preWarm to work after recent API changes

[ https://issues.apache.org/jira/browse/TEZ-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086579#comment-14086579 ] Bikas Saha commented on TEZ-1372: - It will still be session.preWarm(FOO) where FOO is Vertex

[jira] [Commented] (TEZ-1368) TestSecureShuffle failing

[ https://issues.apache.org/jira/browse/TEZ-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086575#comment-14086575 ] Siddharth Seth commented on TEZ-1368: - [~rajesh.balamohan] - the patch looks good mostly

[jira] [Commented] (TEZ-1317) Simplify MRinput/MROutput configuration

[ https://issues.apache.org/jira/browse/TEZ-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086562#comment-14086562 ] Siddharth Seth commented on TEZ-1317: - +1. Looks good. This is really useful - being abl

[jira] [Commented] (TEZ-1369) Provide a configuration variable to reuse containers that had unsuccessful tasks

[ https://issues.apache.org/jira/browse/TEZ-1369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086462#comment-14086462 ] Thaddeus Diamond commented on TEZ-1369: --- I will repost these a bit later. If anyone h

[jira] [Updated] (TEZ-1369) Provide a configuration variable to reuse containers that had unsuccessful tasks

[ https://issues.apache.org/jira/browse/TEZ-1369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thaddeus Diamond updated TEZ-1369: -- Attachment: (was: reuse-failed-containers.thaddeus.patch.1) > Provide a configuration variabl

[jira] [Updated] (TEZ-1369) Provide a configuration variable to reuse containers that had unsuccessful tasks

[ https://issues.apache.org/jira/browse/TEZ-1369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thaddeus Diamond updated TEZ-1369: -- Attachment: (was: reuse-failed-containers.thaddeus.patch) > Provide a configuration variable

[jira] [Updated] (TEZ-1236) Implement common functionality in base abstract class for EdgeManager

[ https://issues.apache.org/jira/browse/TEZ-1236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1236: - Attachment: TEZ-1236.patch In progress patch, remove input parameter of EdgeManager.getNumDestinationConsumerTasks

[jira] [Commented] (TEZ-1372) Fix preWarm to work after recent API changes

[ https://issues.apache.org/jira/browse/TEZ-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086223#comment-14086223 ] Thaddeus Diamond commented on TEZ-1372: --- Linking TEZ-1370 because this ticket was born

[jira] [Commented] (TEZ-1372) Fix preWarm to work after recent API changes

[ https://issues.apache.org/jira/browse/TEZ-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086221#comment-14086221 ] Thaddeus Diamond commented on TEZ-1372: --- I like [~gopalv]'s idea, but am happy to make

[jira] [Updated] (TEZ-1024) Fix determination of failed attempts

[ https://issues.apache.org/jira/browse/TEZ-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1024: Attachment: Tez-1024-2.patch > Fix determination of failed attempts > >

[jira] [Commented] (TEZ-1024) Fix determination of failed attempts

[ https://issues.apache.org/jira/browse/TEZ-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086180#comment-14086180 ] Jeff Zhang commented on TEZ-1024: - bq. should there be another else clause for killed attemp

[jira] [Created] (TEZ-1378) Comment of TestTaskImpl assertTaskKillWaitState is deprecated

Tsuyoshi OZAWA created TEZ-1378: --- Summary: Comment of TestTaskImpl assertTaskKillWaitState is deprecated Key: TEZ-1378 URL: https://issues.apache.org/jira/browse/TEZ-1378 Project: Apache Tez I