[jira] [Updated] (TEZ-3202) Reduce the memory need for jobs with high number of segments

2016-04-12 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3202: - Attachment: TEZ-3202.4.patch > Reduce the memory need for jobs with high number of segments > --

[jira] [Updated] (TEZ-3202) Reduce the memory need for jobs with high number of segments

2016-04-12 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3202: - Attachment: (was: TEZ-3202.4.patch) > Reduce the memory need for jobs with high number of segmen

[jira] [Commented] (TEZ-3202) Reduce the memory need for jobs with high number of segments

2016-04-12 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15238669#comment-15238669 ] Jonathan Eagles commented on TEZ-3202: -- Created a dedicated object to track the key val

[jira] [Updated] (TEZ-3202) Reduce the memory need for jobs with high number of segments

2016-04-12 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3202: - Attachment: TEZ-3202.4.patch TEZ-3202.4-branch-0.7.patch > Reduce the memory need fo

[jira] [Commented] (TEZ-3206) Have unordered partitioned KV output send partition stats via VertexManagerEvent

2016-04-12 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15238664#comment-15238664 ] Jonathan Eagles commented on TEZ-3206: -- I have to look more closely at how the partitio

[jira] [Commented] (TEZ-3206) Have unordered partitioned KV output send partition stats via VertexManagerEvent

2016-04-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15238571#comment-15238571 ] Ming Ma commented on TEZ-3206: -- Current implementation in ordered partitioned KV output uses Ro

[jira] [Commented] (TEZ-3212) IFile throws NegativeArraySizeException for value sizes between 1GB and 2GB

2016-04-12 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15238281#comment-15238281 ] TezQA commented on TEZ-3212: {color:red}-1 overall{color}. Here are the results of testing the

Failed: TEZ-3212 PreCommit Build #1653

2016-04-12 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3212 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1653/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

Success: TEZ-3207 PreCommit Build #1652

2016-04-12 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3207 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1652/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Commented] (TEZ-3207) Add support for fetching multiple partitions from the same source task to UnorderedKVInput

2016-04-12 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15238070#comment-15238070 ] TezQA commented on TEZ-3207: {color:green}+1 overall{color}. Here are the results of testing th

[jira] [Commented] (TEZ-3212) IFile throws NegativeArraySizeException for value sizes between 1GB and 2GB

2016-04-12 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15237994#comment-15237994 ] Jonathan Eagles commented on TEZ-3212: -- Of course the job above was behaving badly and

[jira] [Commented] (TEZ-3212) IFile throws NegativeArraySizeException for value sizes between 1GB and 2GB

2016-04-12 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15237992#comment-15237992 ] Jonathan Eagles commented on TEZ-3212: -- This patch is really just to start a discussion

[jira] [Updated] (TEZ-3212) IFile throws NegativeArraySizeException for value sizes between 1GB and 2GB

2016-04-12 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3212: - Attachment: TEZ-3212.1.patch > IFile throws NegativeArraySizeException for value sizes between 1GB a

[jira] [Created] (TEZ-3212) IFile throws NegativeArraySizeException for value sizes between 1GB and 2GB

2016-04-12 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created TEZ-3212: Summary: IFile throws NegativeArraySizeException for value sizes between 1GB and 2GB Key: TEZ-3212 URL: https://issues.apache.org/jira/browse/TEZ-3212 Project: Apache

[jira] [Commented] (TEZ-3211) tez-ui2 : build issue

2016-04-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15237880#comment-15237880 ] Siddharth Seth commented on TEZ-3211: - Thanks folks for debugging. Created a new RC usin

[jira] [Updated] (TEZ-3207) Add support for fetching multiple partitions from the same source task to UnorderedKVInput

2016-04-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated TEZ-3207: - Attachment: TEZ-3207.patch Thanks [~sseth] for the good point. Here is the draft patch. As part of the fix, it sepa

[jira] [Commented] (TEZ-3211) tez-ui2 : build issue

2016-04-12 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15237568#comment-15237568 ] Hitesh Shah commented on TEZ-3211: -- There is enough info on ._ files when tarballs are crea

[jira] [Comment Edited] (TEZ-3211) tez-ui2 : build issue

2016-04-12 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15237016#comment-15237016 ] Sreenath Somarajapuram edited comment on TEZ-3211 at 4/12/16 1:17 PM:

[jira] [Comment Edited] (TEZ-3211) tez-ui2 : build issue

2016-04-12 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15237016#comment-15237016 ] Sreenath Somarajapuram edited comment on TEZ-3211 at 4/12/16 11:34 AM: ---

[jira] [Comment Edited] (TEZ-3211) tez-ui2 : build issue

2016-04-12 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15237016#comment-15237016 ] Sreenath Somarajapuram edited comment on TEZ-3211 at 4/12/16 11:33 AM: ---

[jira] [Comment Edited] (TEZ-3211) tez-ui2 : build issue

2016-04-12 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15237016#comment-15237016 ] Sreenath Somarajapuram edited comment on TEZ-3211 at 4/12/16 11:31 AM: ---

[jira] [Commented] (TEZ-3211) tez-ui2 : build issue

2016-04-12 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15237016#comment-15237016 ] Sreenath Somarajapuram commented on TEZ-3211: - [~rajesh.balamohan] Looks like yo

[jira] [Comment Edited] (TEZ-3211) tez-ui2 : build issue

2016-04-12 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15237016#comment-15237016 ] Sreenath Somarajapuram edited comment on TEZ-3211 at 4/12/16 11:31 AM: ---

[jira] [Comment Edited] (TEZ-3211) tez-ui2 : build issue

2016-04-12 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15237016#comment-15237016 ] Sreenath Somarajapuram edited comment on TEZ-3211 at 4/12/16 11:31 AM: ---