[jira] Subscription: PIG patch available

2017-01-06 Thread jira
Issue Subscription Filter: PIG patch available (27 issues) Subscriber: pigdaily Key Summary PIG-4926Modify the content of start.xml for spark mode https://issues-test.apache.org/jira/browse/PIG-4926 PIG-4922Deadlock between SpillableMemoryManager and InternalSortedBag

[jira] Subscription: PIG patch available

2017-01-06 Thread jira
Issue Subscription Filter: PIG patch available (36 issues) Subscriber: pigdaily Key Summary PIG-5082Tez UnionOptimizer creates vertex group with one member https://issues.apache.org/jira/browse/PIG-5082 PIG-5081Can not run pig on spark source code distribution

[jira] [Updated] (PIG-4923) Drop Hadoop 1.x support in Pig 0.17

2017-01-06 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4923: Resolution: Fixed Hadoop Flags: Incompatible change,Reviewed Status: Resolved

[jira] [Commented] (PIG-4923) Drop Hadoop 1.x support in Pig 0.17

2017-01-06 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15806080#comment-15806080 ] Rohini Palaniswamy commented on PIG-4923: - +1. Will commit this today. > Drop Hado

Re: Review Request 54056: Drop Hadoop 1.x support in Pig 0.17

2017-01-06 Thread Rohini Palaniswamy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/54056/#review160784 --- Ship it! Ship It! - Rohini Palaniswamy On Dec. 19, 2016, 9:2

Re: Review Request 54056: Drop Hadoop 1.x support in Pig 0.17

2017-01-06 Thread Rohini Palaniswamy
> On Dec. 13, 2016, 6:22 p.m., Rohini Palaniswamy wrote: > > ivy/libraries.properties, lines 75-76 > > > > > > Having two versions of netty will actually create conflict. Hadoop > > folks were talking about this in r

[jira] [Commented] (PIG-4923) Drop Hadoop 1.x support in Pig 0.17

2017-01-06 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15806070#comment-15806070 ] Adam Szita commented on PIG-4923: - [~rohini], can you please let me know what you think? >

[jira] [Comment Edited] (PIG-5083) CombinerPackager and LitePackager should not materialize bags

2017-01-06 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15805903#comment-15805903 ] Rohini Palaniswamy edited comment on PIG-5083 at 1/6/17 10:09 PM:

[jira] [Created] (PIG-5084) Do ReadOnceBag in Tez for multiple inputs

2017-01-06 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-5084: --- Summary: Do ReadOnceBag in Tez for multiple inputs Key: PIG-5084 URL: https://issues.apache.org/jira/browse/PIG-5084 Project: Pig Issue Type: Improveme

[jira] [Updated] (PIG-5083) CombinerPackager and LitePackager should not materialize bags

2017-01-06 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5083: Attachment: PIG-5083-1.patch While analyzing the heapdump during OOM for the Combiner, found t

[jira] [Updated] (PIG-5083) CombinerPackager and LitePackager should not materialize bags

2017-01-06 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5083: Summary: CombinerPackager and LitePackager should not materialize bags (was: CombinerPackager

[jira] [Updated] (PIG-5083) CombinerPackager uses twice the memory due to materializing of bags

2017-01-06 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5083: Description: Before PIG-3591 and creation of CombinerPackager, POCombinerPackage directly rea

[jira] [Created] (PIG-5083) CombinerPackager uses twice the memory due to materializing of bags

2017-01-06 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-5083: --- Summary: CombinerPackager uses twice the memory due to materializing of bags Key: PIG-5083 URL: https://issues.apache.org/jira/browse/PIG-5083 Project: Pig

[jira] [Updated] (PIG-5078) Script fails with error - POStoreTez only accepts MROutput

2017-01-06 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5078: Attachment: PIG-5078-2.patch > Script fails with error - POStoreTez only accepts MROutput > --

[jira] [Updated] (PIG-5078) Script fails with error - POStoreTez only accepts MROutput

2017-01-06 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5078: Fix Version/s: 0.17.0 Status: Patch Available (was: Open) > Script fails with erro

[jira] [Updated] (PIG-5043) Slowstart not applied in Tez with PARALLEL clause

2017-01-06 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5043: Summary: Slowstart not applied in Tez with PARALLEL clause (was: Slowstart not applied in Tez

[jira] [Updated] (PIG-5043) Slowstart not applied in Tez with PARALLEL clause and auto parallelism not applied for UnorderedPartitioned

2017-01-06 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5043: Attachment: PIG-5043-2.patch Not able to get the test case working. Somehow auto parallelism i

[jira] [Commented] (PIG-4930) Skewed Join Breaks On Empty Sampled Input When Key is From Map

2017-01-06 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15805142#comment-15805142 ] Rohini Palaniswamy commented on PIG-4930: - There is no jira. But I was wondering if

[jira] [Commented] (PIG-5082) Tez UnionOptimizer creates vertex group with one member

2017-01-06 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15805050#comment-15805050 ] Rohini Palaniswamy commented on PIG-5082: - [~tmwoodruff], No. I got that covered.

[jira] [Updated] (PIG-5078) Script fails with error - POStoreTez only accepts MROutput

2017-01-06 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5078: Attachment: PIG-5078-1.patch Will attach another patch with e2e test shortly > Script fails w

[jira] [Comment Edited] (PIG-4930) Skewed Join Breaks On Empty Sampled Input When Key is From Map

2017-01-06 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15804038#comment-15804038 ] Nandor Kollar edited comment on PIG-4930 at 1/6/17 1:20 PM: Sure

[jira] [Commented] (PIG-4858) Implement Skewed join for spark engine

2017-01-06 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15804056#comment-15804056 ] Nandor Kollar commented on PIG-4858: Yes, and with this change, we also have to make sur

[jira] [Commented] (PIG-4930) Skewed Join Breaks On Empty Sampled Input When Key is From Map

2017-01-06 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15804038#comment-15804038 ] Nandor Kollar commented on PIG-4930: Sure, I can, could you please assign the Jira to?