[jira] [Updated] (PIG-4284) Enable unit test "TestJoin" for spark

2015-05-26 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-4284: -- Attachment: PIG-4284_2.patch PIG-4284.patch is based on 4ca0ffb - (HEAD, origin/spark, spark) PIG-

[jira] Subscription: PIG patch available

2015-05-26 Thread jira
Issue Subscription Filter: PIG patch available (28 issues) Subscriber: pigdaily Key Summary PIG-4570Allow AvroStorage to use a class for the schema https://issues.apache.org/jira/browse/PIG-4570 PIG-4565Support custom MR partitioners for Spark engine https

[jira] [Commented] (PIG-4283) Enable unit test "TestGrunt" for spark

2015-05-26 Thread Mohit Sabharwal (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14560388#comment-14560388 ] Mohit Sabharwal commented on PIG-4283: -- [~kellyzly], could you please attach a RB for t

[jira] [Resolved] (PIG-4297) Enable unit test "org.apache.pig.test.TestProjectRange" for spark

2015-05-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-4297. -- Resolution: Fixed Committed to spark branch. Thanks, Liyun! > Enable unit test "org.apache.pig.test.TestP

[jira] [Commented] (PIG-4297) Enable unit test "org.apache.pig.test.TestProjectRange" for spark

2015-05-26 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14560322#comment-14560322 ] liyunzhang_intel commented on PIG-4297: --- [~mohitsabharwal]: thanks for your review. [~

[jira] [Commented] (PIG-4297) Enable unit test "org.apache.pig.test.TestProjectRange" for spark

2015-05-26 Thread Mohit Sabharwal (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14560230#comment-14560230 ] Mohit Sabharwal commented on PIG-4297: -- +1 (non-binding) > Enable unit test "org.apach

[jira] [Updated] (PIG-4297) Enable unit test "org.apache.pig.test.TestProjectRange" for spark

2015-05-26 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-4297: -- Attachment: PIG-4297_1.patch [~mohitsabharwal]: thanks your review, has submitted PIG-4297_1.pat

[jira] [Assigned] (PIG-4297) Enable unit test "org.apache.pig.test.TestProjectRange" for spark

2015-05-26 Thread Mohit Sabharwal (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mohit Sabharwal reassigned PIG-4297: Assignee: liyunzhang_intel > Enable unit test "org.apache.pig.test.TestProjectRange" for spar

[jira] [Commented] (PIG-4297) Enable unit test "org.apache.pig.test.TestProjectRange" for spark

2015-05-26 Thread Mohit Sabharwal (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14560198#comment-14560198 ] Mohit Sabharwal commented on PIG-4297: -- Thanks, [~kellyzly] Lot of changes in this pat

[jira] [Updated] (PIG-4565) Support custom MR partitioners for Spark engine

2015-05-26 Thread Mohit Sabharwal (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mohit Sabharwal updated PIG-4565: - Attachment: PIG-4565.1.patch > Support custom MR partitioners for Spark engine > --

[jira] [Created] (PIG-4575) Pass value to MR Partitioners in Spark engine

2015-05-26 Thread Mohit Sabharwal (JIRA)
Mohit Sabharwal created PIG-4575: Summary: Pass value to MR Partitioners in Spark engine Key: PIG-4575 URL: https://issues.apache.org/jira/browse/PIG-4575 Project: Pig Issue Type: Sub-task

[jira] [Commented] (PIG-4570) Allow AvroStorage to use a class for the schema

2015-05-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14560148#comment-14560148 ] Daniel Dai commented on PIG-4570: - [~pmazak], can you add a test case? > Allow AvroStorage

[jira] [Resolved] (PIG-2678) Create abstract PigProgressNotificationListener

2015-05-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-2678. - Resolution: Won't Fix I don't think it is still relevant since Oozie already make use of PPNL. > Create abs

[jira] [Updated] (PIG-4572) CSVExcelStorage treats newlines within fields as record seperator when input file is split

2015-05-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4572: Fix Version/s: 0.16.0 > CSVExcelStorage treats newlines within fields as record seperator when input > file i

[jira] [Updated] (PIG-3864) ToDate(userstring, format, timezone) computes DateTime with strange handling of Daylight Saving Time with location based timezones

2015-05-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3864: Fix Version/s: 0.16.0 Assignee: Daniel Dai Status: Patch Available (was: Open) > ToDate(u

[jira] [Updated] (PIG-3864) ToDate(userstring, format, timezone) computes DateTime with strange handling of Daylight Saving Time with location based timezones

2015-05-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3864: Attachment: PIG-3864-1.patch This should be a bug. Attach patch. > ToDate(userstring, format, timezone) compu

[jira] [Updated] (PIG-4541) Skewed full outer join does not return records if any relation is empty. Outer join does not return any record if left relation is empty

2015-05-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4541: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Patch commit

[jira] [Resolved] (PIG-4571) TestPigRunner.testGetHadoopCounters fail on Windows

2015-05-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4571. - Resolution: Fixed Fix Version/s: (was: 0.15.1) 0.15.0 Hadoop Flags: Review

Re: [VOTE] Release Pig 0.15.0 (candidate 0)

2015-05-26 Thread Daniel Dai
Sorry, but I'd like to include PIG-4541 in, since it produces wrong result. I will roll another RC. Thanks, Daniel From: Alan Gates mailto:alanfga...@gmail.com>> Reply-To: "dev@pig.apache.org" mailto:dev@pig.apache.org>> Date: Tuesday, May 26, 2015 at 2:26 PM To: "dev

[jira] [Commented] (PIG-4541) Skewed full outer join does not return records if any relation is empty. Outer join does not return any record if left relation is empty

2015-05-26 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14560026#comment-14560026 ] Rohini Palaniswamy commented on PIG-4541: - +1 > Skewed full outer join does not ret

[jira] [Commented] (PIG-4541) Skewed full outer join does not return records if any relation is empty. Outer join does not return any record if left relation is empty

2015-05-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14559971#comment-14559971 ] Daniel Dai commented on PIG-4541: - [~dghosal], I can see the skewed join issue when left rel

[jira] [Commented] (PIG-4541) Skewed full outer join does not return records if any relation is empty. Outer join does not return any record if left relation is empty

2015-05-26 Thread Dipankar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14559945#comment-14559945 ] Dipankar commented on PIG-4541: --- I rechecked again and things are not working here. The pig ve

[jira] [Updated] (PIG-4541) Skewed full outer join does not return records if any relation is empty. Outer join does not return any record if left relation is empty

2015-05-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4541: Fix Version/s: (was: 0.15.1) 0.15.0 Status: Patch Available (was: Open) > S

Re: [VOTE] Release Pig 0.15.0 (candidate 0)

2015-05-26 Thread Alan Gates
+1. Downloaded, checked signature and hash, built, ran test-commit and simple local smoke test. Alan. Daniel Dai May 25, 2015 at 20:36 Hi, I have created a candidate build for Pig 0.15.0. Keys used to sign the release are available at http://svn.apache.org/vie

[jira] [Updated] (PIG-4541) Skewed full outer join does not return records if any relation is empty. Outer join does not return any record if left relation is empty

2015-05-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4541: Attachment: PIG-4541-1.patch > Skewed full outer join does not return records if any relation is empty. > Out

[jira] [Commented] (PIG-4541) Skewed full outer join does not return records if any relation is empty. Outer join does not return any record if left relation is empty

2015-05-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14559889#comment-14559889 ] Daniel Dai commented on PIG-4541: - [~dghosal], I tried Pig 0.14.0 with some of your queries,

[jira] [Created] (PIG-4574) Eliminate identity vertex for order by and skewed join right after LOAD

2015-05-26 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-4574: --- Summary: Eliminate identity vertex for order by and skewed join right after LOAD Key: PIG-4574 URL: https://issues.apache.org/jira/browse/PIG-4574 Project: Pig

[jira] [Created] (PIG-4573) Set minimal configured required for Tez

2015-05-26 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-4573: --- Summary: Set minimal configured required for Tez Key: PIG-4573 URL: https://issues.apache.org/jira/browse/PIG-4573 Project: Pig Issue Type: Improvement

[jira] [Commented] (PIG-3864) ToDate(userstring, format, timezone) computes DateTime with strange handling of Daylight Saving Time with location based timezones

2015-05-26 Thread JIRA
[ https://issues.apache.org/jira/browse/PIG-3864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14558928#comment-14558928 ] Eirik Y. Øra commented on PIG-3864: --- I agree. The timezone adjustment should be set accord

[jira] [Commented] (PIG-4555) Add -XX:+UseNUMA for Tez jobs

2015-05-26 Thread Remi Catherinot (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14558850#comment-14558850 ] Remi Catherinot commented on PIG-4555: -- Hi, i've written my answer in the original mail

[jira] [Updated] (PIG-4572) CSVExcelStorage treats newlines within fields as record seperator when input file is split

2015-05-26 Thread Le Clue (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Le Clue updated PIG-4572: - Description: It seems that when a field enclosed by double-quotes contains a carriage return or linefeed, and the i

[jira] [Updated] (PIG-4572) CSVExcelStorage treats newlines within fields as record seperator when input file is split

2015-05-26 Thread Le Clue (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Le Clue updated PIG-4572: - Attachment: script.pig Sample Pig Script > CSVExcelStorage treats newlines within fields as record seperator when i

[jira] [Updated] (PIG-4572) CSVExcelStorage treats newlines within fields as record seperator when input file is split

2015-05-26 Thread Le Clue (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Le Clue updated PIG-4572: - Attachment: SmallTest.txt Sample Input Data 3190 Bytes > CSVExcelStorage treats newlines within fields as record se

[jira] [Created] (PIG-4572) CSVExcelStorage treats newlines within fields as record seperator when input file is split

2015-05-26 Thread Le Clue (JIRA)
Le Clue created PIG-4572: Summary: CSVExcelStorage treats newlines within fields as record seperator when input file is split Key: PIG-4572 URL: https://issues.apache.org/jira/browse/PIG-4572 Project: Pig

[jira] [Updated] (PIG-4297) Enable unit test "org.apache.pig.test.TestProjectRange" for spark

2015-05-26 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-4297: -- Attachment: PIG-4297.patch [~mohitsabharwal],[~praveenr019],[~xuefuz]: PIG-4297.patch is based on

[jira] [Updated] (PIG-4284) Enable unit test "TestJoin" for spark

2015-05-26 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-4284: -- Status: Patch Available (was: Open) > Enable unit test "TestJoin" for spark > ---

[jira] [Updated] (PIG-4284) Enable unit test "TestJoin" for spark

2015-05-26 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-4284: -- Attachment: PIG-4284_1.patch PIG-4284_1.patch is based on "4ca0ffb - (origin/spark) PIG-4568: Fix