Re: Review Request 45667: Support Pig On Spark

2016-10-26 Thread Pallavi Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/45667/ --- (Updated Oct. 27, 2016, 3:17 a.m.) Review request for pig, Daniel Dai and

[jira] [Commented] (PIG-4920) Fail to use Javascript UDF in spark yarn client mode

2016-10-26 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15610287#comment-15610287 ] liyunzhang_intel commented on PIG-4920: --- [~mohitsabharwal] and [~xuefuz]: thanks for your review and

[jira] [Commented] (PIG-5048) HiveUDTF fail if it is the first expression in projection

2016-10-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15609943#comment-15609943 ] Daniel Dai commented on PIG-5048: - Thanks for the patch. Several comments: 1. I'd like to return

[jira] [Updated] (PIG-5048) HiveUDTF fail if it is the first expression in projection

2016-10-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-5048: Assignee: Nandor Kollar (was: Daniel Dai) > HiveUDTF fail if it is the first expression in projection >

[jira] [Commented] (PIG-4934) SET command does not work well with deprecated settings

2016-10-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15609905#comment-15609905 ] Daniel Dai commented on PIG-4934: - If you have both old and new key set to different value, engine will take

[jira] [Commented] (PIG-4798) big integer literals fail to parse

2016-10-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15609858#comment-15609858 ] Daniel Dai commented on PIG-4798: - This is not just a bug fix, it enables a feature never work before. Can

[jira] [Updated] (PIG-4920) Fail to use Javascript UDF in spark yarn client mode

2016-10-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4920: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to spark branch. Thanks,

[jira] [Commented] (PIG-5025) Improve TestLoad.java: use own separated folder under /tmp

2016-10-26 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15608615#comment-15608615 ] Adam Szita commented on PIG-5025: - Actually I think we should go with [^PIG-5025.1.patch]. I checked this

[jira] [Updated] (PIG-4854) Merge spark branch to trunk

2016-10-26 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-4854: -- Attachment: PigOnSpark_3.patch [~rohini], [~daijy],[~xuefuz]: update PigOnSpark_3.patch.

Re: Review Request 45667: Support Pig On Spark

2016-10-26 Thread kelly zhang
> On May 22, 2016, 9:57 p.m., Rohini Palaniswamy wrote: > > src/org/apache/pig/backend/hadoop/hbase/HBaseStorage.java, line 313 > > > > > > Just change the code to use UDFContext.getUDFContext().getJobConf() > >

[jira] [Updated] (PIG-5051) Initialize PigContants.TASK_INDEX in spark mode correctly

2016-10-26 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5051: -- Description: in MR, we initialize PigContants.TASK_INDEX in

[jira] [Created] (PIG-5051) Initialize PigContants.TASK_INDEX in spark mode correctly

2016-10-26 Thread liyunzhang_intel (JIRA)
liyunzhang_intel created PIG-5051: - Summary: Initialize PigContants.TASK_INDEX in spark mode correctly Key: PIG-5051 URL: https://issues.apache.org/jira/browse/PIG-5051 Project: Pig Issue

[jira] [Updated] (PIG-5029) Optimize sort case when data is skewed

2016-10-26 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5029: -- Attachment: PIG-5029_3.patch > Optimize sort case when data is skewed >

[jira] Subscription: PIG patch available

2016-10-26 Thread jira
Issue Subscription Filter: PIG patch available (27 issues) Subscriber: pigdaily Key Summary PIG-4926Modify the content of start.xml for spark mode https://issues-test.apache.org/jira/browse/PIG-4926 PIG-4922Deadlock between SpillableMemoryManager and

[jira] Subscription: PIG patch available

2016-10-26 Thread jira
Issue Subscription Filter: PIG patch available (35 issues) Subscriber: pigdaily Key Summary PIG-5049Cleanup e2e tests turing_jython.conf https://issues.apache.org/jira/browse/PIG-5049 PIG-5043Slowstart not applied in Tez with PARALLEL clause and auto parallelism not