[jira] Updated: (PIG-1433) pig should create success file if mapreduce.fileoutputcommitter.marksuccessfuljobs is true

2010-06-02 Thread Pradeep Kamath (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep Kamath updated PIG-1433: Attachment: PIG-1433.patch Attached patch addresses the issue in MapReduceLauncher by creating an _SU

[jira] Updated: (PIG-1433) pig should create success file if mapreduce.fileoutputcommitter.marksuccessfuljobs is true

2010-06-02 Thread Pradeep Kamath (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep Kamath updated PIG-1433: Status: Patch Available (was: Open) > pig should create success file if > mapreduce.fileoutputcommi

[jira] Created: (PIG-1433) pig should create success file if mapreduce.fileoutputcommitter.marksuccessfuljobs is true

2010-06-02 Thread Pradeep Kamath (JIRA)
pig should create success file if mapreduce.fileoutputcommitter.marksuccessfuljobs is true -- Key: PIG-1433 URL: https://issues.apache.org/jira/browse/PIG-1433 Pr

[jira] Commented: (PIG-1249) Safe-guards against misconfigured Pig scripts without PARALLEL keyword

2010-06-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12874903#action_12874903 ] Jeff Zhang commented on PIG-1249: - Alan,Thanks for your help. > Safe-guards against misconfi

[jira] Updated: (PIG-1432) [zebra] There are some debuging info output to STDOUT in PIG's TableStorer call path

2010-06-02 Thread Yan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yan Zhou updated PIG-1432: -- Status: Resolved (was: Patch Available) Fix Version/s: 0.8.0 Resolution: Fixed Committed to bo

[jira] Commented: (PIG-1432) [zebra] There are some debuging info output to STDOUT in PIG's TableStorer call path

2010-06-02 Thread Gaurav Jain (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12874871#action_12874871 ] Gaurav Jain commented on PIG-1432: -- +1 > [zebra] There are some debuging info output to ST

[jira] Commented: (PIG-1428) Add getPigStatusReporter() to PigHadoopLogger

2010-06-02 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12874865#action_12874865 ] Dmitriy V. Ryaboy commented on PIG-1428: I notice that the issue has been discussed b

algebraic optimization not invoked for filter following group?

2010-06-02 Thread Dmitriy Ryaboy
It looks like right now, the combiner optimization does not kick in for a script like this: data = load 'foo' using PigStorage() as (a, b, c); grouped = group data by a; filtered = filter grouped by COUNT(data) < 1000; Looking at the code in CombinerOptimizer, seems like the Filter bit is just ps

[jira] Updated: (PIG-282) Custom Partitioner

2010-06-02 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-282: --- Status: Open (was: Patch Available) > Custom Partitioner > -- > > Key: PIG-282

[jira] Updated: (PIG-282) Custom Partitioner

2010-06-02 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-282: --- Status: Patch Available (was: Open) > Custom Partitioner > -- > > Key: PIG-282

[jira] Updated: (PIG-1249) Safe-guards against misconfigured Pig scripts without PARALLEL keyword

2010-06-02 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-1249: Attachment: PIG-1249-4.patch Patch with merge conflict resolution. > Safe-guards against misconfigured Pig s

[jira] Updated: (PIG-1249) Safe-guards against misconfigured Pig scripts without PARALLEL keyword

2010-06-02 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-1249: Status: Patch Available (was: Open) > Safe-guards against misconfigured Pig scripts without PARALLEL keyword

[jira] Updated: (PIG-1249) Safe-guards against misconfigured Pig scripts without PARALLEL keyword

2010-06-02 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-1249: Status: Open (was: Patch Available) The latest patch doesn't apply because of a merge conflict. I'll attach

[jira] Updated: (PIG-282) Custom Partitioner

2010-06-02 Thread Aniket Mokashi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Mokashi updated PIG-282: --- Attachment: CustomPartitionerFinale.patch Added code review comments and some minor changes with test ca

[jira] Commented: (PIG-1432) [zebra] There are some debuging info output to STDOUT in PIG's TableStorer call path

2010-06-02 Thread Yan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12874726#action_12874726 ] Yan Zhou commented on PIG-1432: --- Internal Hudson results: [exec] -1 overall. [exec]

Re: does EvalFunc generate the entire bag always ?

2010-06-02 Thread Alan Gates
I don't think it pushes limit yet in this case. Alan. On Jun 1, 2010, at 1:44 PM, hc busy wrote: well, see that's the thing, the 'sort A by $0' is already nlg(n) ahh, I see, my own example suffers from this problem. I guess I'm wondering how 'limit' works in conjunction with UDF's... A pract

[jira] Commented: (PIG-1432) [zebra] There are some debuging info output to STDOUT in PIG's TableStorer call path

2010-06-02 Thread Yan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12874629#action_12874629 ] Yan Zhou commented on PIG-1432: --- The patch is based on the 0.7 branch. No test is necessary as