[jira] [Created] (PIG-2578) Multiple Store-commands mess up mapred.output.dir.

2012-03-09 Thread Mithun Radhakrishnan (Created) (JIRA)
Multiple Store-commands mess up mapred.output.dir. -- Key: PIG-2578 URL: https://issues.apache.org/jira/browse/PIG-2578 Project: Pig Issue Type: Bug Affects Versions: 0.9.2, 0.8.1

[jira] [Commented] (PIG-2542) Jython UDFs only work if the python file is in the current directory

2012-03-09 Thread Aniket Mokashi (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226585#comment-13226585 ] Aniket Mokashi commented on PIG-2542: - How about '../rel/scriptingudf.py'?

[jira] [Updated] (PIG-2576) Change in behavior for UDFContext.getUDFContext().getJobConf() in front-end

2012-03-09 Thread Thomas Weise (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated PIG-2576: -- Fix Version/s: 0.11 0.9.3 0.10 Assignee: Thomas Weise

[jira] [Commented] (PIG-2576) Change in behavior for UDFContext.getUDFContext().getJobConf() in front-end

2012-03-09 Thread Daniel Dai (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226407#comment-13226407 ] Daniel Dai commented on PIG-2576: - +1 > Change in behavior for UDFContext.g

[jira] [Updated] (PIG-2576) Change in behavior for UDFContext.getUDFContext().getJobConf() in front-end

2012-03-09 Thread Thomas Weise (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated PIG-2576: -- Attachment: PIG-2576_0.9.patch Patch to clone UDFContext. Also adding convenience method for frontend che

[jira] [Created] (PIG-2577) UDF :To take first three digit(leading digit) from a column

2012-03-09 Thread vaibhav (Created) (JIRA)
UDF :To take first three digit(leading digit) from a column Key: PIG-2577 URL: https://issues.apache.org/jira/browse/PIG-2577 Project: Pig Issue Type: Test Reporter: v

Re: How can I track the actual map and reduce tasks executed in pig?

2012-03-09 Thread Dmitriy Ryaboy
Pig always runs the same piece of code, generically speaking. There is no codegen. What actually happens is driven by serialized DAGs of the physical operators. This does seem like a bug (or an inefficiency, at least), we shouldn't need 3 mappers to do 3 filters of the same data and re-group. D O

[jira] [Commented] (PIG-2344) UDF / LoadFunc / StoreFunc should be serializable

2012-03-09 Thread Dmitriy V. Ryaboy (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226322#comment-13226322 ] Dmitriy V. Ryaboy commented on PIG-2344: I'm a fan of the general idea, but let's re

[jira] [Commented] (PIG-2344) UDF / LoadFunc / StoreFunc should be serializable

2012-03-09 Thread Thomas Weise (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226299#comment-13226299 ] Thomas Weise commented on PIG-2344: --- Serialization alone would not help in situations wher

[jira] [Commented] (PIG-2576) Change in behavior for UDFContext.getUDFContext().getJobConf() in front-end

2012-03-09 Thread Ashutosh Chauhan (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226196#comment-13226196 ] Ashutosh Chauhan commented on PIG-2576: --- Until PIG-2344 is resolved this (wanting to k

Re: How can I track the actual map and reduce tasks executed in pig?

2012-03-09 Thread Yongzhi Wang
When I change the cogroup command to aggregate 3 filter results: my_raw = LOAD './houred-small.txt' USING PigStorage('\t') AS (user,hour, query); part1 = filter my_raw by hour>11; part2 = filter my_raw by hour<13; part3 = filter my_raw by hour<15; result = cogroup part1 by hour, part2 by hour, par

[jira] [Commented] (PIG-2576) Change in behavior for UDFContext.getUDFContext().getJobConf() in front-end

2012-03-09 Thread Thomas Weise (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226083#comment-13226083 ] Thomas Weise commented on PIG-2576: --- For the user it is a regression or incompatibility in

[jira] [Commented] (PIG-2576) Change in behavior for UDFContext.getUDFContext().getJobConf() in front-end

2012-03-09 Thread Vivek Padmanabhan (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226004#comment-13226004 ] Vivek Padmanabhan commented on PIG-2576: Daniel, currently is there any api calls to

[jira] [Commented] (PIG-2576) Change in behavior for UDFContext.getUDFContext().getJobConf() in front-end

2012-03-09 Thread Daniel Dai (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13225992#comment-13225992 ] Daniel Dai commented on PIG-2576: - This might hardly count as defect. But if we absolutely n

[jira] [Updated] (PIG-2576) Change in behavior for UDFContext.getUDFContext().getJobConf() in front-end

2012-03-09 Thread Vivek Padmanabhan (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Padmanabhan updated PIG-2576: --- Attachment: PIG-2576_Script_UDF.txt Attaching a sample script, udf and exception trace to illus

[jira] [Created] (PIG-2576) Change in behavior for UDFContext.getUDFContext().getJobConf() in front-end

2012-03-09 Thread Vivek Padmanabhan (Created) (JIRA)
Change in behavior for UDFContext.getUDFContext().getJobConf() in front-end --- Key: PIG-2576 URL: https://issues.apache.org/jira/browse/PIG-2576 Project: Pig Issue Type