Review Request: New logical plan: FilterLogicExpressionSimplifier fail to deal with UDF

2011-01-26 Thread Daniel Dai
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/356/ --- Review request for pig and Xuefu Zhang. Summary --- The following script

[jira] Commented: (PIG-1820) New logical plan: FilterLogicExpressionSimplifier fail to deal with UDF

2011-01-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12987120#action_12987120 ] Daniel Dai commented on PIG-1820: - Review request: https://reviews.apache.org/r/356/ New

[jira] Updated: (PIG-1618) Switch to new parser generator technology

2011-01-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-1618: - Attachment: NewParser-14.patch A visitor for new logical plan. It does some schema validations, but it

[jira] Commented: (PIG-1819) For implicit binding, Jython embedded Pig should skip any variable/value that contains $.

2011-01-26 Thread Richard Ding (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12987139#action_12987139 ] Richard Ding commented on PIG-1819: --- In this case, you need to escape the $: {code} from

[jira] Commented: (PIG-1824) Support import modules in Jython UDF

2011-01-26 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12987143#action_12987143 ] Alan Gates commented on PIG-1824: - +1 to Ashutosh's comment. Also, this won't port well as

Review Request: Problem with DID_NOT_FIND_LOAD_ONLY_MAP_PLAN

2011-01-26 Thread Daniel Dai
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/357/ --- Review request for pig, thejas and Alan Gates. Summary --- The following

[jira] Commented: (PIG-1812) Problem with DID_NOT_FIND_LOAD_ONLY_MAP_PLAN

2011-01-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12987164#action_12987164 ] Daniel Dai commented on PIG-1812: - Review request: https://reviews.apache.org/r/357/

[jira] Updated: (PIG-1819) For implicit binding, Jython embedded Pig should skip any variable/value that contains $.

2011-01-26 Thread Richard Ding (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Ding updated PIG-1819: -- Attachment: PIG-1819_1.patch Thanks Julien for reviewing the patch. I shouldn't skip the escaped $ in

[jira] Created: (PIG-1825) ability to turn off the write ahead log for pig's HBaseStorage

2011-01-26 Thread Corbin Hoenes (JIRA)
ability to turn off the write ahead log for pig's HBaseStorage -- Key: PIG-1825 URL: https://issues.apache.org/jira/browse/PIG-1825 Project: Pig Issue Type: Improvement Affects

[jira] Updated: (PIG-1825) ability to turn off the write ahead log for pig's HBaseStorage

2011-01-26 Thread Corbin Hoenes (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Corbin Hoenes updated PIG-1825: --- Attachment: HBaseStorage_noWAL.patch Patched against branch_0.8.0 ability to turn off the write

Re: Pig 0.8 HBaseStorage patch

2011-01-26 Thread Corbin Hoenes
Okay I've created a JIRA and submitted the patch. It's my first patch so please educate me on proper etiquette. https://issues.apache.org/jira/browse/PIG-1825 On Wed, Jan 26, 2011 at 12:43 PM, Alan Gates ga...@yahoo-inc.com wrote: Yahoo is not a huge user of Pig and HBase together yet, so

[jira] Created: (PIG-1826) Unexpected data type -1 found in stream error

2011-01-26 Thread Jonathan Coveney (JIRA)
Unexpected data type -1 found in stream error - Key: PIG-1826 URL: https://issues.apache.org/jira/browse/PIG-1826 Project: Pig Issue Type: Bug Affects Versions: 0.8.0 Environment:

[jira] Updated: (PIG-1826) Unexpected data type -1 found in stream error

2011-01-26 Thread Jonathan Coveney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-1826: -- Description: When running the attached udf I get the title error. By inserting printlns

[jira] Updated: (PIG-1776) changing statement corresponding to alias after explain , then doing dump gives incorrect result

2011-01-26 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated PIG-1776: --- Attachment: PIG-1776.1.patch The root cause of the problem was that the UDFContext objects were not

[jira] Commented: (PIG-1776) changing statement corresponding to alias after explain , then doing dump gives incorrect result

2011-01-26 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12987250#action_12987250 ] Thejas M Nair commented on PIG-1776: test-patch and all unit tests pass. [exec] +1

[jira] Commented: (PIG-1819) For implicit binding, Jython embedded Pig should skip any variable/value that contains $.

2011-01-26 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12987249#action_12987249 ] Julien Le Dem commented on PIG-1819: As discussed: * I've created a new Jira PIG-1827

Re: Pig developer meeting in February

2011-01-26 Thread Julien Le Dem
If making Pig Thread safe (i.e.: two threads running a different pig script) is important then we need to change some of the APIs from static singleton access to a dependency injection pattern. In that case, this should probably be done before 1.0 For example: UDFContext should be passed to the

Re: Pig developer meeting in February

2011-01-26 Thread Dmitriy Ryaboy
I may be wrong but I think predicate pushdown is designed for, but not actually implemented in the current LoadPushdown interface (you can only push projections). If I am wrong, that's great.. but if not, that would be an important feature to add, as people are trying to connect Pig to smart

[jira] Commented: (PIG-1618) Switch to new parser generator technology

2011-01-26 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12987313#action_12987313 ] Thejas M Nair commented on PIG-1618: +1 NewParser-14.patch committed to trunk. Switch

[jira] Updated: (PIG-1819) For implicit binding, Jython embedded Pig should skip any variable/value that contains $.

2011-01-26 Thread Richard Ding (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Ding updated PIG-1819: -- Attachment: PIG-1819_2.patch Attaching a new patch. Thanks Julien for the suggestions. For implicit

Re: Pig developer meeting in February

2011-01-26 Thread Daniel Dai
Are you talking about LoadMetadata.setPartitionFilter? PartitionFilterOptimizer will do that. Daniel Dmitriy Ryaboy wrote: I may be wrong but I think predicate pushdown is designed for, but not actually implemented in the current LoadPushdown interface (you can only push projections). If I am

Re: Pig developer meeting in February

2011-01-26 Thread Dmitriy Ryaboy
Right, we do partition filtering, but not true predicate pushdown. On Wed, Jan 26, 2011 at 5:59 PM, Daniel Dai jiany...@yahoo-inc.com wrote: Are you talking about LoadMetadata.setPartitionFilter? PartitionFilterOptimizer will do that. Daniel Dmitriy Ryaboy wrote: I may be wrong but I

[jira] Updated: (PIG-1812) Problem with DID_NOT_FIND_LOAD_ONLY_MAP_PLAN

2011-01-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1812: Attachment: PIG-1812-2.patch Problem with DID_NOT_FIND_LOAD_ONLY_MAP_PLAN

[jira] Updated: (PIG-1813) Pig 0.8 throws ERROR 1075 while trying to refer a map in the result of eval udf.Works with 0.7

2011-01-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1813: Attachment: PIG-1813-3.patch PIG-1813-2.patch is for trunk. Pig 0.8 throws ERROR 1075 while trying to