[jira] Resolved: (PIG-1745) Disable converting bytes loading from BinStorage

2010-12-05 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-1745. - Resolution: Fixed Release Note: 1. Converting bytes loading from BinStorage() will now result an erro

Debugging query parser

2010-12-05 Thread Renato MarroquĂ­n Mogrovejo
I am trying to debug pig's code, but I can't go into the javacc template files, specifically into the QueryParser class which makes it harder to follow the code. Does anybody know how I could do this? Any type of suggestions are highly appreciated. Thanks in advance. Renato M.

[jira] Updated: (PIG-1755) Clean up duplicated code in Physical Operators

2010-12-05 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-1755: --- Status: Patch Available (was: Open) Existing tests are sufficient for this change. > Clean up

[jira] Updated: (PIG-1755) Clean up duplicated code in Physical Operators

2010-12-05 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-1755: --- Attachment: PIG-1755.patch Reworked a few of the PhysicalOperators to get rid of a few hundred

[jira] Created: (PIG-1755) Clean up duplicated code in Physical Operators

2010-12-05 Thread Dmitriy V. Ryaboy (JIRA)
Clean up duplicated code in Physical Operators -- Key: PIG-1755 URL: https://issues.apache.org/jira/browse/PIG-1755 Project: Pig Issue Type: Improvement Reporter: Dmitriy V. Ryaboy

[jira] Commented: (PIG-1751) New logical plan: PushDownForEachFlatten fail in UDF with unknown output schema

2010-12-05 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12967058#action_12967058 ] Daniel Dai commented on PIG-1751: - test-patch: [exec] +1 overall. [exec] [

[jira] Resolved: (PIG-1751) New logical plan: PushDownForEachFlatten fail in UDF with unknown output schema

2010-12-05 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-1751. - Resolution: Fixed Hadoop Flags: [Reviewed] > New logical plan: PushDownForEachFlatten fail in UDF wit

Re: What's the difference between JobContext, UDFContext?

2010-12-05 Thread Daniel Dai
Are you saying passing configurations to UDF? You can either: 1. Use -D option in command line 2. Put key-value entries into pig.properties, and put the folder containing pig.properties into classpath 3. Create a text file contains key-value pairs, pass it to Pig using command line option -P pro

Re: about pig

2010-12-05 Thread Dmitriy Ryaboy
I can only guess that pig.jar does not live in the directory you are running this command from. As you can see from the paste below, what you are doing should work assuming pig.jar exists. dmitriy$ java -Xmx256m -cp pig.jar org.apache.pig.Main -x local 2010-12-05 11:34:49,776 [main] INFO org.apac

Re: What's the difference between JobContext, UDFContext?

2010-12-05 Thread Jae Lee
is there a easy way to distribute information that UDF relies on from front-end (pig shell) to back-end (map-reduce jobs) I'm trying to work out hive table schema from front-end once then get back-end to use the schema later on. I was hoping to be able to use either of the contexts to store sch

Re: What's the difference between JobContext, UDFContext?

2010-12-05 Thread Daniel Dai
There are couple of differences: * JobContext is a hadoop concept, UDFContext is a Pig concept * JobContext is per Map-reduce job, UDFContext is per Pig store Usually you store some per store settings inside UDFContext, and retrieve it later. Properties p = UDFContext.getUDFContext().getUDFPro