Re: Injecting plans

2013-02-12 Thread Prashant Kommireddi
Thanks Bill. I think the issue would be with the fact that I am trying to inject the property (base path) from an external framework into Load/StoreFunc. An analogy could be a fancy random generator that resides in a framework has to be used to setLocation. However, random generator logic can not

Re: [VOTE] Release Pig 0.11.0 (candidate 0)

2013-02-12 Thread Russell Jurney
BUILD FAILED /Users/rjurney/Software/pig-trunk/build.xml:941: The following error occurred while executing this line: /Users/rjurney/Software/pig-trunk/build.xml:863: The following error occurred while executing this line: /Users/rjurney/Software/pig-trunk/build.xml:936: Tests failed! Total time:

Re: [VOTE] Release Pig 0.11.0 (candidate 0)

2013-02-12 Thread Bill Graham
The artifacts don't expand to a pig-trunk/ directory, so is this the release candidate? If so, which ant command did you run and which tests failed? On Tue, Feb 12, 2013 at 7:55 AM, Russell Jurney russell.jur...@gmail.comwrote: BUILD FAILED /Users/rjurney/Software/pig-trunk/build.xml:941:

Re: Injecting plans

2013-02-12 Thread Julien Le Dem
Then I would point the same direction as Bill: override relativeToAbsolutePath That's more or less what HCatalog does: You use a loader/storer that abstracts out where the data is. and based on the requested location you point to the right files. Out of curiosity: Why does your framework need to

Re: [VOTE] Release Pig 0.11.0 (candidate 0)

2013-02-12 Thread Russell Jurney
This is ... branch-0.11 latest. I can't see that any tests actually fail. Strange. On Tue, Feb 12, 2013 at 9:18 AM, Bill Graham billgra...@gmail.com wrote: The artifacts don't expand to a pig-trunk/ directory, so is this the release candidate? If so, which ant command did you run and which

Re: Injecting plans

2013-02-12 Thread Bill Graham
3. Framework has to parse the script to determine the user provided locations? No, no parsing need. The setLocation method will get whatever location was included in the STORE INTO 'foo' statement and it can then modify 'foo' to be some entirely different thing. I'm still not clear on why

Re: [VOTE] Release Pig 0.11.0 (candidate 1)

2013-02-12 Thread Alan Gates
+1 Release notes look good. Built the code and tests, including piggybank and docs. Ran the piggybank tests and all the tutorials. Ran simple smoke tests in local and cluster mode. Alan. On Feb 11, 2013, at 11:03 PM, Bill Graham wrote: Hi, I have created a candidate build for Pig

[jira] [Commented] (PIG-3179) Task Information Header only prints out the first split for each task

2013-02-12 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13577120#comment-13577120 ] Rohini Palaniswamy commented on PIG-3179: - Koji, Another minor comment. Can you

[jira] [Commented] (PIG-3015) Rewrite of AvroStorage

2013-02-12 Thread Joseph Adler (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13577185#comment-13577185 ] Joseph Adler commented on PIG-3015: --- I think the method setLocation for AvroStoage is

[jira] Subscription: PIG patch available

2013-02-12 Thread jira
Issue Subscription Filter: PIG patch available (26 issues) Subscriber: pigdaily Key Summary PIG-3174Remove rpm and deb artifacts from build.xml https://issues.apache.org/jira/browse/PIG-3174 PIG-3169Remove temporary files that are not needed

Re: How do you pass a schema to the backend in a builtin UDF?

2013-02-12 Thread Prashant Kommireddi
Take a look at UDFContext. Sent from my iPhone On Feb 12, 2013, at 7:54 PM, Russell Jurney russell.jur...@gmail.com wrote: I am writing ToJson as a builtin. How do I send the schema of a builtin UDF to the back-end? In ToJson in github, I use udfProp.setProperty(horton.json.udf.schema,

[jira] [Commented] (PIG-3174) Remove rpm and deb artifacts from build.xml

2013-02-12 Thread Bill Graham (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13577333#comment-13577333 ] Bill Graham commented on PIG-3174: -- Actually, a few comments: - Searching around it's not

[jira] [Updated] (PIG-3025) TestPruneColumn unit test - SimpleEchoStreamingCommand perl inline script needs simplification

2013-02-12 Thread Bill Graham (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Graham updated PIG-3025: - Status: Open (was: Patch Available) TestPruneColumn unit test - SimpleEchoStreamingCommand perl

Re: [VOTE] Release Pig 0.11.0 (candidate 0)

2013-02-12 Thread Bill Graham
Is there evidence of failures or errors in the first few lines of any of the logs/TEST-org.apache.pig.test.*.txt files? On Tue, Feb 12, 2013 at 9:28 AM, Russell Jurney russell.jur...@gmail.comwrote: This is ... branch-0.11 latest. I can't see that any tests actually fail. Strange. On Tue,

Re: How do you pass a schema to the backend in a builtin UDF?

2013-02-12 Thread Jonathan Coveney
EvalFunc now has a getInputSchema method, so this is done for you. Unless I am misunderstanding why you want to do? 2013/2/13 Prashant Kommireddi prash1...@gmail.com Take a look at UDFContext. Sent from my iPhone On Feb 12, 2013, at 7:54 PM, Russell Jurney russell.jur...@gmail.com wrote: