[jira] [Created] (PIG-2553) Pig shouldn't allow attempts to write multiple relations into same directory

2012-02-24 Thread Dmitriy V. Ryaboy (Created) (JIRA)
Pig shouldn't allow attempts to write multiple relations into same directory Key: PIG-2553 URL: https://issues.apache.org/jira/browse/PIG-2553 Project: Pig Issue

[jira] [Commented] (PIG-2541) Automatic record provenance (source tagging) for PigStorage

2012-02-24 Thread Daniel Dai (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13215880#comment-13215880 ] Daniel Dai commented on PIG-2541: - I will take a look today or tomorrow.

Re: Getting e2e test to work with JRuby -- how do I get it to see a library?

2012-02-24 Thread Daniel Dai
Hi, Jonathan, This should similar to python UDF. Take a look of Scripting tests in nightly.conf. We use SCRIPTHOMEPATH to find python udf which is located in test/e2e/pig/udfs/python. You can create a directory test/e2e/pig/ruby to include ruby udfs. Thanks, Daniel On Thu, Feb 23, 2012 at 4:17

[jira] [Updated] (PIG-2552) Better Property handling to deal with deprecation and variable substitution of Hadoop config

2012-02-24 Thread Daniel Dai (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2552: Description: Traditionally Pig handles hadoop configuration using PigContext.properties, the flow is: 1.

Re: Getting e2e test to work with JRuby -- how do I get it to see a library?

2012-02-24 Thread Jonathan Coveney
Thanks Daniel! 2012/2/24 Daniel Dai da...@hortonworks.com Hi, Jonathan, This should similar to python UDF. Take a look of Scripting tests in nightly.conf. We use SCRIPTHOMEPATH to find python udf which is located in test/e2e/pig/udfs/python. You can create a directory test/e2e/pig/ruby to

Re: Getting e2e test to work with JRuby -- how do I get it to see a library?

2012-02-24 Thread Jonathan Coveney
Ah, ok, I think there was a misunderstanding. I do not have any difficulty getting the e2e tests to run, or to see the ruby scripts... The issue is that the ruby scripts have to require a library (require 'pigudf'), and there is no way to get that file where they can see them. Since the tests are

Re: Getting e2e test to work with JRuby -- how do I get it to see a library?

2012-02-24 Thread Daniel Dai
Current directory for e2e tests is test/e2e/pig/testdist. All the script file in test/e2e/pig/udfs/ruby should copy to libexec/ruby (we might need to change test/e2e/pig/build.xml if it does not copy). I am not familiar with ruby, but can you require libexec/ruby/pigudf? Daniel On Fri, Feb 24,

[jira] [Commented] (PIG-2470) Issue with CSVEXcelStorage piggy bank function

2012-02-24 Thread Peter Welch (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13216195#comment-13216195 ] Peter Welch commented on PIG-2470: -- Can you provide an example? Issue

[jira] [Created] (PIG-2556) CSVExcelStorage load: quoted field with newline as first character sees newline as record end

2012-02-24 Thread Peter Welch (Created) (JIRA)
CSVExcelStorage load: quoted field with newline as first character sees newline as record end -- Key: PIG-2556 URL: https://issues.apache.org/jira/browse/PIG-2556

[jira] [Created] (PIG-2557) CSVExcelStorage save : empty quotes becomes 4 quotes . This should become a null field.

2012-02-24 Thread Peter Welch (Created) (JIRA)
CSVExcelStorage save : empty quotes becomes 4 quotes . This should become a null field. --- Key: PIG-2557 URL: https://issues.apache.org/jira/browse/PIG-2557

[jira] [Updated] (PIG-2532) Registered classes fail deserialization in frontend

2012-02-24 Thread Julien Le Dem (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-2532: --- Attachment: PIG-2532-v4.patch I rebased the patch again and did a small change so that the test can be

Re: GSoC 2012

2012-02-24 Thread Daniel Dai
Hi, Zhijie, Glad to see you again. As a tradition, Pig definitely will be part of this year's GSoC and you are welcome to apply. I try to compile a page in a week or so. Folks, anyone volunteer to mentor besides me? Daniel On Fri, Feb 24, 2012 at 4:42 PM, Zhijie Shen zjshe...@gmail.com wrote:

Re: GSoC 2012

2012-02-24 Thread Daniel Dai
Committer is not necessary. Welcome on board, Jonathan! On Fri, Feb 24, 2012 at 6:05 PM, Jon Coveney jcove...@gmail.com wrote: Do you guys only accept committer mentors? My knowledge of pig isn't as deep as some, but I'd be willing to throw my hat in. Sent from my iPhone On Feb 24, 2012,