Re: LoadMetada.getStatistics() is unsupported

2012-03-26 Thread Daniel Dai
Return null should be fine. I changed that for BinStorage, which otherwise breaks unit test. Daniel On Sun, Mar 25, 2012 at 10:07 PM, Bill Graham billgra...@gmail.com wrote: Hi, We found a bug where InterStorage.getStatistics() was throwing UnsupportedOperationException which was causing

[jira] [Commented] (PIG-1314) Add DateTime Support to Pig

2012-03-26 Thread Daniel Dai (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13238187#comment-13238187 ] Daniel Dai commented on PIG-1314: - I would like to mentor this. Add

Re: Pig Newbie: Building with Ant

2012-03-26 Thread Daniel Dai
remove ivy/ivy-2.2.0.jar and try rebuild. On Sun, Mar 25, 2012 at 4:26 PM, Apurv Verma dapu...@gmail.com wrote: Hi,  I checked out the latest trunk and tried to run ant which throwed some errors. I generally use maven. Usually the first thing to do after downloading a maven project is mvn

[jira] [Updated] (PIG-2612) e2e harness: should not require PH_OLD_CLUSTER_CONF

2012-03-26 Thread Daniel Dai (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2612: Resolution: Fixed Fix Version/s: (was: 0.11) Hadoop Flags: Reviewed Status:

[jira] [Commented] (PIG-1767) Intermediate data lost in local mode

2012-03-26 Thread Daniel Dai (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13238194#comment-13238194 ] Daniel Dai commented on PIG-1767: - What is your ds.default.name?

[jira] [Commented] (PIG-2616) JobControlCompiler.getInputSizeFromLoader must handle exceptions from LoadFunc.getStatistics.

2012-03-26 Thread Daniel Dai (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13238195#comment-13238195 ] Daniel Dai commented on PIG-2616: - The fix is fine. You can also drop

[jira] [Commented] (PIG-2613) Pig substitutes/mangles upper ASCII characters (values 127)

2012-03-26 Thread Daniel Dai (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13238198#comment-13238198 ] Daniel Dai commented on PIG-2613: - Can you attach your input? Pig

[jira] [Commented] (PIG-2610) GC errors on using FILTER within nested FOREACH

2012-03-26 Thread Daniel Dai (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13238205#comment-13238205 ] Daniel Dai commented on PIG-2610: - Yes, we shall open a Jira for the new rule. For now, you

Re: Pig Newbie: Building with Ant

2012-03-26 Thread Apurv Verma
Works for me, thanks. :) -- thanks and regards, Apurv Verma B. Tech.(CSE) IIT- Ropar On Mon, Mar 26, 2012 at 1:36 PM, Daniel Dai da...@hortonworks.com wrote: remove ivy/ivy-2.2.0.jar and try rebuild. On Sun, Mar 25, 2012 at 4:26 PM, Apurv Verma dapu...@gmail.com wrote: Hi, I

Build failed in Jenkins: Pig-trunk #1215

2012-03-26 Thread Apache Jenkins Server
See https://builds.apache.org/job/Pig-trunk/1215/changes Changes: [daijy] Fix several e2e test failures -- [...truncated 6487 lines...] [findbugs] org.mozilla.javascript.NativeJavaObject [findbugs] jline.ConsoleReaderInputStream [findbugs]

[jira] [Updated] (PIG-2613) Pig substitutes/mangles upper ASCII characters (values 127)

2012-03-26 Thread Leo Heska (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leo Heska updated PIG-2613: --- Attachment: DummyDataTS.txt Pig substitutes/mangles upper ASCII characters (values 127)

[jira] [Commented] (PIG-2613) Pig substitutes/mangles upper ASCII characters (values 127)

2012-03-26 Thread Leo Heska (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13238263#comment-13238263 ] Leo Heska commented on PIG-2613: Sample input file attached, though the one line of input

[jira] [Updated] (PIG-2616) JobControlCompiler.getInputSizeFromLoader must handle exceptions from LoadFunc.getStatistics.

2012-03-26 Thread Bill Graham (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Graham updated PIG-2616: - Attachment: pig-2616.2.patch Here's a patch that returns null from {{InterStorage.getStatistics}}, which

Re: LoadMetada.getStatistics() is unsupported

2012-03-26 Thread Bill Graham
Sounds good, I just updated the patch. Return null is what the LoadMetadata javadoc says to do when stats aren't available actually, so the null case should be expected. On Mon, Mar 26, 2012 at 1:03 AM, Daniel Dai da...@hortonworks.com wrote: Return null should be fine. I changed that for

Re: Review Request: JRuby UDFs in Pig

2012-03-26 Thread Jonathan Coveney
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/4091/ --- (Updated 2012-03-26 17:28:16.350869) Review request for pig, Julien Le Dem and

[jira] [Commented] (PIG-2317) Ruby/Jruby UDFs

2012-03-26 Thread jirapos...@reviews.apache.org (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13238576#comment-13238576 ] jirapos...@reviews.apache.org commented on PIG-2317:

[GSoC 2012] Interested in PIG Cubing [PIG-2167]

2012-03-26 Thread ASF - Maillists
Hello everyone I am MS student at The Ohio State University and I have been working on hadoop for about a year. Regarding other related work, I have implemented map side fragment replicated join in YSmart as a part of a course project. I am currently doing research with Prof. Arnab Nandi.

[jira] [Updated] (PIG-2317) Ruby/Jruby UDFs

2012-03-26 Thread Daniel Dai (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2317: Attachment: PIG-2317-10_plus.patch Seems I still need a small patch to make e2e tests work. I attach

[jira] [Created] (PIG-2617) Project-Range expression fails inside macro for UDF arguments

2012-03-26 Thread Doug Daniels (Created) (JIRA)
Project-Range expression fails inside macro for UDF arguments -- Key: PIG-2617 URL: https://issues.apache.org/jira/browse/PIG-2617 Project: Pig Issue Type: Bug

[jira] [Commented] (PIG-2613) Pig substitutes/mangles upper ASCII characters (values 127)

2012-03-26 Thread Leo Heska (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13238947#comment-13238947 ] Leo Heska commented on PIG-2613: Forgot to mention - this sounds very like HIVE-237:

[jira] [Created] (PIG-2618) Pig e2e local fails to build

2012-03-26 Thread Jonathan Coveney (Created) (JIRA)
Pig e2e local fails to build Key: PIG-2618 URL: https://issues.apache.org/jira/browse/PIG-2618 Project: Pig Issue Type: Bug Reporter: Jonathan Coveney Assignee: Jonathan Coveney

[jira] [Updated] (PIG-2618) Pig e2e local fails to build

2012-03-26 Thread Jonathan Coveney (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-2618: -- Status: Patch Available (was: Open) Pig e2e local fails to build

[jira] [Updated] (PIG-2618) Pig e2e local fails to build

2012-03-26 Thread Jonathan Coveney (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-2618: -- Attachment: PIG-2618.patch Pig e2e local fails to build

[jira] [Updated] (PIG-2317) Ruby/Jruby UDFs

2012-03-26 Thread Jonathan Coveney (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-2317: -- Attachment: PIG-2317-12.patch Ruby/Jruby UDFs --- Key:

[jira] [Commented] (PIG-2317) Ruby/Jruby UDFs

2012-03-26 Thread jirapos...@reviews.apache.org (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13239015#comment-13239015 ] jirapos...@reviews.apache.org commented on PIG-2317:

[jira] [Commented] (PIG-2317) Ruby/Jruby UDFs

2012-03-26 Thread Daniel Dai (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13239017#comment-13239017 ] Daniel Dai commented on PIG-2317: - The error I see is Pig does not ship jruby.jar. We shall

[jira] [Updated] (PIG-2537) Output from flatten with a null tuple input generating data inconsistent with the schema

2012-03-26 Thread Daniel Dai (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2537: Fix Version/s: (was: 0.10) 0.11 Discussed with Thejas, Alan, we might need to

Re: Review Request: JRuby UDFs in Pig

2012-03-26 Thread Jonathan Coveney
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/4091/ --- (Updated 2012-03-27 00:11:05.270583) Review request for pig, Julien Le Dem and

[jira] [Updated] (PIG-2317) Ruby/Jruby UDFs

2012-03-26 Thread Jonathan Coveney (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-2317: -- Attachment: PIG-2317-13.patch PIG-2317-13.patch Daniel, As always, thanks for

[jira] [Updated] (PIG-2618) Pig e2e local fails to build

2012-03-26 Thread Jonathan Coveney (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-2618: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed. r1305701 has the

[jira] [Updated] (PIG-2540) AvroStorage can't read schema on amazon s3 in elastic mapreduce

2012-03-26 Thread Jonathan Coveney (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-2540: -- Resolution: Fixed Fix Version/s: 0.11 0.9.3 Hadoop Flags: Reviewed

[jira] [Commented] (PIG-2540) AvroStorage can't read schema on amazon s3 in elastic mapreduce

2012-03-26 Thread Jonathan Coveney (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13239131#comment-13239131 ] Jonathan Coveney commented on PIG-2540: --- Applied to pig0.9 r1305717 Onward and

[jira] [Commented] (PIG-2614) AvroStorage crashes on LOADING a single bad error

2012-03-26 Thread Jonathan Coveney (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13239193#comment-13239193 ] Jonathan Coveney commented on PIG-2614: --- Russell, In Elephant-bird, there is a key

[jira] [Updated] (PIG-2614) AvroStorage crashes on LOADING a single bad error

2012-03-26 Thread Jonathan Coveney (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-2614: -- Attachment: PIG-2614_0.patch works in both 0.10 and 0.11 AvroStorage crashes

[jira] [Updated] (PIG-2614) AvroStorage crashes on LOADING a single bad error

2012-03-26 Thread Jonathan Coveney (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-2614: -- Priority: Major (was: Blocker) Affects Version/s: 0.11 Fix Version/s: 0.11

What outstanding patches are must haves for 0.10? (path to a RC theater)

2012-03-26 Thread Jonathan Coveney
It's time to get serious about rolling an RC. 0.10 seems pretty strong... are there any pressing JIRAs that people want to try and get in? Looking at the open JIRAs with a fix labeled of 0.10 (which is admittedly possibly incomplete), it looks like there isn't anything terribly seriously left...

Re: What outstanding patches are must haves for 0.10? (path to a RC theater)

2012-03-26 Thread Daniel Dai
Once PIG-2317 check in, only document patch (PIG-2601) and some of Russell's patches left. Before roll up RC, we need to make sure all unit tests and e2e tests pass, I can help with this. Daniel On Mon, Mar 26, 2012 at 10:29 PM, Jonathan Coveney jcove...@gmail.com wrote: It's time to get

Re: What outstanding patches are must haves for 0.10? (path to a RC theater)

2012-03-26 Thread Jonathan Coveney
Perhaps a big initiative for 0.11 could be to get the builds to the point where flaky tests don't essentially gut the usefulness of the CI server (Pig 0.9 hasn't passed in 6 months, etc). I'm not sure how difficult that would be though, and what the benefit would be. But it's pretty annoying to be