[jira] [Updated] (PIG-3235) Add log4j.properties for unit tests

2013-03-15 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3235: --- Resolution: Fixed Fix Version/s: 0.12 Status: Resolved (was: Patch Available) Thank

[jira] [Commented] (PIG-3235) Add log4j.properties for unit tests

2013-03-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13604127#comment-13604127 ] Daniel Dai commented on PIG-3235: - +1 > Add log4j.properties for unit tests

[jira] [Updated] (PIG-3235) Add log4j.properties for unit tests

2013-03-15 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3235: --- Summary: Add log4j.properties for unit tests (was: Enable DEBUG log messages in unit tests by default)

[jira] [Updated] (PIG-3235) Enable DEBUG log messages in unit tests by default

2013-03-15 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3235: --- Attachment: PIG-3235-2.patch Sure. I lowered the logging level to INFO, which is the current default va

[jira] [Resolved] (PIG-3236) parametrize snapshot and staging repo id

2013-03-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-3236. - Resolution: Fixed Fix Version/s: 0.12 Hadoop Flags: Reviewed Committed to trunk.

[jira] [Updated] (PIG-3236) parametrize snapshot and staging repo id

2013-03-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3236: Attachment: PIG-3236-0.12.patch Attach patch for trunk. > parametrize snapshot and staging r

[jira] [Commented] (PIG-3235) Enable DEBUG log messages in unit tests by default

2013-03-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13604076#comment-13604076 ] Daniel Dai commented on PIG-3235: - Make sense, but would like set the default to warning. Do

[jira] [Commented] (PIG-3238) Pig current releases lack a UDF Stuff(). This UDF deletes a specified length of characters and inserts another set of characters at a specified starting point.

2013-03-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13604071#comment-13604071 ] Daniel Dai commented on PIG-3238: - Thanks for the patch. However, we need example in javadoc

[jira] [Commented] (PIG-3243) Documentation error

2013-03-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13604066#comment-13604066 ] Daniel Dai commented on PIG-3243: - Would you like to create a patch? Change the src/docs/sr

[jira] [Commented] (PIG-3249) Pig startup script prints out a wrong version of hadoop when using fat jar

2013-03-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13604064#comment-13604064 ] Daniel Dai commented on PIG-3249: - Sure, can't agree more. > Pig startup sc

[jira] Subscription: PIG patch available

2013-03-15 Thread jira
Issue Subscription Filter: PIG patch available (33 issues) Subscriber: pigdaily Key Summary PIG-3247Piggybank functions to mimic OVER clause in SQL https://issues.apache.org/jira/browse/PIG-3247 PIG-3238Pig current releases lack a UDF Stuff(). This UDF deletes

Re: Welcome our new PMC chair, Julien Le Dem

2013-03-15 Thread Julien Le Dem
Thank you all ! Julien On Mar 10, 2013, at 21:31, Xuefu Zhang wrote: > Congrats!!! > > --Xuefu > > On Sun, Mar 10, 2013 at 9:00 PM, Jarek Jarcec Cecho wrote: > >> Congratulations sir! >> >> Jarcec >> >> On Sun, Mar 10, 2013 at 08:55:55PM -0700, Aniket Mokashi wrote: >>> Congrats Julien! >>

Re: Are we ready for 0.11.1 release?

2013-03-15 Thread Julien Le Dem
+1 for a new release Julien On Mar 15, 2013, at 17:08, Dmitriy Ryaboy wrote: > I think all the critical patches we discussed as required for 0.11.1 have > gone in -- is there anything else people want to finish up, or can we roll > this? Current change log: > > Release 0.11.1 (unreleased) >

[jira] [Commented] (PIG-3181) MultiStorage - java.lang.OutOfMemoryError: Java heap space

2013-03-15 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13604062#comment-13604062 ] Johnny Zhang commented on PIG-3181: --- Hi, do you mean below right? {noformat} a = load '/in

Re: Are we ready for 0.11.1 release?

2013-03-15 Thread Daniel Dai
Can I put PIG-3132 in? Thanks, Daniel On Fri, Mar 15, 2013 at 5:55 PM, Julien Le Dem wrote: > +1 for a new release > > On Friday, March 15, 2013, Dmitriy Ryaboy wrote: > >> I think all the critical patches we discussed as required for 0.11.1 have >> gone in -- is there anything else people want

Re: Are we ready for 0.11.1 release?

2013-03-15 Thread Julien Le Dem
+1 for a new release On Friday, March 15, 2013, Dmitriy Ryaboy wrote: > I think all the critical patches we discussed as required for 0.11.1 have > gone in -- is there anything else people want to finish up, or can we roll > this? Current change log: > > Release 0.11.1 (unreleased) > > INCOMPATI

Re: Contribute to PIG-3225

2013-03-15 Thread Daniel Dai
That's PIG-2597. I am not sure about the status of it, if it is not done, we can continue it this year. Daniel On Fri, Mar 15, 2013 at 11:52 AM, Russell Jurney wrote: > Can we have a GsoC entry to antlrize grunt? Who can mentor it? > > Russell Jurney http://datasyndrome.com > > On Mar 15, 2013,

[jira] [Commented] (PIG-3194) Changes to ObjectSerializer.java break compatibility with Hadoop 0.20.2

2013-03-15 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13604037#comment-13604037 ] Prashant Kommireddi commented on PIG-3194: -- Kai, can you confirm 11.1 works for you

[jira] [Commented] (PIG-3194) Changes to ObjectSerializer.java break compatibility with Hadoop 0.20.2

2013-03-15 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13604023#comment-13604023 ] Prashant Kommireddi commented on PIG-3194: -- Thanks for review/commit, Dmitriy.

Re: pig 0.11 candidate 2 feedback: Several problems

2013-03-15 Thread Prashant Kommireddi
Looks like all outstanding 0.11.1 critical bugs are fixed. Time for an RC? Please let me know if I can help. On Fri, Mar 8, 2013 at 3:51 PM, Dmitriy Ryaboy wrote: > Looks like Lohit found a critical bug we should fix for 11.1: > https://issues.apache.org/jira/browse/PIG-3241(only observed in had

Are we ready for 0.11.1 release?

2013-03-15 Thread Dmitriy Ryaboy
I think all the critical patches we discussed as required for 0.11.1 have gone in -- is there anything else people want to finish up, or can we roll this? Current change log: Release 0.11.1 (unreleased) INCOMPATIBLE CHANGES IMPROVEMENTS PIG-2988: start deploying pigunit maven artifact part of

[jira] [Updated] (PIG-3194) Changes to ObjectSerializer.java break compatibility with Hadoop 0.20.2

2013-03-15 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-3194: --- Resolution: Fixed Fix Version/s: 0.12 Status: Resolved (was: Patch Available)

[jira] [Assigned] (PIG-3249) Pig startup script prints out a wrong version of hadoop when using fat jar

2013-03-15 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Kommireddi reassigned PIG-3249: Assignee: Prashant Kommireddi > Pig startup script prints out a wrong version of

[jira] [Updated] (PIG-3249) Pig startup script prints out a wrong version of hadoop when using fat jar

2013-03-15 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Kommireddi updated PIG-3249: - Attachment: PIG-3249.patch > Pig startup script prints out a wrong version of hadoop wh

[jira] [Commented] (PIG-3194) Changes to ObjectSerializer.java break compatibility with Hadoop 0.20.2

2013-03-15 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13603984#comment-13603984 ] Dmitriy V. Ryaboy commented on PIG-3194: +1 > Changes to ObjectSeri

[jira] [Commented] (PIG-3249) Pig startup script prints out a wrong version of hadoop when using fat jar

2013-03-15 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13603946#comment-13603946 ] Prashant Kommireddi commented on PIG-3249: -- Thanks Daniel, that's a nice approach.

Re: LoadFunc and LoadMetadata

2013-03-15 Thread Daniel Dai
Yes, in theory filter should pushed above foreach. I don't know what happen, the easiest way is do an explain and let's check the plan. Daniel On Fri, Mar 15, 2013 at 11:32 AM, Jeff Yuan wrote: > Yes, I do use AS in the load statement. I thought Filters are always > pushed as close to the Load o

[jira] [Updated] (PIG-3244) Make PIG_HOME configurable

2013-03-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3244: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Looks good.

[jira] [Updated] (PIG-3244) Make PIG_HOME configurable

2013-03-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3244: Assignee: Robert Schooley > Make PIG_HOME configurable > -- > > K

[jira] [Updated] (PIG-3194) Changes to ObjectSerializer.java break compatibility with Hadoop 0.20.2

2013-03-15 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Kommireddi updated PIG-3194: - Attachment: PIG-3194_2.patch Uploading a new patch with Dmitriy's feedback incorporated.

Re: Contribute to PIG-3225

2013-03-15 Thread Russell Jurney
Can we have a GsoC entry to antlrize grunt? Who can mentor it? Russell Jurney http://datasyndrome.com On Mar 15, 2013, at 11:34 AM, Daniel Dai wrote: > GSoC 2013 wiki is not up yet. You can find some information from last > year's wiki: https://cwiki.apache.org/confluence/display/PIG/GSoc2012.

[jira] [Assigned] (PIG-2630) Issue with setting "b = a;"

2013-03-15 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang reassigned PIG-2630: - Assignee: (was: Johnny Zhang) > Issue with setting "b = a;" > --- >

Re: Contribute to PIG-3225

2013-03-15 Thread Daniel Dai
GSoC 2013 wiki is not up yet. You can find some information from last year's wiki: https://cwiki.apache.org/confluence/display/PIG/GSoc2012. Thanks, Daniel On Mon, Mar 11, 2013 at 6:38 PM, Dmitriy Ryaboy wrote: > + Gianmarco > > > On Mon, Mar 11, 2013 at 11:20 AM, Sadari Jayawardena < > sjayawar

Re: LoadFunc and LoadMetadata

2013-03-15 Thread Jeff Yuan
Yes, I do use AS in the load statement. I thought Filters are always pushed as close to the Load operators as possible? What kind of Foreach is added? Thanks, Jeff On Fri, Mar 15, 2013 at 10:57 AM, Daniel Dai wrote: > getPartitionKeys should be called by default. Did you use "AS" clause > in loa

[jira] [Commented] (PIG-3223) AvroStorage does not handle comma separated input paths

2013-03-15 Thread Michael Kramer (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13603652#comment-13603652 ] Michael Kramer commented on PIG-3223: - [~cheolsoo], thanks for getting back to me so qui

Re: LoadFunc and LoadMetadata

2013-03-15 Thread Daniel Dai
getPartitionKeys should be called by default. Did you use "AS" clause in load statement? That could add a foreach between Load and Filter, and getPartitionKeys will only be invoked if filter is right after load. Do an explain to check for it. Thanks, Daniel On Thu, Mar 14, 2013 at 8:37 PM, Jeff Y

[jira] [Commented] (PIG-2597) Move grunt from javacc to ANTRL

2013-03-15 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13603583#comment-13603583 ] Koji Noguchi commented on PIG-2597: --- bq. Jonathan, any update on this? I'm interested in t

[jira] [Commented] (PIG-3205) Passing arguments to python script does not work with -f option

2013-03-15 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13603563#comment-13603563 ] Rohini Palaniswamy commented on PIG-3205: - Ah. Sure. Thanks for catching it. Left ov

[jira] [Commented] (PIG-3205) Passing arguments to python script does not work with -f option

2013-03-15 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13603560#comment-13603560 ] Cheolsoo Park commented on PIG-3205: +1. Do you mind deleting the following line if it'

[jira] [Commented] (PIG-3249) Pig startup script prints out a wrong version of hadoop when using fat jar

2013-03-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13603540#comment-13603540 ] Daniel Dai commented on PIG-3249: - We can change to use "java -cp pig.jar org.apache.hadoop.

[jira] [Updated] (PIG-3239) Unable to return multiple values from a macro using SPLIT

2013-03-15 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3239: --- Resolution: Fixed Fix Version/s: 0.12 Status: Resolved (was: Patch Available) Commit

Re: Error 4010 Cannot find hadoop configurations in classpath

2013-03-15 Thread Prashant Kommireddi
Take a look at http://pig.apache.org/docs/r0.11.0/start.html#Running+the+Pig+Scripts+in+Mapreduce+Mode Additionally, you can try "pig -x local" if you wish to run it in local mode http://pig.apache.org/docs/r0.11.0/start.html#Running+the+Pig+Scripts+in+Local+Mode Please follow the instructions on

Re: Pig Error Java_home not set

2013-03-15 Thread Prashant Kommireddi
export JAVA_HOME= on your local machine. Even better if you can add it to your .bashrc or .profile or their equivalents. On Mar 15, 2013, at 7:59 AM, oualid ait wafli wrote: > Hi > > I am beginner at Pig > > I want start it but I dont know how to fix fix the java_home error ! > how set the Jav