[jira] [Assigned] (PIG-3065) pig output format/committer should support recovery for hadoop 0.23

2013-09-16 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang reassigned PIG-3065: - Assignee: (was: Johnny Zhang) pig output format/committer should support recovery

[jira] [Commented] (PIG-3279) Support nested RANK

2013-08-26 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13750350#comment-13750350 ] Johnny Zhang commented on PIG-3279: --- Hi, Olga, sorry for the delay. As you can see

[jira] [Commented] (PIG-3394) pig parser complain same value passed to macro when expanding macro

2013-07-26 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13720467#comment-13720467 ] Johnny Zhang commented on PIG-3394: --- [~abacus], thanks for explanations! this is for sure

[jira] [Commented] (PIG-3394) pig parser complain same value passed to macro when expanding macro

2013-07-26 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13721009#comment-13721009 ] Johnny Zhang commented on PIG-3394: --- [~cheolsoo], sure, I am fine with it. Just want

[jira] [Commented] (PIG-3394) pig parser complain same value passed to macro when expanding macro

2013-07-26 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13721034#comment-13721034 ] Johnny Zhang commented on PIG-3394: --- sounds great! Thanks for [~abacus] report this jira

[jira] [Reopened] (PIG-2247) Pig parser does not detect multiple arguments with the same name passed to macro

2013-07-26 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang reopened PIG-2247: --- please see discussion in PIG-3394. The original patch detects duplicate arguments, but it should detect

[jira] [Commented] (PIG-3394) pig parser complain same value passed to macro when expanding macro

2013-07-25 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13719882#comment-13719882 ] Johnny Zhang commented on PIG-3394: --- [~abacus], this is the introduced by bug fix PIG-2247

[jira] [Updated] (PIG-3065) pig output format/committer should support recovery for hadoop 0.23

2013-07-12 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-3065: -- Attachment: PIG-3065.patch.txt Rohini, thanks for your comments. Appreciate. I just upload the polished

[jira] [Commented] (PIG-3369) unit test TestImplicitSplitOnTuple.testImplicitSplitterOnTuple failed when using hadoopversion=23

2013-07-12 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707461#comment-13707461 ] Johnny Zhang commented on PIG-3369: --- turn out in hadoop23 profile, the test expects

[jira] [Updated] (PIG-3369) unit test TestImplicitSplitOnTuple.testImplicitSplitterOnTuple failed when using hadoopversion=23

2013-07-12 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-3369: -- Attachment: PIG-3369.patch.txt Thanks for the comments, Cheolsoo! I was looking at why JOIN get

[jira] [Updated] (PIG-3369) unit test TestImplicitSplitOnTuple.testImplicitSplitterOnTuple failed when using hadoopversion=23

2013-07-12 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-3369: -- Status: Patch Available (was: Open) unit test TestImplicitSplitOnTuple.testImplicitSplitterOnTuple

[jira] [Commented] (PIG-3359) Register Statements and Param Substitution in Macros

2013-07-11 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706134#comment-13706134 ] Johnny Zhang commented on PIG-3359: --- Hi, Jonathan, few questions: 1. how to use existing

[jira] [Updated] (PIG-3065) pig output format/committer should support recovery for hadoop 0.23

2013-07-08 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-3065: -- Status: Open (was: Patch Available) pig output format/committer should support recovery for hadoop

[jira] [Updated] (PIG-3065) pig output format/committer should support recovery for hadoop 0.23

2013-07-03 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-3065: -- Attachment: PIG-3065.patch.txt Rohini, thanks a lot for your explanations! This patch added a new

[jira] [Updated] (PIG-3065) pig output format/committer should support recovery for hadoop 0.23

2013-07-03 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-3065: -- Assignee: Johnny Zhang Status: Patch Available (was: Open) pig output format/committer

[jira] [Updated] (PIG-3369) unit test TestImplicitSplitOnTuple.testImplicitSplitterOnTuple failed when using hadoopversion=23

2013-07-01 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-3369: -- Description: in trunk, this test pass with hadoopversion 20, but when using -Dhadoopversion=23

[jira] [Created] (PIG-3369) unit test TestImplicitSplitOnTuple.testImplicitSplitterOnTuple failed when using hadoopversion=23

2013-07-01 Thread Johnny Zhang (JIRA)
Johnny Zhang created PIG-3369: - Summary: unit test TestImplicitSplitOnTuple.testImplicitSplitterOnTuple failed when using hadoopversion=23 Key: PIG-3369 URL: https://issues.apache.org/jira/browse/PIG-3369

[jira] [Commented] (PIG-3292) Logical plan invalid state: duplicate uid in schema during self-join to get cross product

2013-06-12 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13681358#comment-13681358 ] Johnny Zhang commented on PIG-3292: --- unit tests all pass. Logical plan

[jira] [Commented] (PIG-3292) Logical plan invalid state: duplicate uid in schema during self-join to get cross product

2013-06-10 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13680153#comment-13680153 ] Johnny Zhang commented on PIG-3292: --- thanks for the patch, works for me locally. +1 (non

[jira] [Commented] (PIG-3292) Logical plan invalid state: duplicate uid in schema during self-join to get cross product

2013-06-07 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13678589#comment-13678589 ] Johnny Zhang commented on PIG-3292: --- thanks for opening jira Sergey, took a look, not sure

[jira] [Updated] (PIG-3250) Pig dryrun generates wrong output in .expanded file for 'SPLIT....OTHERWISE...' command

2013-06-04 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-3250: -- Attachment: PIG-3250.patch.txt with this patch, macro including SPLIT...OTHERWISE is expanded

[jira] [Updated] (PIG-3279) Support nested RANK

2013-06-03 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-3279: -- Attachment: PIG-3279-3.patch.txt Thanks a lot for your comments, [~daijy]! Appreciate. I changed

[jira] [Commented] (PIG-3329) RANK operator failed when working with SPLIT

2013-06-03 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13673936#comment-13673936 ] Johnny Zhang commented on PIG-3329: --- [~xalan], are you working this right now? I got

[jira] [Commented] (PIG-3329) RANK operator failed when working with SPLIT

2013-05-29 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13669057#comment-13669057 ] Johnny Zhang commented on PIG-3329: --- [~xalan], thanks for your comments. the RANK

[jira] [Commented] (PIG-3329) RANK operator failed when working with SPLIT

2013-05-23 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665400#comment-13665400 ] Johnny Zhang commented on PIG-3329: --- Redis, I actually can reproduce the issue

[jira] [Commented] (PIG-3329) RANK operator failed when working with SPLIT

2013-05-23 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665403#comment-13665403 ] Johnny Zhang commented on PIG-3329: --- The issue doesn't happen when using RANK BY, so

[jira] [Commented] (PIG-2244) Macros cannot be passed relation names

2013-05-22 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13664514#comment-13664514 ] Johnny Zhang commented on PIG-2244: --- [~xuefuz], thanks for your comments! I think

[jira] [Commented] (PIG-3314) make better symbol resolving order in Pig

2013-05-17 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13660469#comment-13660469 ] Johnny Zhang commented on PIG-3314: --- the symbol I can think include (from high priority

[jira] [Updated] (PIG-2378) macros don't accept references to items within tuples as arguments

2013-05-17 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-2378: -- Status: Open (was: Patch Available) turn out it breaks several unit tests, cancel the current patch

[jira] [Updated] (PIG-2378) macros don't accept references to items within tuples as arguments

2013-05-16 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-2378: -- Attachment: PIG-2378.patch.txt this is a working patch resolving the issue. Now you don't have to use

[jira] [Updated] (PIG-2378) macros don't accept references to items within tuples as arguments

2013-05-16 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-2378: -- Status: Patch Available (was: Open) macros don't accept references to items within tuples

Re: Unit test classpath trouble

2013-05-14 Thread Johnny Zhang
with -DdebugArgs=-XX:+CMSClassUnloadingEnabled -XX:MaxPermSize=128M Regards, Rohini On Mon, May 13, 2013 at 10:22 AM, Johnny Zhang xiao...@cloudera.com wrote: I run unit test against 2.0.4-alpha in the trunk. The tests hit OutOfMemoryError: PermGen space in the middle, but so far

Re: Unit test classpath trouble

2013-05-13 Thread Johnny Zhang
I run unit test against 2.0.4-alpha in the trunk. The tests hit OutOfMemoryError: PermGen space in the middle, but so far no failures or errors. I re-kicked off the test. Johnny On Fri, May 10, 2013 at 6:49 PM, Johnny Zhang xiao...@cloudera.com wrote: Hi, Andrew: I just set up a job to run

Re: Unit test classpath trouble

2013-05-10 Thread Johnny Zhang
Hi, Andrew: Does something like -Dhadoopversion=23 help ? eg. ant clean test -Dhadoopversion=23 -Dtest.junit.output.format=xml Johnny On Fri, May 10, 2013 at 3:39 AM, Andrew Purtell apurt...@apache.org wrote: Please pardon the basic question. I'm building Pig 0.11.2-SNAPSHOT against Hadoop

[jira] [Commented] (PIG-3279) Support nested RANK

2013-05-10 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13654834#comment-13654834 ] Johnny Zhang commented on PIG-3279: --- the exception seems happen between 'global rearrange

[jira] [Assigned] (PIG-3279) Support nested RANK

2013-05-10 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang reassigned PIG-3279: - Assignee: Johnny Zhang Support nested RANK --- Key: PIG

[jira] [Commented] (PIG-3316) Pig failed to interpret DateTime values in some special cases

2013-05-10 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13655069#comment-13655069 ] Johnny Zhang commented on PIG-3316: --- it is a little bit late :) but the unit tests

Re: Unit test classpath trouble

2013-05-10 Thread Johnny Zhang
Hi, Andrew: I just set up a job to run unit test against 2.0.4-alpha. I will investigate failure and reply to thread. Thanks, Johnny Zhang On Fri, May 10, 2013 at 6:19 PM, Andrew Purtell apurt...@apache.org wrote: I've tried that, thanks. I did a bit more investigation and it seems the issue

[jira] [Commented] (PIG-3316) Pig failed to interpret DateTime values in some special cases

2013-05-09 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13653389#comment-13653389 ] Johnny Zhang commented on PIG-3316: --- Xuefu, thanks for submit the patch, it looks good

[jira] [Created] (PIG-3314) make better symbol resolving order in Pig

2013-05-07 Thread Johnny Zhang (JIRA)
Johnny Zhang created PIG-3314: - Summary: make better symbol resolving order in Pig Key: PIG-3314 URL: https://issues.apache.org/jira/browse/PIG-3314 Project: Pig Issue Type: Improvement

[jira] [Updated] (PIG-3314) make better symbol resolving order in Pig

2013-05-07 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-3314: -- Description: this idea comes when we trying to resolve PIG-2248, please take a look the comments starts

Re: Review Request: PIG-3223 AvroStorage does not handle comma separated input paths

2013-05-03 Thread Johnny Zhang
://reviews.apache.org/r/10351/#review20127 --- On May 3, 2013, 12:33 a.m., Johnny Zhang wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/10351

Re: Review Request: PIG-3223 AvroStorage does not handle comma separated input paths

2013-05-03 Thread Johnny Zhang
/TestAvroStorage.java bd7a6d2 Diff: https://reviews.apache.org/r/10351/diff/ Testing --- added two more test cases in TestAvroStorage.java and they all pass Thanks, Johnny Zhang

[jira] [Updated] (PIG-3223) AvroStorage does not handle comma separated input paths

2013-05-03 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-3223: -- Attachment: PIG-3223.patch.txt latest patch addressed Rohini's comments in RB

[jira] [Commented] (PIG-2248) Pig parser does not detect when a macro name masks a UDF name

2013-05-03 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13648838#comment-13648838 ] Johnny Zhang commented on PIG-2248: --- Daniel, can you explain the term symbol resolving

[jira] [Updated] (PIG-3223) AvroStorage does not handle comma separated input paths

2013-05-03 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-3223: -- Attachment: PIG-3223.branch-0.11.patch.txt Rohini, thanks for your +1 on RB. Here is the patch

[jira] [Commented] (PIG-2248) Pig parser does not detect when a macro name masks a UDF name

2013-05-03 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13648863#comment-13648863 ] Johnny Zhang commented on PIG-2248: --- Daniel, this is a good idea, and in bigger picture. 3

[jira] [Commented] (PIG-3223) AvroStorage does not handle comma separated input paths

2013-05-02 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13647785#comment-13647785 ] Johnny Zhang commented on PIG-3223: --- [~viraj], thanks for your comments patch, my

Re: Welcome our newest committer Prashant Kommireddi

2013-05-02 Thread Johnny Zhang
Congrats Prashant! On Thu, May 2, 2013 at 1:17 PM, Bill Graham billgra...@gmail.com wrote: Congrats Prashant! On Thu, May 2, 2013 at 1:11 PM, Daniel Dai da...@hortonworks.com wrote: Congratulation! On Thu, May 2, 2013 at 1:06 PM, Cheolsoo Park piaozhe...@gmail.com wrote:

Re: Review Request: PIG-3223 AvroStorage does not handle comma separated input paths

2013-05-02 Thread Johnny Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/10351/#review19974 --- On April 8, 2013, 10:03 p.m., Johnny Zhang wrote

[jira] [Commented] (PIG-3223) AvroStorage does not handle comma separated input paths

2013-05-02 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13647938#comment-13647938 ] Johnny Zhang commented on PIG-3223: --- @Rohini and [~viraj], thanks for your comments. I

[jira] [Assigned] (PIG-3223) AvroStorage does not handle comma separated input paths

2013-05-02 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang reassigned PIG-3223: - Assignee: Johnny Zhang (was: Viraj Bhat) AvroStorage does not handle comma separated input

[jira] [Updated] (PIG-3223) AvroStorage does not handle comma separated input paths

2013-05-02 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-3223: -- Attachment: PIG-3223.patch.txt post the revised patch based on Rohini's comments, I also run

Re: Review Request: PIG-3223 AvroStorage does not handle comma separated input paths

2013-05-02 Thread Johnny Zhang
/avro/TestAvroStorage.java bd7a6d2 Diff: https://reviews.apache.org/r/10351/diff/ Testing --- added two more test cases in TestAvroStorage.java and they all pass Thanks, Johnny Zhang

Re: Review Request: PIG-3223 AvroStorage does not handle comma separated input paths

2013-05-02 Thread Johnny Zhang
/current/api/org/apache/hadoop/fs/FileSystem.html#globStatus(org.apache.hadoop.fs.Path). Found this method in pig which would take care of the logic - LoadFunc.getPathStrings() . Use this for splitting paths. This should simplify the whole change Johnny Zhang wrote

Re: Review Request: PIG-3223 AvroStorage does not handle comma separated input paths

2013-05-02 Thread Johnny Zhang
/ Testing --- added two more test cases in TestAvroStorage.java and they all pass Thanks, Johnny Zhang

[jira] [Updated] (PIG-3223) AvroStorage does not handle comma separated input paths

2013-05-02 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-3223: -- Attachment: PIG-3223.patch.txt AvroStorage does not handle comma separated input paths

[jira] [Commented] (PIG-3223) AvroStorage does not handle comma separated input paths

2013-05-02 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13648078#comment-13648078 ] Johnny Zhang commented on PIG-3223: --- [~rohini], could you please review the latest patch

[jira] [Updated] (PIG-2244) Macros cannot be passed relation names

2013-04-24 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-2244: -- Status: Patch Available (was: Open) Macros cannot be passed relation names

Re: Review Request: PIG-2248 Pig parser does not detect when a macro name masks a UDF name

2013-04-24 Thread Johnny Zhang
a builtin UDF org.apache.pig.builtin.ABS Thanks, Johnny Zhang

[jira] [Created] (PIG-3296) parallel running Pig unit tests

2013-04-24 Thread Johnny Zhang (JIRA)
Johnny Zhang created PIG-3296: - Summary: parallel running Pig unit tests Key: PIG-3296 URL: https://issues.apache.org/jira/browse/PIG-3296 Project: Pig Issue Type: Improvement Affects

Re: Put a Google summer of code 2013 cwiki page

2013-04-24 Thread Johnny Zhang
, 2013 at 12:00 PM, Daniel Dai da...@hortonworks.com wrote: Hi, Johnny, If you want to mentor this in GSoC, please create a Jira ticket and label it gsoc2013. Thanks, Daniel On Tue, Mar 26, 2013 at 1:40 PM, Johnny Zhang xiao...@cloudera.com wrote: I have another idea for GSoC

[jira] [Created] (PIG-3290) TestLogicalPlanBuilder.testQuery85 fail in trunk

2013-04-23 Thread Johnny Zhang (JIRA)
Johnny Zhang created PIG-3290: - Summary: TestLogicalPlanBuilder.testQuery85 fail in trunk Key: PIG-3290 URL: https://issues.apache.org/jira/browse/PIG-3290 Project: Pig Issue Type: Bug

[jira] [Updated] (PIG-2248) Pig parser does not detect when a macro name masks a UDF name

2013-04-22 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-2248: -- Attachment: PIG-2248.patch.txt Pig parser does not detect when a macro name masks a UDF name

[jira] [Commented] (PIG-2248) Pig parser does not detect when a macro name masks a UDF name

2013-04-22 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638642#comment-13638642 ] Johnny Zhang commented on PIG-2248: --- Daniel, appreciate your time to try out the patch. My

[jira] [Updated] (PIG-2244) Macros cannot be passed relation names

2013-04-22 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-2244: -- Status: Open (was: Patch Available) Daniel, thanks a lot for review the patch. I will try to fix PIG

[jira] [Commented] (PIG-2378) macros don't accept references to items within tuples as arguments

2013-04-22 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638711#comment-13638711 ] Johnny Zhang commented on PIG-2378: --- the work around throw casting exception in trunk

[jira] [Updated] (PIG-3279) Support nested RANK

2013-04-19 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-3279: -- Attachment: PIG-3279-1.patch.txt Support nested RANK --- Key

[jira] [Commented] (PIG-3279) Support nested RANK

2013-04-19 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13636900#comment-13636900 ] Johnny Zhang commented on PIG-3279: --- Thanks Gianmarco open the jira. The current patch

Re: Question on Join algorithms in PIG

2013-04-17 Thread Johnny Zhang
Hi, Yunming: Beside three implementation you mentioned, there is also the default join, which needs map and reduce phase. replicated join doesn't require data sets to be sorted. You just need to make sure second input is the smaller input. These two classes are related to merged join: 1.

[jira] [Commented] (PIG-2244) Macros cannot be passed relation names

2013-04-12 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13630593#comment-13630593 ] Johnny Zhang commented on PIG-2244: --- couple comments on this patch 1. the PigMacro.java

Review Request: PIG-2248 Pig parser does not detect when a macro name masks a UDF name

2013-04-12 Thread Johnny Zhang
[main] WARN org.apache.pig.parser.PigMacro - macro name 'COUNT' masks a builtin UDF org.apache.pig.builtin.COUNT [main] WARN org.apache.pig.parser.PigMacro - macro name 'ABS' masks a builtin UDF org.apache.pig.builtin.ABS Thanks, Johnny Zhang

[jira] [Updated] (PIG-2244) Macros cannot be passed relation names

2013-04-10 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-2244: -- Attachment: PIG-2244.patch.txt Macros cannot be passed relation names

[jira] [Updated] (PIG-2244) Macros cannot be passed relation names

2013-04-10 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-2244: -- Attachment: PIG-2244.patch.txt with the latest patch, the dry run will fail with the error message

[jira] [Updated] (PIG-2244) Macros cannot be passed relation names

2013-04-10 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-2244: -- Status: Patch Available (was: Open) Macros cannot be passed relation names

Review Request: PIG-3223 AvroStorage does not handle comma separated input paths

2013-04-08 Thread Johnny Zhang
in TestAvroStorage.java and they all pass Thanks, Johnny Zhang

[jira] [Updated] (PIG-2248) Pig parser does not detect when a macro name masks a UDF name

2013-04-05 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-2248: -- Attachment: PIG-2248.patch.txt Pig parser does not detect when a macro name masks a UDF name

[jira] [Updated] (PIG-2248) Pig parser does not detect when a macro name masks a UDF name

2013-04-05 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-2248: -- Status: Patch Available (was: Open) with this patch, the Pig will throw warning message when macro has

[jira] [Assigned] (PIG-2248) Pig parser does not detect when a macro name masks a UDF name

2013-04-05 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang reassigned PIG-2248: - Assignee: Johnny Zhang Pig parser does not detect when a macro name masks a UDF name

[jira] [Updated] (PIG-2248) Pig parser does not detect when a macro name masks a UDF name

2013-04-05 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-2248: -- Status: Open (was: Patch Available) [~prkommireddi], thanks a lot for review my patch. I will post

[jira] [Assigned] (PIG-3049) Cannot sort on a bag in nested foreach

2013-04-05 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang reassigned PIG-3049: - Assignee: (was: Johnny Zhang) Cannot sort on a bag in nested foreach

[jira] [Updated] (PIG-2248) Pig parser does not detect when a macro name masks a UDF name

2013-04-05 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-2248: -- Attachment: PIG-2248.patch.txt Pig parser does not detect when a macro name masks a UDF name

[jira] [Updated] (PIG-2248) Pig parser does not detect when a macro name masks a UDF name

2013-04-05 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-2248: -- Status: Patch Available (was: Open) [~prkommireddi], here is the polished patch address the comments

[jira] [Updated] (PIG-2248) Pig parser does not detect when a macro name masks a UDF name

2013-04-05 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-2248: -- Attachment: PIG-2248.patch.txt new patch fix the indention Pig parser does not detect

[jira] [Updated] (PIG-2244) Macros cannot be passed relation names

2013-04-05 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-2244: -- Status: Open (was: Patch Available) Macros cannot be passed relation names

[jira] [Commented] (PIG-2265) Test case TestSecondarySort failure

2013-04-05 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13624269#comment-13624269 ] Johnny Zhang commented on PIG-2265: --- Thanks for doing this, Daniel! I think

[jira] [Commented] (PIG-2247) Pig parser does not detect multiple arguments with the same name passed to macro

2013-04-03 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13621457#comment-13621457 ] Johnny Zhang commented on PIG-2247: --- thank you so much for reviewing my patch, Daniel

[jira] [Commented] (PIG-2244) Macros cannot be passed relation names

2013-04-03 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13621770#comment-13621770 ] Johnny Zhang commented on PIG-2244: --- Thanks for the comments, Daniel! Right now the error

Re: Pig 0.10 on YARN

2013-03-29 Thread Johnny Zhang
Hi, cos: I met the same problem before. Can you try below in your Bigtop pig maven execution .pom ? It will actually resolve other problem as well (for example, you may see Pig cannot get kerberos principle in secure YARN cluster) dependencies dependency

[jira] [Updated] (PIG-2247) Pig parser does not detect multiple arguments with the same name passed to macro

2013-03-28 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-2247: -- Attachment: PIG-2247.patch.txt Pig parser does not detect multiple arguments with the same name

[jira] [Updated] (PIG-2247) Pig parser does not detect multiple arguments with the same name passed to macro

2013-03-28 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-2247: -- Status: Patch Available (was: Open) Hey, [~alangates], I fix this issue by adding detecting logic when

[jira] [Assigned] (PIG-2247) Pig parser does not detect multiple arguments with the same name passed to macro

2013-03-28 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang reassigned PIG-2247: - Assignee: Johnny Zhang Pig parser does not detect multiple arguments with the same name

[jira] [Commented] (PIG-3223) AvroStorage does not handle comma separated input paths

2013-03-27 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13616066#comment-13616066 ] Johnny Zhang commented on PIG-3223: --- [~prkommireddi], sorry I don't know why globbing

[jira] [Updated] (PIG-2244) Macros cannot be passed relation names

2013-03-26 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-2244: -- Attachment: PIG-2244.patch.txt Macros cannot be passed relation names

[jira] [Updated] (PIG-2244) Macros cannot be passed relation names

2013-03-26 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-2244: -- Status: Patch Available (was: Open) [~alangates], I fix the antlr grammar file so that it be able

[jira] [Assigned] (PIG-2244) Macros cannot be passed relation names

2013-03-26 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang reassigned PIG-2244: - Assignee: Johnny Zhang Macros cannot be passed relation names

Re: Put a Google summer of code 2013 cwiki page

2013-03-26 Thread Johnny Zhang
I have another idea for GSoC project: parallel running the unit tests. I think several people mentioned this in last Pig meetup. The objective is enabling us to run whole unit tests before commit any patch. The fix should include two parts: (1) unit test doesn't interferes each other (e.g. moving

[jira] [Commented] (PIG-2265) Test case TestSecondarySort failure

2013-03-26 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13614734#comment-13614734 ] Johnny Zhang commented on PIG-2265: --- current the test is disabled in trunk. I enable

[jira] [Commented] (PIG-2378) macros don't accept references to items within tuples as arguments

2013-03-23 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13611989#comment-13611989 ] Johnny Zhang commented on PIG-2378: --- I think it is not a bug, using {noformat} B

[jira] [Assigned] (PIG-2378) macros don't accept references to items within tuples as arguments

2013-03-23 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang reassigned PIG-2378: - Assignee: Johnny Zhang macros don't accept references to items within tuples as arguments

  1   2   >