[jira] [Commented] (PIG-2706) Add clear to list of grunt commands

2012-05-30 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13285438#comment-13285438 ] Prashant Kommireddi commented on PIG-2706: -- Hi Allan, patch looks good for the most

[jira] [Updated] (PIG-2706) Add clear to list of grunt commands

2012-05-30 Thread JIRA
[ https://issues.apache.org/jira/browse/PIG-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Avendaño updated PIG-2706: Attachment: PIG-2706-3 Thanks for the review. Minor changes done. Add clear to

[jira] [Assigned] (PIG-2706) Add clear to list of grunt commands

2012-05-30 Thread JIRA
[ https://issues.apache.org/jira/browse/PIG-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Avendaño reassigned PIG-2706: --- Assignee: Allan Avendaño Add clear to list of grunt commands

[jira] [Commented] (PIG-2706) Add clear to list of grunt commands

2012-05-30 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13285450#comment-13285450 ] Prashant Kommireddi commented on PIG-2706: -- A minor one again, indentation is off a

[jira] [Updated] (PIG-2721) Wrong output generated while loading bags as input

2012-05-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2721: Resolution: Fixed Fix Version/s: 0.10.1 0.11 Hadoop Flags: Reviewed

[jira] [Commented] (PIG-798) Schema errors when using PigStorage and none when using BinStorage in FOREACH??

2012-05-30 Thread Subir S (JIRA)
[ https://issues.apache.org/jira/browse/PIG-798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13285456#comment-13285456 ] Subir S commented on PIG-798: - Shouldn't the documentation

Build failed in Jenkins: Pig-trunk #1254

2012-05-30 Thread Apache Jenkins Server
See https://builds.apache.org/job/Pig-trunk/1254/changes Changes: [daijy] PIG-2721: Wrong output generated while loading bags as input [dvryaboy] PIG-2727: PigStorage Source tagging does not need pig.splitCombination to be turned off -- [...truncated

[jira] [Commented] (PIG-2279) Error when using PigUnit on a script that uses IMPORT another script with macros

2012-05-30 Thread Juan Gentile (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13285624#comment-13285624 ] Juan Gentile commented on PIG-2279: --- Hi Mark, yes please, it'd be useful. Thank you!!

[jira] [Created] (PIG-2729) Macro expansion does not use pig.import.search.path - UnitTest borked

2012-05-30 Thread Johannes Schwenk (JIRA)
Johannes Schwenk created PIG-2729: - Summary: Macro expansion does not use pig.import.search.path - UnitTest borked Key: PIG-2729 URL: https://issues.apache.org/jira/browse/PIG-2729 Project: Pig

[jira] [Commented] (PIG-366) PigPen - Eclipse plugin for a graphical PigLatin editor

2012-05-30 Thread Sheejo (JIRA)
[ https://issues.apache.org/jira/browse/PIG-366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13285717#comment-13285717 ] Sheejo commented on PIG-366: Hi Everyone, If you have any Documentation regarding the Eclipse

Re: CUBE/ROLLUP/GROUPING SETS syntax

2012-05-30 Thread Alan Gates
Some thoughts on this: 1) +1 to what Dmitriy said on HAVING 2) We need to be clear about separating operators in the grammar versus logical plan versus physical plan. The choices you make in the grammar are totally independent of the other two. That is, you could choose the syntax: rel =

[jira] [Created] (PIG-2730) TFileStorage getStatistics incorrectly throws an exception instead of returning null

2012-05-30 Thread Travis Crawford (JIRA)
Travis Crawford created PIG-2730: Summary: TFileStorage getStatistics incorrectly throws an exception instead of returning null Key: PIG-2730 URL: https://issues.apache.org/jira/browse/PIG-2730

Re: CUBE/ROLLUP/GROUPING SETS syntax

2012-05-30 Thread Jonathan Coveney
I was going to say the same thing Alan said w.r.t. operators: operators in the grammar can correspond to whatever logical and physical operators you want. As far as the principle of least astonishment compared to SQL... Pig is already pretty astonishing. I don't know why we would bend over

[jira] [Commented] (PIG-2166) UDFs to join a bag

2012-05-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13285866#comment-13285866 ] Daniel Dai commented on PIG-2166: - Hi, Hien, Patch looks good. For BagToString, it is better

[jira] [Updated] (PIG-2173) piggybank datetime conversion javadocs not properly formatted

2012-05-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2173: Resolution: Fixed Fix Version/s: 0.11 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Commented] (PIG-2728) Grunt shell automagically sets number of reducers and doesn't allow you to override it

2012-05-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13285887#comment-13285887 ] Daniel Dai commented on PIG-2728: - There is typo in DEFAULT_PARALLELISM, should be: set

[jira] [Commented] (PIG-2724) Make Tuple Iterable

2012-05-30 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13285888#comment-13285888 ] Julien Le Dem commented on PIG-2724: Good idea Jon. Some minor comments: * chain the

[jira] [Updated] (PIG-2690) Pig Documentation regarding Merge Join is confusing

2012-05-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2690: Resolution: Not A Problem Status: Resolved (was: Patch Available) Pig Documentation regarding

[jira] [Commented] (PIG-2706) Add clear to list of grunt commands

2012-05-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13285922#comment-13285922 ] Daniel Dai commented on PIG-2706: - Can we also find a way for Windows?

[jira] [Commented] (PIG-2730) TFileStorage getStatistics incorrectly throws an exception instead of returning null

2012-05-30 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13285978#comment-13285978 ] Dmitriy V. Ryaboy commented on PIG-2730: Yep, implementation is wrong. Travis, can

[jira] [Commented] (PIG-798) Schema errors when using PigStorage and none when using BinStorage in FOREACH??

2012-05-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13286003#comment-13286003 ] Daniel Dai commented on PIG-798: Yes, we are actually want to fix it, see PIG-2315.

[jira] [Commented] (PIG-2279) Error when using PigUnit on a script that uses IMPORT another script with macros

2012-05-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13286007#comment-13286007 ] Daniel Dai commented on PIG-2279: - Mark, can you post the patch on Jira?

Re: CUBE/ROLLUP/GROUPING SETS syntax

2012-05-30 Thread Alan Gates
On May 30, 2012, at 10:43 AM, Jonathan Coveney wrote: I was going to say the same thing Alan said w.r.t. operators: operators in the grammar can correspond to whatever logical and physical operators you want. As far as the principle of least astonishment compared to SQL... Pig is already

[jira] [Created] (PIG-2731) remove deprecated methods isNull() and setNull(boolean) from Tuple

2012-05-30 Thread Julien Le Dem (JIRA)
Julien Le Dem created PIG-2731: -- Summary: remove deprecated methods isNull() and setNull(boolean) from Tuple Key: PIG-2731 URL: https://issues.apache.org/jira/browse/PIG-2731 Project: Pig

[jira] [Updated] (PIG-2731) remove deprecated methods isNull() and setNull(boolean) from Tuple

2012-05-30 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-2731: --- Hadoop Flags: Incompatible change remove deprecated methods isNull() and setNull(boolean) from

[jira] [Updated] (PIG-2731) remove deprecated methods isNull() and setNull(boolean) from Tuple

2012-05-30 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-2731: --- Hadoop Flags: (was: Incompatible change) remove deprecated methods isNull() and

[jira] [Commented] (PIG-2730) TFileStorage getStatistics incorrectly throws an exception instead of returning null

2012-05-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13286057#comment-13286057 ] Daniel Dai commented on PIG-2730: - Yes, similar to BinStorage, should return null instead.

[jira] [Updated] (PIG-2724) Make Tuple Iterable

2012-05-30 Thread Jonathan Coveney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-2724: -- Attachment: PIG-2724-1.patch Oh wow, not chaining the exception was pure typo. Lame. Thanks for

[jira] [Updated] (PIG-2724) Make Tuple Iterable

2012-05-30 Thread Jonathan Coveney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-2724: -- Attachment: PIG-2724-1.patch Make Tuple Iterable ---

[jira] [Created] (PIG-2732) Let's get rid of the deprecated Tuple methods

2012-05-30 Thread Jonathan Coveney (JIRA)
Jonathan Coveney created PIG-2732: - Summary: Let's get rid of the deprecated Tuple methods Key: PIG-2732 URL: https://issues.apache.org/jira/browse/PIG-2732 Project: Pig Issue Type:

[jira] [Assigned] (PIG-2732) Let's get rid of the deprecated Tuple methods

2012-05-30 Thread Jonathan Coveney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney reassigned PIG-2732: - Assignee: Jonathan Coveney Let's get rid of the deprecated Tuple methods

Build failed in Jenkins: Pig-trunk #1255

2012-05-30 Thread Apache Jenkins Server
See https://builds.apache.org/job/Pig-trunk/1255/changes Changes: [daijy] PIG-2173: piggybank datetime conversion javadocs not properly formatted -- [...truncated 6338 lines...] [findbugs] org.python.core.PyCode [findbugs] com.jcraft.jsch.HostKey

[jira] [Updated] (PIG-2732) Let's get rid of the deprecated Tuple methods

2012-05-30 Thread Jonathan Coveney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-2732: -- Status: Patch Available (was: Open) Here 'tis Let's get rid of the deprecated

[jira] [Updated] (PIG-2732) Let's get rid of the deprecated Tuple methods

2012-05-30 Thread Jonathan Coveney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-2732: -- Attachment: PIG-2732-0.patch Let's get rid of the deprecated Tuple methods

[jira] [Updated] (PIG-2730) TFileStorage getStatistics incorrectly throws an exception instead of returning null

2012-05-30 Thread Travis Crawford (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Crawford updated PIG-2730: - Attachment: PIG-2730.1.patch TFileStorage getStatistics incorrectly throws an exception

[jira] [Updated] (PIG-2730) TFileStorage getStatistics incorrectly throws an exception instead of returning null

2012-05-30 Thread Travis Crawford (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Crawford updated PIG-2730: - Status: Patch Available (was: Open) TFileStorage getStatistics incorrectly throws an

[jira] [Updated] (PIG-2717) Tuple field mangled during flattening

2012-05-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2717: Attachment: PIG-2717-2.patch Fix a unit test failure. Tuple field mangled during

[jira] [Resolved] (PIG-2717) Tuple field mangled during flattening

2012-05-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-2717. - Resolution: Fixed Hadoop Flags: Reviewed Patch committed to 0.10/trunk. Tuple

[jira] [Updated] (PIG-2730) TFileStorage getStatistics incorrectly throws an exception instead of returning null

2012-05-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2730: Resolution: Fixed Fix Version/s: 0.10.1 0.11 Hadoop Flags: Reviewed

[jira] [Commented] (PIG-2724) Make Tuple Iterable

2012-05-30 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13286177#comment-13286177 ] Julien Le Dem commented on PIG-2724: Thanks Jonathan. Overall, this looks good. Some

[jira] [Commented] (PIG-2724) Make Tuple Iterable

2012-05-30 Thread Jonathan Coveney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13286183#comment-13286183 ] Jonathan Coveney commented on PIG-2724: --- - Thanks for the heads up on the javadoc -

[jira] [Updated] (PIG-2724) Make Tuple Iterable

2012-05-30 Thread Jonathan Coveney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-2724: -- Attachment: PIG-2724-2.patch Make Tuple Iterable ---

[jira] [Resolved] (PIG-2731) remove deprecated methods isNull() and setNull(boolean) from Tuple

2012-05-30 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem resolved PIG-2731. Resolution: Duplicate remove deprecated methods isNull() and setNull(boolean) from Tuple

[jira] [Commented] (PIG-2732) Let's get rid of the deprecated Tuple methods

2012-05-30 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13286205#comment-13286205 ] Julien Le Dem commented on PIG-2732: +1 it's been deprecated in the previous version of

Re: CUBE/ROLLUP/GROUPING SETS syntax

2012-05-30 Thread Prasanth J
Thanks Alan and Jon for expressing your views. I agree with Jon's point, if the syntax contains CUBE then user expects it to perform CUBE operation. So Jon's syntax seems more meaningful and concise rel = CUBE rel BY (dims); rel = ROLLUP rel BY (dims); rel = GROUPING_SET rel BY (dims); 2

[jira] [Commented] (PIG-2724) Make Tuple Iterable

2012-05-30 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13286220#comment-13286220 ] Julien Le Dem commented on PIG-2724: * np * You are correct but your argument for

Re: CUBE/ROLLUP/GROUPING SETS syntax

2012-05-30 Thread Jonathan Coveney
As far as the underlying implementation, if they all use the same optimizations that you use in cube, then it can be LOCube. If they have their own optimizations etc (or could), it may be worth them having their own Logical operators (which might just be LOCube with flags for the time being) that

[jira] [Commented] (PIG-2724) Make Tuple Iterable

2012-05-30 Thread Jonathan Coveney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13286222#comment-13286222 ] Jonathan Coveney commented on PIG-2724: --- I care not about the AbstractTypeAwareTuple,

[jira] [Updated] (PIG-2724) Make Tuple Iterable

2012-05-30 Thread Jonathan Coveney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-2724: -- Attachment: PIG-2724-3.patch This removes AbstractTypeAwareTuple, though it doesn't change the

Fwd: [jira] [Commented] (PIG-2732) Let's get rid of the deprecated Tuple methods

2012-05-30 Thread Jonathan Coveney
I'm pinging dev directly because I am afraid this won't get any eyes otherwise. Also, because there is a bigger issue here: what should our policy on removing deprecated methods be? reference(Tuple), I'm looking at you. -- Forwarded message -- From: Julien Le Dem (JIRA)

Re: [jira] [Commented] (PIG-2732) Let's get rid of the deprecated Tuple methods

2012-05-30 Thread Alan Gates
Officially our policy is deprecated methods can be removed after they have been deprecated for at least one release. Unofficially we've tended to follow the path of least resistance and only remove deprecated things when we had a reason. This approach seems reasonable to me, as it inflicts

Re: [jira] [Commented] (PIG-2732) Let's get rid of the deprecated Tuple methods

2012-05-30 Thread Jonathan Coveney
The reason in my case is that I started implementing a non-trivial Tuple implementation, and it feels really janky to me to have this sort of tribal knowledge that oh, it's ok to do nothing in this method, or it's ok to return null here. It just muddies up the Tuple contract... should my

[jira] [Commented] (PIG-2166) UDFs to join a bag

2012-05-30 Thread Hien Luu (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13286311#comment-13286311 ] Hien Luu commented on PIG-2166: --- I ran in a problem when trying to generate test data using

[jira] [Commented] (PIG-2638) Optimize BinInterSedes treatment of longs

2012-05-30 Thread Bill Graham (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13286316#comment-13286316 ] Bill Graham commented on PIG-2638: -- +1 Looks good to me. Optimize

[jira] [Commented] (PIG-2166) UDFs to join a bag

2012-05-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13286317#comment-13286317 ] Daniel Dai commented on PIG-2166: - You need to install IPC::Run module. I usually download

[jira] [Commented] (PIG-2638) Optimize BinInterSedes treatment of longs

2012-05-30 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13286345#comment-13286345 ] Ashutosh Chauhan commented on PIG-2638: --- Another option is to use VInts and its