[jira] [Commented] (PIG-2652) Skew join and order by don't trigger reducer estimation

2012-04-15 Thread Daniel Dai (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13254296#comment-13254296 ] Daniel Dai commented on PIG-2652: - In which context do you see the issue stated in the Jira?

[jira] [Commented] (PIG-2652) Skew join and order by don't trigger reducer estimation

2012-04-15 Thread Dmitriy V. Ryaboy (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13254361#comment-13254361 ] Dmitriy V. Ryaboy commented on PIG-2652: Rolled back for 0.9.3 and 0.10. Thanks for

[jira] [Commented] (PIG-2652) Skew join and order by don't trigger reducer estimation

2012-04-15 Thread Dmitriy V. Ryaboy (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13254388#comment-13254388 ] Dmitriy V. Ryaboy commented on PIG-2652: Ok, I have a test case. Estimation isn't

[jira] [Commented] (PIG-2652) Skew join and order by don't trigger reducer estimation

2012-04-15 Thread Bill Graham (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13254394#comment-13254394 ] Bill Graham commented on PIG-2652: -- I was able to reproduce with a similar script that

[jira] [Commented] (PIG-2652) Skew join and order by don't trigger reducer estimation

2012-04-15 Thread Bill Graham (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13254397#comment-13254397 ] Bill Graham commented on PIG-2652: -- FYI, here's my script that reproduces with an initial

[jira] [Created] (PIG-2654) LoadFunc and StoreFunc implementations should be instanciated only once in the FE and once in the BE per call in a given script

2012-04-15 Thread Julien Le Dem (Created) (JIRA)
LoadFunc and StoreFunc implementations should be instanciated only once in the FE and once in the BE per call in a given script --- Key: PIG-2654

[jira] [Commented] (PIG-2653) Precompile option in PIG (Ability to store the plan for queries which are run multiple times)

2012-04-15 Thread Julien Le Dem (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13254401#comment-13254401 ] Julien Le Dem commented on PIG-2653: This is a good idea. It would also be nice if It

[jira] [Commented] (PIG-2653) Precompile option in PIG (Ability to store the plan for queries which are run multiple times)

2012-04-15 Thread Ashutosh Chauhan (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13254408#comment-13254408 ] Ashutosh Chauhan commented on PIG-2653: --- One technique which is used in some databases

[jira] [Commented] (PIG-2652) Skew join and order by don't trigger reducer estimation

2012-04-15 Thread Dmitriy V. Ryaboy (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13254431#comment-13254431 ] Dmitriy V. Ryaboy commented on PIG-2652: Looks like the third rule isn't correct

[jira] [Updated] (PIG-2652) Skew join and order by don't trigger reducer estimation

2012-04-15 Thread Daniel Dai (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2652: Attachment: PIG-2652_2.patch I agree SampleOptimizer did more than it suppose to be, better to separate into

[jira] [Commented] (PIG-2653) Precompile option in PIG (Ability to store the plan for queries which are run multiple times)

2012-04-15 Thread Dmitriy V. Ryaboy (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13254455#comment-13254455 ] Dmitriy V. Ryaboy commented on PIG-2653: Reusing the physical plan is going to be a

[jira] [Updated] (PIG-2652) Skew join and order by don't trigger reducer estimation

2012-04-15 Thread Daniel Dai (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2652: Attachment: PIG-2652_3.patch SampleOptimizer is not a good place to do #reducer adjust. It is done once

[jira] [Reopened] (PIG-2652) Skew join and order by don't trigger reducer estimation

2012-04-15 Thread Dmitriy V. Ryaboy (Reopened) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy reopened PIG-2652: oh yeah.. we should reopen this :) Skew join and order by don't trigger

[jira] [Commented] (PIG-2652) Skew join and order by don't trigger reducer estimation

2012-04-15 Thread Dmitriy V. Ryaboy (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13254471#comment-13254471 ] Dmitriy V. Ryaboy commented on PIG-2652: Awesome, Daniel, thanks. This last version

[jira] [Updated] (PIG-2652) Skew join and order by don't trigger reducer estimation

2012-04-15 Thread Daniel Dai (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2652: Attachment: PIG-2652_3_10.patch The same patch for 0.10 branch. One side affect is explain will see

[jira] [Updated] (PIG-2574) Make reducer estimator plugable

2012-04-15 Thread Bill Graham (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Graham updated PIG-2574: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk.