[jira] Assigned: (PIG-1321) Logical Optimizer: Merge cascading foreach

[ https://issues.apache.org/jira/browse/PIG-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai reassigned PIG-1321: --- Assignee: Xuefu Zhang (was: Daniel Dai) > Logical Optimizer: Merge cascading foreach > ---

[jira] Commented: (PIG-1405) Need to move many standard functions from piggybank into Pig

[ https://issues.apache.org/jira/browse/PIG-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12880965#action_12880965 ] Hadoop QA commented on PIG-1405: -1 overall. Here are the results of testing the latest atta

[jira] Assigned: (PIG-1399) Logical Optimizer: Expression optimizor rule

[ https://issues.apache.org/jira/browse/PIG-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai reassigned PIG-1399: --- Assignee: Yan Zhou > Logical Optimizer: Expression optimizor rule > ---

Re: skew join in pig

Thanks Dmitriy. I didn't see any performance issue yet. I ask this for a comparison of skew joins strategies. I would like to share something after I get more ideas. Thanks, -Gang - 原始邮件 发件人： Dmitriy Ryaboy 收件人： pig-dev@hadoop.apache.org 发送日期： 2010/6/21 (周一) 12:36:36 下午 主 题： Re:

[jira] Updated: (PIG-1453) [zebra] Intermittent failure for TestOrderPreserveUnionHDFS

[ https://issues.apache.org/jira/browse/PIG-1453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yan Zhou updated PIG-1453: -- Status: Patch Available (was: Open) > [zebra] Intermittent failure for TestOrderPreserveUnionHDFS >

[jira] Updated: (PIG-1453) [zebra] Intermittent failure for TestOrderPreserveUnionHDFS

[ https://issues.apache.org/jira/browse/PIG-1453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yan Zhou updated PIG-1453: -- Status: Open (was: Patch Available) > [zebra] Intermittent failure for TestOrderPreserveUnionHDFS >

[jira] Commented: (PIG-1334) Make pig artifacts available through maven

[ https://issues.apache.org/jira/browse/PIG-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12880938#action_12880938 ] Olga Natkovich commented on PIG-1334: - We need to look at how this is done by hadoop. bui

[jira] Assigned: (PIG-1334) Make pig artifacts available through maven

[ https://issues.apache.org/jira/browse/PIG-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich reassigned PIG-1334: --- Assignee: niraj rai > Make pig artifacts available through maven >

[jira] Updated: (PIG-1451) [zebra] change the build.test property in build to test.build.dir to be in consistent with PIG

[ https://issues.apache.org/jira/browse/PIG-1451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yan Zhou updated PIG-1451: -- Status: Resolved (was: Patch Available) Resolution: Fixed The "contrib test" failure is due to the commi

[jira] Updated: (PIG-1405) Need to move many standard functions from piggybank into Pig

[ https://issues.apache.org/jira/browse/PIG-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Mokashi updated PIG-1405: Status: Patch Available (was: Open) > Need to move many standard functions from piggybank into Pig >

[jira] Updated: (PIG-1405) Need to move many standard functions from piggybank into Pig

[ https://issues.apache.org/jira/browse/PIG-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Mokashi updated PIG-1405: Attachment: StandardUDFtoPigFinale.patch Reviewed all comments for all the files. Made required chang

[jira] Updated: (PIG-1405) Need to move many standard functions from piggybank into Pig

[ https://issues.apache.org/jira/browse/PIG-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Mokashi updated PIG-1405: Status: Open (was: Patch Available) > Need to move many standard functions from piggybank into Pig >

Re: skew join in pig

It's just whatever the hash function happens to do. By the time the "hot" keys are slotted to be spread among multiple reducers, they are no longer hot, so it doesn't matter if you put a few of the partitions in the same reducer. Remember, we mostly care about things we have to keep in memory. Sinc

[jira] Commented: (PIG-1427) Monitor and kill runaway UDFs

[ https://issues.apache.org/jira/browse/PIG-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12880881#action_12880881 ] Ashutosh Chauhan commented on PIG-1427: --- It seems you missed out ivy.xml bits in the la

Re: skew join in pig

OK. I konw how many reducers to allocate for one hot key. But how will the reducers allocated for key1 overlap the reducers for key2? Say key1 needs 3 reducers and is allocated reducer 0, 1, 2. Key2 needs 4 reducers, can we allocate reducers 0, 1, 2, 3 for key2? Or 3, 4, 5, 6? What is the ideas

[jira] Commented: (PIG-1034) Pig does not support ORDER ... BY group alias

[ https://issues.apache.org/jira/browse/PIG-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12880808#action_12880808 ] Hadoop QA commented on PIG-1034: -1 overall. Here are the results of testing the latest atta

[jira] Updated: (PIG-1034) Pig does not support ORDER ... BY group alias

[ https://issues.apache.org/jira/browse/PIG-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1034: Attachment: PIG_1034.patch Attach the patch > Pig does not support ORDER ... BY group alias > --

[jira] Updated: (PIG-1034) Pig does not support ORDER ... BY group alias

[ https://issues.apache.org/jira/browse/PIG-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1034: Status: Patch Available (was: Open) Affects Version/s: 0.8.0 Fix Version/s: 0.8.0 > P