[ https://issues.apache.org/jira/browse/PIG-2693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13276238#comment-13276238 ]
Travis Crawford commented on PIG-2693: -------------------------------------- This patch is causing the issue: https://github.com/apache/pig/commit/d49f903e0d041ce7d9e8e2d0a9066cd666f99da7 Looking into what's changed. {code} commit d49f903e0d041ce7d9e8e2d0a9066cd666f99da7 Author: Dmitriy V. Ryaboy <dvrya...@apache.org> Date: Fri Apr 27 23:34:03 2012 +0000 PIG-2652: Skew join and order by dont trigger reducer estimation (dvryaboy) git-svn-id: https://svn.apache.org/repos/asf/pig/trunk@1331637 13f79535-47bb-0310-9956-ffa450edef68 {code} > LoadFunc.setLocation should be called before LoadMetadata.getStatistics > ------------------------------------------------------------------------ > > Key: PIG-2693 > URL: https://issues.apache.org/jira/browse/PIG-2693 > Project: Pig > Issue Type: Bug > Reporter: Bill Graham > Assignee: Bill Graham > Attachments: PIG-2693.1.patch > > > We ran into a bug with Pig/HCatalog integration on the trunk. The issue is > that {{JobControlCompiler}} calls the {{adjustNumReducers}} method just > before it calls {{setLocation}} on all of the {{LoadFuncs}}. This causes > problems, since some loaders (i.e., {{HCatLoader}}) need {{setLocation}} to > be called before it can respond to {{getStatistics}} with it's data size. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira