[ 
https://issues.apache.org/jira/browse/PIG-2693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13276238#comment-13276238
 ] 

Travis Crawford commented on PIG-2693:
--------------------------------------

This patch is causing the issue: 

https://github.com/apache/pig/commit/d49f903e0d041ce7d9e8e2d0a9066cd666f99da7

Looking into what's changed.

{code}
commit d49f903e0d041ce7d9e8e2d0a9066cd666f99da7
Author: Dmitriy V. Ryaboy <dvrya...@apache.org>
Date:   Fri Apr 27 23:34:03 2012 +0000

    PIG-2652:  Skew join and order by dont trigger reducer estimation (dvryaboy)
    
    git-svn-id: https://svn.apache.org/repos/asf/pig/trunk@1331637 
13f79535-47bb-0310-9956-ffa450edef68
{code}
                
> LoadFunc.setLocation should be called before LoadMetadata.getStatistics 
> ------------------------------------------------------------------------
>
>                 Key: PIG-2693
>                 URL: https://issues.apache.org/jira/browse/PIG-2693
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Bill Graham
>            Assignee: Bill Graham
>         Attachments: PIG-2693.1.patch
>
>
> We ran into a bug with Pig/HCatalog integration on the trunk. The issue is 
> that {{JobControlCompiler}} calls the {{adjustNumReducers}} method just 
> before it calls {{setLocation}} on all of the {{LoadFuncs}}. This causes 
> problems, since some loaders (i.e.,  {{HCatLoader}}) need {{setLocation}} to 
> be called before it can respond to {{getStatistics}} with it's data size.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to