Custom partitioner not set when POSplit is involved in Plan
-----------------------------------------------------------

                 Key: PIG-2627
                 URL: https://issues.apache.org/jira/browse/PIG-2627
             Project: Pig
          Issue Type: Bug
    Affects Versions: 0.9.2, 0.10
            Reporter: Vivek Padmanabhan



{code}
A = load 'i3.txt' as (k,v);
L = FILTER A BY k == 'k1';
B = GROUP A BY k PARTITION BY SimpleCustomPartitioner PARALLEL 3;
C = FOREACH B GENERATE FLATTEN(A) PARALLEL 3;
STORE C INTO 'output1';
STORE L INTO 'output2';
{code}

For the above script the custom partitioner mentioned in the GROUP BY statement 
is ignored by Pig.
To workaround this issue I had to disable Multiquery or put exec statements in 
between.

The configuration is getting missed out while the Physical plan is getting 
converted into the MR plan.
(Note the POGlobalRearrange is visited on a different MROper than what the 
actual MRPlan returns)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to