PIG Logical Optimization: Use CNF in FilterAboveForeach -------------------------------------------------------
Key: PIG-1532 URL: https://issues.apache.org/jira/browse/PIG-1532 Project: Pig Issue Type: Bug Components: impl Reporter: Swati Jain Priority: Minor Consider the following program, ( g1-4 < 348 ) predicate should be pushed above LOForeach. This would be possible if we convert the filter expression into CNF and push individual conjuncts below LOForeach. {noformat} A = load 'f1' USING PigStorage(',') as (a1:int,a2:int,a3:int); B = load 'f2' USING PigStorage(',') as (b1:int,b2:int); G1 = GROUP A by a1, B by b1; C = FOREACH G1 GENERATE group as g1, MAX(A.a2) as max_a2, COUNT_STAR(B.b2) as max_b2; D = Filter C by (g1+max_a2 > 1 or g1 >= 23) and ( g1-4 < 348 ); explain D; {noformat} -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.