CombinerOptimizer exception with multi-query
--------------------------------------------
Key: PIG-2164
URL: https://issues.apache.org/jira/browse/PIG-2164
Project: Pig
Issue Type: Bug
Affects Versions: 0.9.0
Reporter: Thejas M Nair
Assignee: Thejas M Nair
Fix For: 0.9.0, 0.10
{code}
l = load 'x' as (a,b,c);
f1 = foreach (group l by (a,b)) generate COUNT_STAR(*);
f2 = foreach (group l by (a,null)) generate COUNT_STAR(*);
u = union f1, f2;
explain u;
Pig Stack Trace
---------------
ERROR 2018: Internal error. Unable to introduce the combiner for optimization.
org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1067: Unable to
explain alias u
at org.apache.pig.PigServer.explain(PigServer.java:1063)
at
org.apache.pig.tools.grunt.GruntParser.explainCurrentBatch(GruntParser.java:393)
at
org.apache.pig.tools.grunt.GruntParser.processExplain(GruntParser.java:325)
at
org.apache.pig.tools.grunt.GruntParser.processExplain(GruntParser.java:288)
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.Explain(PigScriptParser.java:665)
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:325)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:188)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:67)
at org.apache.pig.Main.run(Main.java:487)
at org.apache.pig.Main.main(Main.java:108)
Caused by: org.apache.pig.impl.plan.optimizer.OptimizerException: ERROR 2018:
Internal error. Unable to introduce the combiner for optimization.
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.CombinerOptimizer.visitMROp(CombinerOptimizer.java:313)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceOper.visit(MapReduceOper.java:252)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceOper.visit(MapReduceOper.java:42)
at
org.apache.pig.impl.plan.DepthFirstWalker.depthFirst(DepthFirstWalker.java:69)
at
org.apache.pig.impl.plan.DepthFirstWalker.depthFirst(DepthFirstWalker.java:71)
at
org.apache.pig.impl.plan.DepthFirstWalker.walk(DepthFirstWalker.java:52)
at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:51)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.compile(MapReduceLauncher.java:492)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.explain(MapReduceLauncher.java:454)
at org.apache.pig.PigServer.explain(PigServer.java:1055)
... 10 more
Caused by: java.lang.ArrayIndexOutOfBoundsException: 2
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.CombinerOptimizer.addAlgebraicFuncToCombineFE(CombinerOptimizer.java:515)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.CombinerOptimizer.visitMROp(CombinerOptimizer.java:227)
... 19 more
================================================================================
{code}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
