[
https://issues.apache.org/jira/browse/PIG-5031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Koji Noguchi resolved PIG-5031.
-------------------------------
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 0.17.0
Thanks for the review Rohini!
Committed to trunk.
> Tez failing to compile when replicate join is done with a limit vertex on left
> ------------------------------------------------------------------------------
>
> Key: PIG-5031
> URL: https://issues.apache.org/jira/browse/PIG-5031
> Project: Pig
> Issue Type: Bug
> Components: tez
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Priority: Minor
> Fix For: 0.17.0
>
> Attachments: pig-5031-v01.patch
>
>
> {code}
> a = load 'file:///tmp/input' as (x:int, y:int);
> b = load 'file:///tmp/input' as (x:int, y:int);
> c = limit a 1;
> d = join c by x, b by x using 'replicated';
> store a into 'file:///tmp/pigoutput/a';
> store d into 'file:///tmp/pigoutput/d';
> {code}
> This fails with
> {noformat}
> ERROR 2022: The current operator is closed. This is unexpected while
> compiling.
> org.apache.pig.backend.hadoop.executionengine.tez.plan.TezCompilerException:
> ERROR 2034: Error compiling operator POFRJoin
> at
> org.apache.pig.backend.hadoop.executionengine.tez.plan.TezCompiler.visitFRJoin(TezCompiler.java:756)
> at
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POFRJoin.visit(POFRJoin.java:213)
> at
> org.apache.pig.backend.hadoop.executionengine.tez.plan.TezCompiler.compile(TezCompiler.java:409)
> at
> org.apache.pig.backend.hadoop.executionengine.tez.plan.TezCompiler.compile(TezCompiler.java:388)
> at
> org.apache.pig.backend.hadoop.executionengine.tez.plan.TezCompiler.compile(TezCompiler.java:264)
> at
> org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher.compile(TezLauncher.java:423)
> at
> org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher.launchPig(TezLauncher.java:171)
> at
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.launchPig(HExecutionEngine.java:290)
> at org.apache.pig.PigServer.launchPlan(PigServer.java:1474)
> at
> org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1459)
> at org.apache.pig.PigServer.execute(PigServer.java:1448)
> at org.apache.pig.PigServer.executeBatch(PigServer.java:488)
> at org.apache.pig.PigServer.executeBatch(PigServer.java:471)
> at
> org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:172)
> at
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:235)
> at
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:206)
> at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
> at org.apache.pig.Main.run(Main.java:630)
> at org.apache.pig.Main.main(Main.java:176)
> Caused by:
> org.apache.pig.backend.hadoop.executionengine.tez.plan.TezCompilerException:
> ERROR 2022: The current operator is closed. This is unexpected while
> compiling.
> at
> org.apache.pig.backend.hadoop.executionengine.tez.plan.TezCompiler.visitFRJoin(TezCompiler.java:739)
> ... 18 more
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
