[
https://issues.apache.org/jira/browse/PIG-240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12989305#comment-12989305
]
Thomas Memenga commented on PIG-240:
------------------------------------
Additional Note: Applied latest patch to 0.8.0 (release), but executing the
following script results in nullpointerexception:
{code}
data = load 'hdfs://host.local:9000/user/hadoop/input/part-r-00000' using
PigStorage() as (thed,ts:int,cId,ai,si);
input_filtered = foreach data generate ts, ai, si;
pipe_4965 = filter input_filtered by ts > 1288043999 and ts < 1288047599;
pipe_4965_grouped = group pipe_4965 by (ai, si);
pipe_4965_flat = foreach pipe_4965_grouped generate FLATTEN($0) , COUNT($1) ,
MIN(pipe_4965.ts) as ts_min, MAX(pipe_4965.ts) as ts_max;
store pipe_4965_flat INTO '/user/hadoop/output/4965' USING PigStorage();
{code}
{code}
org.apache.pig.impl.logicalLayer.FrontendException: ERROR 2042: Error in new
logical plan. Try -Dpig.usenewlogicalplan=false.
at
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.compile(HExecutionEngine.java:309)
at org.apache.pig.PigServer.compilePp(PigServer.java:1354)
at
org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1196)
at org.apache.pig.PigServer.execute(PigServer.java:1190)
at org.apache.pig.PigServer.access$100(PigServer.java:128)
at org.apache.pig.PigServer$Graph.execute(PigServer.java:1517)
at org.apache.pig.PigServer.executeBatchEx(PigServer.java:362)
at org.apache.pig.PigServer.executeBatch(PigServer.java:329)
at
org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:112)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:169)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:141)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:90)
at org.apache.pig.Main.run(Main.java:510)
at org.apache.pig.Main.main(Main.java:107)
Caused by: java.lang.NullPointerException
at
org.apache.pig.newplan.ReverseDependencyOrderWalker.walk(ReverseDependencyOrderWalker.java:70)
at org.apache.pig.newplan.PlanVisitor.visit(PlanVisitor.java:50)
at
org.apache.pig.newplan.logical.optimizer.SchemaResetter.visit(SchemaResetter.java:105)
at
org.apache.pig.newplan.logical.relational.LOGenerate.accept(LOGenerate.java:229)
at
org.apache.pig.newplan.DependencyOrderWalker.walk(DependencyOrderWalker.java:75)
at
org.apache.pig.newplan.logical.optimizer.SchemaResetter.visit(SchemaResetter.java:94)
at
org.apache.pig.newplan.logical.relational.LOForEach.accept(LOForEach.java:71)
at
org.apache.pig.newplan.DependencyOrderWalker.walk(DependencyOrderWalker.java:75)
at org.apache.pig.newplan.PlanVisitor.visit(PlanVisitor.java:50)
at
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.compile(HExecutionEngine.java:261)
... 13 more
{code}
Script works fine with unpatched 0.8.0
> Support launching concurrent Pig jobs from one VM
> -------------------------------------------------
>
> Key: PIG-240
> URL: https://issues.apache.org/jira/browse/PIG-240
> Project: Pig
> Issue Type: Improvement
> Components: impl
> Reporter: Tom White
> Assignee: Jeff Zhang
> Attachments: patch_240.txt, pig-240-1.patch, pig-240-2.patch,
> pig-240.patch
>
>
> For some applications it would be convenient to launch concurrent Pig jobs
> from a single VM. This is currently not possible since Pig has static mutable
> state.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
