java.lang.ArrayIndexOutOfBoundsException druing accessing relation
------------------------------------------------------------------
Key: PIG-1730
URL: https://issues.apache.org/jira/browse/PIG-1730
Project: Pig
Issue Type: Bug
Components: impl
Affects Versions: 0.8.0
Reporter: Sherry Chen
Fix For: 0.8.0
New logical plan is failing following code:
<pre>
A = load 'data' AS (query:chararray, type:chararray, freq:int);
B = group A by query;
C = foreach B {
click = filter A by (type == 'c');
pv = filter A by (type == 'p');
click_sum = (IsEmpty(click.freq)? 0 : SUM(click.freq));
generate
COUNT(click),
COUNT(pv),
click_sum;
}
store C into 'C';
</pre>
java.lang.ArrayIndexOutOfBoundsException: -1
at java.util.ArrayList.get(ArrayList.java:324)
at org.apache.pig.data.DefaultTuple.get(DefaultTuple.java:158)
at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POProject.processInputBag(POProject.java:482)
at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.PORelationToExprProject.getNext(PORelationToExprProject.java:107)
at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POProject.processInputBag(POProject.java:480)
at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POProject.getNext(POProject.java:197)
at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.processInput(POUserFunc.java:160)
at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:212)
at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:289)
at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POBinCond.getNext(POBinCond.java:193)
at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.processPlan(POForEach.java:361)
at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.getNext(POForEach.java:291)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.runPipeline(PigMapReduce.java:433)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.processOnePackageOutput(PigMapReduce.java:401)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:381)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:251)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at
org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:570)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:412)
at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:258)
2010-11-16 19:53:51,816 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- job job_local_0002 has failed! Stop running all dependent jobs
2010-11-16 19:53:51,818 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- 100% complete
2010-11-16 19:53:51,818 [main] ERROR org.apache.pig.tools.pigstats.PigStatsUtil
- 1 map reduce job(s) failed!
2010-11-16 19:53:51,818 [main] INFO org.apache.pig.tools.pigstats.PigStats -
Detected Local mode. Stats reported below may be incomplete
2010-11-16 19:53:51,819 [main] INFO org.apache.pig.tools.pigstats.PigStats -
Script Statistics:
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
