Koji Noguchi created PIG-3051:
---------------------------------
Summary: java.lang.IndexOutOfBoundsException failure with
LimitOptimizer + ColumnPruning
Key: PIG-3051
URL: https://issues.apache.org/jira/browse/PIG-3051
Project: Pig
Issue Type: Bug
Components: parser
Affects Versions: 0.10.0, 0.11
Reporter: Koji Noguchi
Assignee: Koji Noguchi
Had a user hitting
"Caused by: java.lang.IndexOutOfBoundsException: Index: 1, Size: 1" error when
he had multiple stores and limit in his code.
I couldn't reproduce this with short pig code (due to ColumnPruning somehow not
happening when shortened), but here's a snippet.
{noformat}
...
G3 = FOREACH G2 GENERATE sortCol, FLATTEN(group) as label, (long)COUNT(G1) as
cnt;
G4 = ORDER G3 BY cnt DESC PARALLEL 25;
ONEROW = LIMIT G4 1;
U1 = FOREACH ONEROW GENERATE 3 as sortcol, 'somelabel' as label, cnt;
store U1 into 'u1' using PigStorage();
store G4 into 'g4' using PigStorage();
{noformat}
With '-t ColumnMapKeyPrune', job didn't hit the error.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
