[
https://issues.apache.org/jira/browse/PIG-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042362#comment-13042362
]
Daniel Eklund commented on PIG-2087:
------------------------------------
I was trying to immediately project out of a STRSPLIT(). Something like this:
STRSPLIT(timestamp, ' ', 1).$0
See our conversation here:
http://mail-archives.apache.org/mod_mbox/pig-user/201105.mbox/%[email protected]%3E
Unfortunately, due to the circumstances of the client, I am stuck using the
version 0.8. If I get a moment free, I can check it out on 0.8.1.
The above issue was the only one that necessitated me going back to the old
planner, but I found too many other problems (not just this one documented
here) that I went back AGAIN to the new one, and used a workaround for the
STRSPLIT() projection.
thanks.
> Not able to project into 'group' tuple from FILTER
> ---------------------------------------------------
>
> Key: PIG-2087
> URL: https://issues.apache.org/jira/browse/PIG-2087
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.8.0
> Reporter: Daniel Eklund
> Priority: Minor
> Labels: pig
>
> GROUP creates the 'group' tuple, but subsequent FILTER statements cannot
> project into it without throwing ClassCastExceptions.
> Example:
> -----------
> my_data = LOAD 'test.txt' using PigStorage(',')
> as (name:chararray, age:int, eye_color:chararray, height:int);
> by_age_and_color = GROUP my_data BY (age, eye_color);
> OUT2 = FILTER by_age_and_color by group.age is not null;
> dump OUT2;
> -- I get a similar problem even if I do something like:
> OUT3 = FILTER by_age_and_color by group.age > 9;
> dump OUT3;
> --------- sample test.txt ---------
> ravi,33,blue,43
> brendan,33,green,53
> ravichandra,15,blue,43
> leonor,15,brown,46
> caeser,18,blue,23
> JCVD,,blue,23
> anthony,33,blue,46
> xavier,23,blue,13
> patrick,18,blue,33
> sang,33,brown,44
> -------------------------------
> java.lang.ClassCastException: java.lang.Integer cannot be cast to
> org.apache.pig.data.Tuple
> at
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POProject.getNext(POProject.java:392)
> at
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.processInput(PhysicalOperator.java:276)
> at
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POProject.getNext(POProject.java:138)
> at
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POProject.getNext(POProject.java:276)
> at
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.GreaterThanExpr.getNext(GreaterThanExpr.java:72)
> at
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POFilter.getNext(POFilter.java:148)
> at
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.processInput(PhysicalOperator.java:276)
> at
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLocalRearrange.getNext(POLocalRearrange.java:256)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.runPipeline(PigMapBase.java:236)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:231)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:53)
> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:646)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:322)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:210)
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
