[jira] [Commented] (PIG-2083) bincond ERROR 1025: Invalid field projection when null is used
[ https://issues.apache.org/jira/browse/PIG-2083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13039242#comment-13039242 ] Richard Ding commented on PIG-2083: --- +1 bincond ERROR 1025: Invalid field projection when null is used -- Key: PIG-2083 URL: https://issues.apache.org/jira/browse/PIG-2083 Project: Pig Issue Type: Bug Components: build Affects Versions: 0.9.0 Environment: Linux 2.6.18-53.1.13.el5 #1 SMP Mon Feb 11 13:27:27 EST 2008 x86_64 x86_64 x86_64 GNU/Linux Hadoop 0.20.203.3.1104011556 -r 96519d04f65e22ffadf89b225d0d44ef1741d126 Compiled on Fri Apr 1 16:29:09 PDT 2011 Reporter: Araceli Henley Assignee: Thejas M Nair Fix For: 0.9.0 Attachments: PIG-2083.1.patch This is a regression for 9. a = load '1.txt' as (a0, a1); b = foreach a generate (a0==0?null:2); explain b; ERROR 1025: Invalid field projection. Projected field [null] does not exist in schema -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2087) Not able to project into 'group' tuple from FILTER
[
https://issues.apache.org/jira/browse/PIG-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13039290#comment-13039290
]
Daniel Eklund commented on PIG-2087:
Cloudera could not reproduce but together we narrowed it down and found that it
was a result of
-Dpig.usenewlogicalplan=false that I was using (I was actually using set
pig.usenewlogicalplan false)
Unfortunately I need this for a workaround on another issue, and since this
won't be an issue for later releases, I'll let you decide whether it needs any
priority at all. thanks.
Not able to project into 'group' tuple from FILTER
---
Key: PIG-2087
URL: https://issues.apache.org/jira/browse/PIG-2087
Project: Pig
Issue Type: Bug
Affects Versions: 0.8.0
Reporter: Daniel Eklund
Priority: Minor
Labels: pig
GROUP creates the 'group' tuple, but subsequent FILTER statements cannot
project into it without throwing ClassCastExceptions.
Example:
---
my_data = LOAD 'test.txt' using PigStorage(',')
as (name:chararray, age:int, eye_color:chararray, height:int);
by_age_and_color = GROUP my_data BY (age, eye_color);
OUT2 = FILTER by_age_and_color by group.age is not null;
dump OUT2;
-- I get a similar problem even if I do something like:
OUT3 = FILTER by_age_and_color by group.age 9;
dump OUT3;
- sample test.txt -
ravi,33,blue,43
brendan,33,green,53
ravichandra,15,blue,43
leonor,15,brown,46
caeser,18,blue,23
JCVD,,blue,23
anthony,33,blue,46
xavier,23,blue,13
patrick,18,blue,33
sang,33,brown,44
---
java.lang.ClassCastException: java.lang.Integer cannot be cast to
org.apache.pig.data.Tuple
at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POProject.getNext(POProject.java:392)
at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.processInput(PhysicalOperator.java:276)
at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POProject.getNext(POProject.java:138)
at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POProject.getNext(POProject.java:276)
at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.GreaterThanExpr.getNext(GreaterThanExpr.java:72)
at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POFilter.getNext(POFilter.java:148)
at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.processInput(PhysicalOperator.java:276)
at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLocalRearrange.getNext(POLocalRearrange.java:256)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.runPipeline(PigMapBase.java:236)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:231)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:53)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:646)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:322)
at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:210)
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (PIG-2083) bincond ERROR 1025: Invalid field projection when null is used
[ https://issues.apache.org/jira/browse/PIG-2083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair resolved PIG-2083. Resolution: Fixed Hadoop Flags: [Reviewed] Patch committed to trunk and 0.9 branch. bincond ERROR 1025: Invalid field projection when null is used -- Key: PIG-2083 URL: https://issues.apache.org/jira/browse/PIG-2083 Project: Pig Issue Type: Bug Components: build Affects Versions: 0.9.0 Environment: Linux 2.6.18-53.1.13.el5 #1 SMP Mon Feb 11 13:27:27 EST 2008 x86_64 x86_64 x86_64 GNU/Linux Hadoop 0.20.203.3.1104011556 -r 96519d04f65e22ffadf89b225d0d44ef1741d126 Compiled on Fri Apr 1 16:29:09 PDT 2011 Reporter: Araceli Henley Assignee: Thejas M Nair Fix For: 0.9.0 Attachments: PIG-2083.1.patch This is a regression for 9. a = load '1.txt' as (a0, a1); b = foreach a generate (a0==0?null:2); explain b; ERROR 1025: Invalid field projection. Projected field [null] does not exist in schema -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2096) End to end tests for new Macro feature
[ https://issues.apache.org/jira/browse/PIG-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-2096: Attachment: macro_tests.patch These have not been thoroughly tested and are not yet ready for inclusion. Just checkpointing so others can see the tests we plan to add. End to end tests for new Macro feature -- Key: PIG-2096 URL: https://issues.apache.org/jira/browse/PIG-2096 Project: Pig Issue Type: Improvement Components: tools Affects Versions: 0.9.0 Reporter: Alan Gates Assignee: Alan Gates Attachments: macro_tests.patch We need to add new end to end tests for the new Pig macro and import features. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
