[ https://issues.apache.org/jira/browse/PIG-3379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai updated PIG-3379: ---------------------------- Resolution: Fixed Fix Version/s: 0.12 Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Patch committed to trunk. Thanks Xuefu! > Alias reuse in nested foreach causes PIG script to fail > ------------------------------------------------------- > > Key: PIG-3379 > URL: https://issues.apache.org/jira/browse/PIG-3379 > Project: Pig > Issue Type: Bug > Components: impl > Affects Versions: 0.11.1 > Reporter: Xuefu Zhang > Assignee: Xuefu Zhang > Fix For: 0.12 > > Attachments: PIG-3379-draft.patch, PIG-3379.patch > > > The following script fails: > {code:title=temp.pig} > Events = LOAD 'x' AS (eventTime:long, deviceId:chararray, > eventName:chararray); > Events = FOREACH Events GENERATE eventTime, deviceId, eventName; > EventsPerMinute = GROUP Events BY (eventTime / 60000); > EventsPerMinute = FOREACH EventsPerMinute { > DistinctDevices = DISTINCT Events.deviceId; > nbDevices = SIZE(DistinctDevices); > DistinctDevices = FILTER Events BY eventName == 'xuaHeartBeat'; > nbDevicesWatching = SIZE(DistinctDevices); > GENERATE $0*60000 as timeStamp, nbDevices as nbDevices, nbDevicesWatching > as nbDevicesWatching; > } > EventsPerMinute = FILTER EventsPerMinute BY timeStamp >= 0 AND timeStamp < > 100000; > A = FOREACH EventsPerMinute GENERATE timeStamp; > describe A; > {code} > With the error: > {code} > 2013-07-16 11:31:20,450 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR > 1025: > <file /home/xzhang/Documents/temp.pig, line 14, column 37> Invalid field > projection. Projected field [timeStamp] does not exist in schema: > deviceId:chararray. > {code} > Using distinct alias name for the 2nd "DistinctDevices" fixes the problem. As > an observation, removing the last filter statement also fixes the problem. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira