Hi, I have two files Group_condition.txt Colun1|Y Column2|N Column3|Y Load_cfl = LOAD '/user/hdfs/file.txt' USING PigStorage('|') as (code:chararray,book_code:int,currency_code:chararray,start_date:datetime,end_date:datetime,type:chararray,amount:double ); Load_GroupBy = LOAD '/user/hdfs/Groupby_Condition.txt' USING PigStorage('|') as (groupBy:chararray , condition :chararray); filter_col = FILTER Load_GroupBy BY (condition == 'Y'); flatn_col = FOREACH filter_col GENERATE FLATTEN(groupBy); tuple_col = FOREACH flatn_col GENERATE TOTUPLE(groupBy); cfl_grp = GROUP Load_cfl BY (flatn_col);
getting error : > Invalid scalar projection: flatn_col : A column needs to be projected from > a relation for it to be used as a scalar What am I missing in above ? Would really appreciate the help. Thanks, Divya