Hi,
I have two files
Group_condition.txt
Colun1|Y
Column2|N
Column3|Y
Load_cfl = LOAD '/user/hdfs/file.txt' USING PigStorage('|') as
(code:chararray,book_code:int,currency_code:chararray,start_date:datetime,end_date:datetime,type:chararray,amount:double
);
Load_GroupBy = LOAD '/user/hdfs/Groupby_Condition.txt' USING
PigStorage('|') as (groupBy:chararray , condition :chararray);
filter_col = FILTER Load_GroupBy BY (condition == 'Y');
flatn_col = FOREACH filter_col GENERATE FLATTEN(groupBy);
tuple_col = FOREACH flatn_col GENERATE TOTUPLE(groupBy);
cfl_grp = GROUP Load_cfl BY (flatn_col);
getting error :
> Invalid scalar projection: flatn_col : A column needs to be projected from
> a relation for it to be used as a scalar
What am I missing in above ?
Would really appreciate the help.
Thanks,
Divya
