Hi Rodrigo,
Thanks for your suggestion. Though I don't see how the multistore UDF
helps.
Register UDFs etc
> A = LOAD
> B = LOAD
> C = LOAD
>
> -- do lots of transformations with A and B and C get intermediate result
> INTER_RES
> result1 = FOREACH (GROUP INTER_RES BY (...
> STORE res
Marco,
check out this UDF:
http://pig.apache.org/docs/r0.8.1/api/org/apache/pig/piggybank/storage/MultiStorage.html
I think it can get the job done without having to group everything.
Cheers,
Rodrigo
2015-01-08 7:27 GMT-02:00 Marco Cadetg :
> Hi there,
>
> I've a big pig script which first gen
Hi there,
I've a big pig script which first generates some expensive intermediate
result on which I run multiple group by statements and multiple stores.
Something like this.
Register UDFs etc
A = LOAD
B = LOAD
C = LOAD
-- do lots of transformations with A and B and C get intermediat
