Re: Is it possible to implement transpose with PigLatin/any other MR language?

2012-06-22 Thread Robert Evans
FOREACH since sorting is not preserved, for other operations again data may be in wrong order in the row. To me it seems like it is not possible to do this in MR. On Fri, Jun 22, 2012 at 12:56 AM, Robert Evans wrote: > That may be true, I have not read through the code very closely, if you >

Re: Is it possible to implement transpose with PigLatin/any other MR language?

2012-06-21 Thread Robert Evans
That may be true, I have not read through the code very closely, if you have multiple reduces, so you can run it with a single reduce or you can write a custom partitioner to do it. You only need to know the length of the column, and then you can divide them up appropriately, kind of like how