Hello,
I'm using PIG from Java and I store my results using the regular call:
pigServer.store(pigAlias, outputFilePath);
Now, I need to read the file produced (in order to store it to a
MySQL table).
The problem is that PIG (when used in map/reduce mode) is creating a
directory + a set of part files for each stored "file".
I cannot figure out how to read this output: should I concatenate
all part files? Is there an PIG API that hide this complexity?
Thanks for your help, as it is a blocking issue for me.
Regards,