One thing you can do though, is to let pig create new files every time and have a post-pig task/job to combine the old file and the new file.
It's a little abnormal to require a single file on HDFS. Normally, MR or other jobs deal with a folder of files, not just a single file. Regards, Xuefu On Thu, Jul 18, 2013 at 4:49 AM, Serega Sheypak <[email protected]>wrote: > it's not possible. It's HDFS. > > > 2013/7/18 Bhavesh Shah <[email protected]> > > > Hello, > > > > Actually I have a use case in which I will receive the data from some > > source and I have to dump it in the same file after every regular > interval > > and use that file for further operation. I tried to search on it, but I > > didn't see the anything related to this. > > > > I am using STORE function, but STORE function always create new file with > > specified name and gives error if the specified file already exists. > > How should I do store the data in same file? Is it possible in Pig or > have > > some work around for it? > > Please suggest me some solution over this. > > > > > > Thanks, > > Bhavesh Shah >
