Re: How to update a file which is in HDFS

2013-07-05 Thread Mohammad Tariq
hich has same one million plus 1000 > >> > new > >> > records added in end of the file. > >> > Here i just want to move the 1000 records alone into HDFS instead of > >> > overwriting the entire file. > >> > > >> > Can i use HBas

Re: How to update a file which is in HDFS

2013-07-05 Thread Harsh J
records alone into HDFS instead of >> > overwriting the entire file. >> > >> > Can i use HBase for this scenario? i don't have clear idea about HBase. >> > Just >> > asking. >> > >> > >> > >> > >> > Thanks, >> > Manickam P &

Re: How to update a file which is in HDFS

2013-07-05 Thread Mohammad Tariq
27;t have clear idea about HBase. > Just > > asking. > > > > > > > > > > Thanks, > > Manickam P > > > > > >> From: ha...@cloudera.com > >> Date: Fri, 5 Jul 2013 16:13:16 +0530 > > > >> Subject: Re: How to update a file

Re: How to update a file which is in HDFS

2013-07-05 Thread Harsh J
ng the entire file. > > Can i use HBase for this scenario? i don't have clear idea about HBase. Just > asking. > > > > > Thanks, > Manickam P > > >> From: ha...@cloudera.com >> Date: Fri, 5 Jul 2013 16:13:16 +0530 > >> Subject: Re: How to u

RE: How to update a file which is in HDFS

2013-07-05 Thread Manickam P
of overwriting the entire file. Can i use HBase for this scenario? i don't have clear idea about HBase. Just asking. Thanks, Manickam P > From: ha...@cloudera.com > Date: Fri, 5 Jul 2013 16:13:16 +0530 > Subject: Re: How to update a file which is in HDFS > To: user@hadoop.ap

Re: How to update a file which is in HDFS

2013-07-05 Thread Harsh J
The answer to the "delta" part is more that HDFS does not presently support random writes. You cannot alter a closed file for anything other than appending at the end, which I doubt will help you if you are also receiving updates (it isn't clear from your question what this added data really is).

Re: How to update a file which is in HDFS

2013-07-05 Thread Robin East
atter, you will need more complex logic. >> >> >> >> John >> >> >> >> >> >> From: Mohammad Tariq [mailto:donta...@gmail.com] >> Sent: Thursday, July 04, 2013 5:47 AM >> To: user@hadoop.apache.org >

Re: How to update a file which is in HDFS

2013-07-05 Thread Robin East
ecords a the end of the file? Or can they be anywhere in the file? If > the latter, you will need more complex logic. > > > > John > > > > > > From: Mohammad Tariq [mailto:donta...@gmail.com] > Sent: Thursday, July 04, 2013 5:47 AM > To: user@hado

Re: How to update a file which is in HDFS

2013-07-04 Thread Mohammad Tariq
If the latter, you will need more complex logic.*** > * > > ** ** > > John > > ** ** > > ** ** > > *From:* Mohammad Tariq [mailto:donta...@gmail.com] > *Sent:* Thursday, July 04, 2013 5:47 AM > *To:* user@hadoop.apache.org > *Subject:* Re: How to update a file which is in HDFS**

RE: How to update a file which is in HDFS

2013-07-04 Thread John Lilley
:47 AM To: user@hadoop.apache.org Subject: Re: How to update a file which is in HDFS Hello Manickam, Append is currently not possible. Warm Regards, Tariq cloudfront.blogspot.com<http://cloudfront.blogspot.com> On Thu, Jul 4, 2013 at 4:40 PM, Manickam P mailto:manicka...@outlook.com

Re: How to update a file which is in HDFS

2013-07-04 Thread Mohammad Mustaqeem
You can append using WebHDFS.. Following link may help you-- http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/WebHDFS.html#Append_to_a_File On Thu, Jul 4, 2013 at 5:17 PM, Mohammad Tariq wrote: > Hello Manickam, > > Append is currently not possible. > > Warm Regards

Re: How to update a file which is in HDFS

2013-07-04 Thread Mohammad Tariq
Hello Manickam, Append is currently not possible. Warm Regards, Tariq cloudfront.blogspot.com On Thu, Jul 4, 2013 at 4:40 PM, Manickam P wrote: > Hi, > > I have moved my input file into the HDFS location in the cluster setup. > Now i got a new set of file which has some new records al