Re: Question about hdfs close * hflush behavior

2011-09-08 Thread Kanghua151
; 0.21, which is buggy in other aspects. So, no stable released version >>> has a working append() call. >>> >>> In truth I've never seen a _good_ use case for >>> append-to-an-existing-file. Usually you can do just as well by keeping >>> the file

Re: Question about hdfs close * hflush behavior

2011-09-08 Thread Todd Lipcon
no bug ? >> >> 0.21, which is buggy in other aspects. So, no stable released version >> has a working append() call. >> >> In truth I've never seen a _good_ use case for >> append-to-an-existing-file. Usually you can do just as well by keeping >> the

Re: Question about hdfs close * hflush behavior

2011-09-08 Thread Kanghua151
. Usually you can do just as well by keeping > the file open and periodically hflushing, or rolling to a new file > when you want to add more records to an existing dataset. > > -Todd > >>> From: t...@cloudera.com >>> Date: Wed, 7 Sep 2011 14:17:10 -0700 >>&g

Re: Question about hdfs close * hflush behavior

2011-09-08 Thread Todd Lipcon
ting-file. Usually you can do just as well by keeping the file open and periodically hflushing, or rolling to a new file when you want to add more records to an existing dataset. -Todd >> From: t...@cloudera.com >> Date: Wed, 7 Sep 2011 14:17:10 -0700 >> Subject: Re: Question about hd

RE: Question about hdfs close * hflush behavior

2011-09-07 Thread kang hua
bug ? 4 which version of hdfs that append is no bug ? thanks again.kanghua > From: t...@cloudera.com > Date: Wed, 7 Sep 2011 14:17:10 -0700 > Subject: Re: Question about hdfs close * hflush behavior > To: hdfs-user@hadoop.apache.orgSend > > 2011/9/7 kang hua : > > > &

Re: Question about hdfs close * hflush behavior

2011-09-07 Thread Todd Lipcon
2011/9/7 kang hua : > > Hi friends: >I has two question. >first one is: >I use libhdfs's hflush to flush my data to a file, in same process > context I can read it. But I find that file unchanged if I check from hadoop > shell it's len is zero( check by "hadoop fs -ls xxx" or read

Question about hdfs close * hflush behavior

2011-09-07 Thread kang hua
Hi friends: I has two question. first one is: I use libhdfs's hflush to flush my data to a file, in same process context I can read it. But I find that file unchanged if I check from hadoop shell ―― it's len is zero( check by "hadoop fs -ls xxx" or read it in program); however when I reb