Hi guys,
Another question related to it is that when you do hadoop fs -copyFromLocal
or use
API to call fs.write(), does it write to local filesystem first before
writing to HDFS. I read and found out that it writes on local file-system
until block-size is reached and then writes on HDFS.
Wouldn't
Thanks Joey !
I will try to find out abt copyFromLocal. Looks like Hadoop Apis write serially
as you pointed out.
Thanks,
-JJ
On May 17, 2011, at 8:32 PM, Joey Echeverria wrote:
> The sequence file writer definitely does it serially as you can only
> ever write to the end of a file in Hadoop.
Hi,
My question is when I run a command from hdfs client, for eg. hadoop fs
-copyFromLocal or create a sequence file writer in java code and append
key/values to it through Hadoop APIs, does it internally transfer/write data
to HDFS serially or in parallel ?
Thanks in advance,
-JJ
