Re: Re: performance about writing data to HDFS

2018-02-01 Thread 徐传印
IOException -原始邮件- 发件人:"Miklos Szegedi" 发送时间:2018-01-30 01:50:23 (星期二) 收件人: "徐传印" 抄送: Hdfs-dev , "Hadoop Common" , "common-u...@hadoop.apache.org" 主题: Re: performance about writing data to HDFS Hello, Here is an example. You can set an initial lo

Re: performance about writing data to HDFS

2018-01-29 Thread Miklos Szegedi
Hello, Here is an example. You can set an initial low replication like this code does: https://github.com/apache/hadoop/blob/56feaa40bb94fcaa96ae668eebfabec4611928c0/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-uploader/src/main/java/org/apache/hadoop/mapred/uploader/F