Re: HDFS how to specify the exact datanode to put data on?

2015-07-20 Thread max scalf
May I ask why you need to do that? Y not let Hadoop handle that for u? On Sunday, July 19, 2015, Shiyao Ma i...@introo.me wrote: Hi, I'd like to put my data selectively on some datanodes. Currently I can do that by shutting down un-needed datanodes. But this is a little laborsome. Is

HDFS how to specify the exact datanode to put data on?

2015-07-19 Thread Shiyao Ma
Hi, I'd like to put my data selectively on some datanodes. Currently I can do that by shutting down un-needed datanodes. But this is a little laborsome. Is it possible to directly specify the datanodes I'd like to put the data on when doing operations like: hdfs dfs -put / TIA. --

Re: HDFS how to specify the exact datanode to put data on?

2015-07-19 Thread Ted Yu
DFSClient#create() allows you to pass favored nodes. Does that serve your needs ? On Jul 19, 2015, at 7:30 PM, Shiyao Ma i...@introo.me wrote: Hi, I'd like to put my data selectively on some datanodes. Currently I can do that by shutting down un-needed datanodes. But this is a