Re: Copy hdfs block from one data node to another

2014-07-09 Thread Yehia Elshater
Thanks a lot. I will take a look on the balancer and decommissioning code. On 10 July 2014 00:34, Arpit Agarwal wrote: > The balancer does something similar. It uses > DataTransferProtocol.replaceBlock. > > > On Wed, Jul 9, 2014 at 9:20 PM, sudhakara st > wrote: > >> You can get info about all

Re: Copy hdfs block from one data node to another

2014-07-09 Thread Arpit Agarwal
The balancer does something similar. It uses DataTransferProtocol.replaceBlock. On Wed, Jul 9, 2014 at 9:20 PM, sudhakara st wrote: > You can get info about all blocks stored in perticuler data node, i,e > block report. But you to handle, move in block level not in file or start > and end bytes

Re: Copy hdfs block from one data node to another

2014-07-09 Thread sudhakara st
You can get info about all blocks stored in perticuler data node, i,e block report. But you to handle, move in block level not in file or start and end bytes level. On Thu, Jul 10, 2014 at 2:49 AM, Chris Mawata wrote: > Haven't looked at the source but the thing you are trying to do sounds > si

Re: Copy hdfs block from one data node to another

2014-07-09 Thread Chris Mawata
Haven't looked at the source but the thing you are trying to do sounds similar to what happens when you are decommissioning a datanode. I would hunt for that code. Cheers Chris On Jul 9, 2014 3:41 PM, "Yehia Elshater" wrote: > Hi Chris, > > Actually I need this functionality for my research, basi

Re: Copy hdfs block from one data node to another

2014-07-09 Thread Yehia Elshater
Hi Chris, Actually I need this functionality for my research, basically for fault tolerance. I can calculate some failure probability for some data nodes after certain unit of time. So I need to copy all the blocks reside on these nodes to another nodes. Thanks Yehia On 7 July 2014 20:45, Chris

Re: Copy hdfs block from one data node to another

2014-07-07 Thread Chris Mawata
Can you outline why one would want to do that? The blocks are disposable so it is strange to manipulate them directly. On Jul 7, 2014 8:16 PM, "Yehia Elshater" wrote: > Hi All, > > How can copy a certain hdfs block (given the file name, start and end > bytes) from one node to another node ? > > T

Copy hdfs block from one data node to another

2014-07-07 Thread Yehia Elshater
Hi All, How can copy a certain hdfs block (given the file name, start and end bytes) from one node to another node ? Thanks Yehia