Hi,
dfs data directory at a datanode stores blocks in following directory
structure:
All blocks are stored at location:
dfs.data.dir/current/
This directory contains some blocks and some subdirectories named like
'subdir*' (eg. subdir0, subdir1, ... ,subdir33, ..,subdir63)
To be precise, each
Ajit,
Just move/merge subdirectories - its the easiest way to go about it and does no
harm. For confidence, you can also fire up a test cluster and test out these
things :)
On 05-Dec-2011, at 2:59 PM, Ajit Ratnaparkhi wrote:
Hi,
dfs data directory at a datanode stores blocks in following
Hi,
Current volume choosing policy is round robin fashion, Since the DN got new
disk, balancer will balance some blocks to this node. But the volume choosing
will be same when palcing the block. AFAIK, it wont do any special balancing
between disks in the same node. please correct me if i
Thanks for Help Joey!
Does just copying block files from one drive to another work?
Isn't there metadata maintained at datanode about block locations on that
datanode? If not, then how does datanode know about blocks stored on it?
-Ajit.
On Tue, Nov 22, 2011 at 5:25 PM, Joey Echeverria
This is an interesting usecase based on my understanding data nodes send
block information to name node so if you move the block files around old
data node should stop sending and new nodes would start sending. each block
is a seperate file.
it would be better to try this but i dont think this is
Ajit / Inder,
Please see
http://wiki.apache.org/hadoop/FAQ#On_an_individual_data_node.2C_how_do_you_balance_the_blocks_on_the_disk.3F
On Tue, Nov 22, 2011 at 9:44 PM, Ajit Ratnaparkhi
ajit.ratnapar...@gmail.com wrote:
Thanks for Help Joey!
Does just copying block files from one drive to
Thanks Harsh!
On Tue, Nov 22, 2011 at 10:05 PM, Harsh J ha...@cloudera.com wrote:
Ajit / Inder,
Please see
http://wiki.apache.org/hadoop/FAQ#On_an_individual_data_node.2C_how_do_you_balance_the_blocks_on_the_disk.3F
On Tue, Nov 22, 2011 at 9:44 PM, Ajit Ratnaparkhi
