Re: How to test DFS?

2015-05-26 Thread jay vyas
you could just list the file contents in your hadoop data/ directories, of the individual nodes, ... somewhere in there the file blocks will be floating around. On Tue, May 26, 2015 at 4:59 PM, Caesar Samsi caesarsa...@mac.com wrote: Hello, How would I go about and confirm that a file has

Re: How to test DFS?

2015-05-26 Thread Drake민영근
Hi, You can use 'hdfs fsck' command for determining block locations. Sample run shows below: [root@qa-b1 ~]# hdfs fsck /tmp/jack -files -blocks -locations Connecting to namenode via http://192.168.50.171:50070 FSCK started by root (auth:SIMPLE) from /192.168.50.170 for path /tmp/jack at Wed May

How to test DFS?

2015-05-26 Thread Caesar Samsi
Hello, How would I go about and confirm that a file has been distributed successfully to all datanodes? I would like to demonstrate this capability in a short briefing for my colleagues. Can I access the file from the datanode itself (todate I can only access the files from the master