Great!
Thanks very much,
Shirley
On Sep 29, 2008, at 7:37 PM, Elia Mazzawi wrote:
you can see those stats for each job in the job tracker web interface
http://yourdfsmaster.com:50030/jobtracker.jsp
click on the job link to get the stats
since its in the web interface there is probably a command to get it.
Shirley Cohen wrote:
Hi,
I would like to measure the disk i/o performance of our hadoop
cluster. However, running iostat on 16 nodes is rather cumbersome.
Does dfs keep track of any stats like the number of blocks or
bytes read and written? From scanning the api, I found a class
called "org.apache.hadoop.fs.FileSystem.Statistics" that could be
relevant. Does anyone know if this is what I'm looking for?
Thanks,
Shirley