Re: Remote Blocked Transfer count

2011-10-22 Thread Uma Maheswara Rao G 72686
- Original Message - From: Mark question markq2...@gmail.com Date: Saturday, October 22, 2011 5:57 am Subject: Remote Blocked Transfer count To: common-user common-user@hadoop.apache.org Hello, I wonder if there is a way to measure how many of the data blocks havetransferred over

Re: Remote Blocked Transfer count

2011-10-22 Thread Rajiv Chittajallu
Have you looked at DataNode metrics? $ sudo -u hdfs bash -c 'echo -e open `cat $HADOOP_SECURE_DN_PID_DIR/hadoop_secure_dn.pid`\n get -b Hadoop:name=DataNode,service=DataNode * | /usr/bin/java -jar /home/rajive/w/jmx/jmxterm.jar -n ' Welcome to JMX terminal. Type help for available commands.

Remote Blocked Transfer count

2011-10-21 Thread Mark question
Hello, I wonder if there is a way to measure how many of the data blocks have transferred over the network? Or more generally, how many times where there a connection/contact between different machines? I thought of checking the Namenode log file which usually shows blk_ from src= to dst