Bench-marking Hadoop Performance

2014-07-22 Thread Charley Newtonne
This is a new cluster I'm putting up and I need to get an idea on what to expect from a performance standpoint. Older docs point to gridmix and TestDFSIO . However, most of this doc is obsolete and no longer applies on 2.4. Where can I find benchmarking docs for 2.4? What are my options? Also, I

Hadoop 2.4 test jar files.

2014-07-22 Thread Charley Newtonne
I have spent hours trying to find out how to run these jar files. The older version are documented on the web and some of the books. These, however, are not. How do I know ... - The purpose of each one of these jar files. - The class to call and what it does. - The arguments to pass.

Re: Hadoop 2.4 test jar files.

2014-07-22 Thread Charley Newtonne
hadoop modules. You can expand the one(s) you're interested in and run tests contained in them. Cheers On Tue, Jul 22, 2014 at 9:47 AM, Charley Newtonne cnewto...@gmail.com wrote: I have spent hours trying to find out how to run these jar files. The older version are documented on the web

Configuring Hadoop Client: Where is fail-over configured.

2014-06-26 Thread Charley Newtonne
I have hadoop 2.4 installed in HA mode using QJM. I have verified the cluster failover works as expected. The java clients are configured to connect to the active NN by specifying the hdf://nn1.company.com:8020. If this nn1 is down, how's the client know the location of the standby nn. Where is