Re: Comparing the performance of 0.98.2 RC0 and 0.98.0 using YCSB

2014-05-15 Thread Jean-Daniel Cryans
Nice, thanks for running this. J-D On Tue, May 6, 2014 at 6:58 PM, Andrew Purtell wrote: > Comparing the relative performance of 0.98.2 RC0 and 0.98.0 on Hadoop 2.2.0 > using YCSB. > > The hardware used is different than for the previous report comparing > 0.98.1 to 0.98.0. However the results

Re: Comparing the performance of 0.98.2 RC0 and 0.98.0 using YCSB

2014-05-15 Thread Andrew Purtell
Thanks for the offer J-M. We'd be / are in your debt for kicking the tires. I think YCSB or LoadTestTool (the former is more well known with a convenient summary report) can help detect fine trends in operation latencies. And certainly regressions too. Would be a good compliment to PE. I shou

Re: Comparing the performance of 0.98.2 RC0 and 0.98.0 using YCSB

2014-05-12 Thread Jean-Marc Spaggiari
I run PE for (almost*) all the releases. I can add YCSB if you want. It's a dedicated cluster where I have only Hadoop 2.2.0 running, ZK (on the master) and HBase. Nothing else. Only 3RS+1MASTER for now. Just send me the YCSB workload (as long as it doesn't require to run for more than 24h). JM *

Re: Comparing the performance of 0.98.2 RC0 and 0.98.0 using YCSB

2014-05-11 Thread Konstantin Boudnik
I think the point wasn't a benchmarking but merely to make sure there's no regressions. On Wed, May 07, 2014 at 02:16PM, Vladimir Rodionov wrote: > *7x EC2 c3.8xlarge: 1 master, 5 slaves, 1 test client* > > Andrew, I think these numbers are far from maximum you can get from this > set up. Why onl

Re: Comparing the performance of 0.98.2 RC0 and 0.98.0 using YCSB

2014-05-11 Thread Andrew Purtell
For cost and time reasons, and for regression checking operation latencies not drag racing peak throughput. I wanted YCSB because many try HBase out with it, I find that YCSB is difficult to use to say the least in a coordinated way with multiple instances. For benchmarking throughput I would

Re: Comparing the performance of 0.98.2 RC0 and 0.98.0 using YCSB

2014-05-10 Thread Vladimir Rodionov
*7x EC2 c3.8xlarge: 1 master, 5 slaves, 1 test client* Andrew, I think these numbers are far from maximum you can get from this set up. Why only 1 test client? -Vladimir Rodionov On Tue, May 6, 2014 at 6:58 PM, Andrew Purtell wrote: > Comparing the relative performance of 0.98.2 RC0 and 0.98.

Comparing the performance of 0.98.2 RC0 and 0.98.0 using YCSB

2014-05-07 Thread Andrew Purtell
Comparing the relative performance of 0.98.2 RC0 and 0.98.0 on Hadoop 2.2.0 using YCSB. The hardware used is different than for the previous report comparing 0.98.1 to 0.98.0. However the results are very similar, both in terms of 0.98.2 RC0 numbers with respect to those measured for 0.98.0, and t