RE: High variance in results for hbase benchmarking

2011-03-07 Thread Buttler, David
Subject: Re: High variance in results for hbase benchmarking Mark, Gary, Ted, Thanks for your responses. I will keep the EC2 issues and other things in mind when I get a chance to redo the benchmarking. BTW is there any recommendation for an on demand computing provider for benchmarking purpose

Re: High variance in results for hbase benchmarking

2011-03-06 Thread Aditya Sharma
/files/papers/E02.pdf . > > - Andy > > > --- On Thu, 3/3/11, Gary Helmling wrote: > > > From: Gary Helmling > > Subject: Re: High variance in results for hbase benchmarking > > To: user@hbase.apache.org > > Cc: "Aditya Sharma" > > Date: T

Re: High variance in results for hbase benchmarking

2011-03-04 Thread Ted Dunning
Is your insert path multi-threaded? On Thu, Mar 3, 2011 at 10:51 PM, Aditya Sharma wrote: > It was quite variable, as I said earlier, but in one sort of representative > READs only benchmark, it was 115 READs per second. For a READ + WRITE > benchmark, it was 90 operations per second (with some p

Re: High variance in results for hbase benchmarking

2011-03-04 Thread Andrew Purtell
ery handy for a lot of other things though, like functional or smoke testing. For additional information see: http://www.comp.nus.edu.sg/~vldb2010/proceedings/files/papers/E02.pdf . - Andy --- On Thu, 3/3/11, Gary Helmling wrote: > From: Gary Helmling > Subject: Re: High variance in

Re: High variance in results for hbase benchmarking

2011-03-03 Thread Gary Helmling
On Thu, Mar 3, 2011 at 10:19 PM, Aditya Sharma wrote: > > Since we are using EC2 Large instances, it seems unlikely that network or > some other virtualization related resources crunch are affecting our > performance measurement. > > You are guaranteed to see large variance in results when benchma

Re: High variance in results for hbase benchmarking

2011-03-03 Thread Aditya Sharma
It was quite variable, as I said earlier, but in one sort of representative READs only benchmark, it was 115 READs per second. For a READ + WRITE benchmark, it was 90 operations per second (with some primitive caching thrown in). Aditya On Fri, Mar 4, 2011 at 11:54 AM, Ted Dunning wrote: > Wha

Re: High variance in results for hbase benchmarking

2011-03-03 Thread Ted Dunning
What kinds of speeds are you seeing? On Thu, Mar 3, 2011 at 10:19 PM, Aditya Sharma wrote: > Hi All, > > I am working on benchmarking different data stores to find the best fit for > our use case. I would like to know views and suggestions of the HBase user > and developer community on some of my

Re: High variance in results for hbase benchmarking

2011-03-03 Thread Ted Yu
Which hbase version did you use ? On Thu, Mar 3, 2011 at 10:19 PM, Aditya Sharma wrote: > Hi All, > > I am working on benchmarking different data stores to find the best fit for > our use case. I would like to know views and suggestions of the HBase user > and developer community on some of my fi

High variance in results for hbase benchmarking

2011-03-03 Thread Aditya Sharma
Hi All, I am working on benchmarking different data stores to find the best fit for our use case. I would like to know views and suggestions of the HBase user and developer community on some of my findings as the results I am getting are highly variable. My HBase Setup has two EC2 Large hosts (ea