Scalability Bugs in HBase

2017-02-27 Thread Tanakorn Leesatapornwongsa
Dear HBase team, We are CS researchers at the University of Chicago. In our recent research, we are building a framework to find and replay "scalability bugs" with just one machine (scalability bugs are bugs that only surface in large-scale deployments such as in hundreds of nodes, but do not app

Re: Scalability Bugs in HBase

2017-02-27 Thread Tanakorn Leesatapornwongsa
I think the mailing list does not allow attachment, so I attach it here as a link to the paper. http://people.cs.uchicago.edu/~tanakorn/scale.pdf Best, Tanakorn L. > On Feb 27, 2017, at 10:25 PM, Tanakorn Leesatapornwongsa > wrote: > > D

Re: Scalability Bugs in HBase

2017-02-27 Thread Ted Yu
The references only listed C* bugs. Can you tell us which 9 hbase bugs you have analyzed ? Thanks On Mon, Feb 27, 2017 at 8:25 PM, Tanakorn Leesatapornwongsa < tanak...@cs.uchicago.edu> wrote: > Dear HBase team, > > We are CS researchers at the University of Chicago. In our recent > research,

Re: Scalability Bugs in HBase

2017-02-27 Thread Tanakorn Leesatapornwongsa
Sure, here is the list of HBase bugs, https://issues.apache.org/jira/browse/HBASE-3620 https://issues.apache.org/jira/browse/HBASE-8778 https://issues.apache.org/jira/browse/HBASE-7190

Re: Scalability Bugs in HBase

2017-02-27 Thread Ted Yu
I noticed that a few of the bugs below are still open. If you clone hbase git repo, you can find fixed bugs w.r.t. StochasticLoadBalancer by examining git history of ./hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/StochasticLoadBalancer.java FYI On Mon, Feb 27, 2017 at 8:52

Re: Scalability Bugs in HBase

2017-02-28 Thread Ted Yu
On page 4: The PIL-replaced functions are still manually picked and replaced. The next major task is to make the whole process automated and find more bugs. Do you have estimate when the task of automation would be completed ? Thanks On Mon, Feb 27, 2017 at 8:25 PM, Tanakorn Leesatapornwongsa <

Re: Scalability Bugs in HBase

2017-02-28 Thread Tanakorn Leesatapornwongsa
Hi Ted, Thank you for the pointer to the bugs. I will look into it. For the feature that you ask, we estimate that it will take 2 - 3 months to finish. We will keep you posted. Thank you again! Best, Tanakorn L. > On Feb 28, 2017, at 10:42 AM, Ted Yu wrote: > > On page 4: > The PIL-replaced