Lithium (Klout) powers www.klout.com with HBase. The operations team is 2 full time engineers + the manager (who also does hands on operations work with the team). This operations team is responsible for the entirety of our Hadoop stack including the HBase clusters. We have one 165 node Hive cluster for Data Science and 5 HBase clusters (of varying sizes), 2 of which are used to power klout.com.
We have strong SLA requirements for klout.com as it is a user facing product. I don't remember the sizing of our HBase clusters off hand but they are substantial enough to load user profile data and Klout scores for approximately 600 million users on a daily basis. I believe the data set is in the order of several terabytes. On Sat Dec 06 2014 at 8:49:37 PM lars hofhansl <la...@apache.org> wrote: > For expected latency, read this: http://hadoop-hbase.blogspot. > com/2014/08/hbase-client-response-times.htmlFor cluster/machine sizing > this might be helpful: http://hadoop-hbase.blogspot. > com/2013/01/hbase-region-server-memory-sizing.html Disclaimer: I wrote > these two posts. > -- Lars > > From: jeremy p <athomewithagroove...@gmail.com> > To: user@hbase.apache.org > Sent: Friday, December 5, 2014 1:37 PM > Subject: What companies are using HBase to serve a customer-facing > product? > > Hey all, > > So, I'm currently evaluating HBase as a solution for querying a very large > data set (think 60+ TB). We'd like to use it to directly power a > customer-facing product. My question is threefold : > > 1) What companies use HBase to serve a customer-facing product? I'm not > interested in evaluations, experiments, or POC. I'm also not interested in > offline BI or analytics. I'm specifically interested in cases where HBase > serves as the data store for a customer-facing product. > > 2) Of the companies that use HBase to serve a customer-facing product, > which ones use it to query data sets of 60TB or more? > > 3) Of companies use HBase to query 60+ TB data sets and serve a > customer-facing product, how many employees are required to support their > HBase installation? In other words, if I were to start a team tomorrow, > and their purpose was to maintain a 60+ TB HBase installation for a > customer-facing product, how many people should I hire? > > 4) Of companies use HBase to query 60+ TB data sets and serve a > customer-facing product, what kind of measures do they take for disaster > recovery? > > If you can, please point me to articles, videos, and other materials. > Obviously, the larger the company, the better case it will make for HBase. > > Thank you! > > >
