At HubSpot we have 5 customer facing production clusters 30-60TB+ each. Our Data Ops team has ranged from 2-3 (including me), but we support much more than just hbase. We have an in-house built nightly backup system and persist all HLogs on an ongoing basis, so in 2-3 hours we can recover to within about a minute of any disaster . We are also looking at replication for the future.
Our clusters serve mixed workloads, from APIs serving thousands of req/s to Hadoop and other batch jobs. Each of these have different SLAs, but the APIs are driving customer interactions so must be in the 100-500ms range or lower, mostly. On Saturday, December 6, 2014, lars hofhansl <la...@apache.org> wrote: > For expected latency, read this: > http://hadoop-hbase.blogspot.com/2014/08/hbase-client-response-times.htmlFor > cluster/machine sizing this might be helpful: > http://hadoop-hbase.blogspot.com/2013/01/hbase-region-server-memory-sizing.html > Disclaimer: I wrote these two posts. > -- Lars > > From: jeremy p <athomewithagroove...@gmail.com <javascript:;>> > To: user@hbase.apache.org <javascript:;> > Sent: Friday, December 5, 2014 1:37 PM > Subject: What companies are using HBase to serve a customer-facing > product? > > Hey all, > > So, I'm currently evaluating HBase as a solution for querying a very large > data set (think 60+ TB). We'd like to use it to directly power a > customer-facing product. My question is threefold : > > 1) What companies use HBase to serve a customer-facing product? I'm not > interested in evaluations, experiments, or POC. I'm also not interested in > offline BI or analytics. I'm specifically interested in cases where HBase > serves as the data store for a customer-facing product. > > 2) Of the companies that use HBase to serve a customer-facing product, > which ones use it to query data sets of 60TB or more? > > 3) Of companies use HBase to query 60+ TB data sets and serve a > customer-facing product, how many employees are required to support their > HBase installation? In other words, if I were to start a team tomorrow, > and their purpose was to maintain a 60+ TB HBase installation for a > customer-facing product, how many people should I hire? > > 4) Of companies use HBase to query 60+ TB data sets and serve a > customer-facing product, what kind of measures do they take for disaster > recovery? > > If you can, please point me to articles, videos, and other materials. > Obviously, the larger the company, the better case it will make for HBase. > > Thank you! > > >
