Re: What companies are using HBase to serve a customer-facing product?

2014-12-06 Thread Jack Levin
We at Imageshack use Hbase to store all of our images, currently at ~2bl rows with about 350+ TB. Jack On Friday, December 5, 2014, iain wright iainw...@gmail.com wrote: Hi Jeremy, pinterest is using it for their feeds: http://www.slideshare.net/cloudera/case-studies-session-3a

Re: What companies are using HBase to serve a customer-facing product?

2014-12-06 Thread lars hofhansl
For expected latency, read this: http://hadoop-hbase.blogspot.com/2014/08/hbase-client-response-times.htmlFor cluster/machine sizing this might be helpful: http://hadoop-hbase.blogspot.com/2013/01/hbase-region-server-memory-sizing.html  Disclaimer: I wrote these two posts. -- Lars From:

Re: What companies are using HBase to serve a customer-facing product?

2014-12-06 Thread Bryan Beaudreault
At HubSpot we have 5 customer facing production clusters 30-60TB+ each. Our Data Ops team has ranged from 2-3 (including me), but we support much more than just hbase. We have an in-house built nightly backup system and persist all HLogs on an ongoing basis, so in 2-3 hours we can recover to

Re: What companies are using HBase to serve a customer-facing product?

2014-12-06 Thread Pradeep Gollakota
Lithium (Klout) powers www.klout.com with HBase. The operations team is 2 full time engineers + the manager (who also does hands on operations work with the team). This operations team is responsible for the entirety of our Hadoop stack including the HBase clusters. We have one 165 node Hive

What companies are using HBase to serve a customer-facing product?

2014-12-05 Thread jeremy p
Hey all, So, I'm currently evaluating HBase as a solution for querying a very large data set (think 60+ TB). We'd like to use it to directly power a customer-facing product. My question is threefold : 1) What companies use HBase to serve a customer-facing product? I'm not interested in

Re: What companies are using HBase to serve a customer-facing product?

2014-12-05 Thread Sean Busbey
Hi Jeremy! We'll probably need more information to answer your questions. In particular, what kind of read or write SLA are you looking to meet? At what scale of concurrent users? What size of retrievals? Normally, customer facing application means something in the human interactive time scale,

Re: What companies are using HBase to serve a customer-facing product?

2014-12-05 Thread Ted Yu
Please see the following: Facebook messages: https://www.facebook.com/notes/facebook-engineering/the-underlying-technology-of-messages/454991608919 https://www.facebook.com/UsingHbase https://www.facebook.com/download/499785426741400/Storage%20Infrastructure%20Behind%20Facebook%20Messages%20.pdf

Re: What companies are using HBase to serve a customer-facing product?

2014-12-05 Thread Esteban Gutierrez
The folks from Gap have a really nice use case: http://www.slideshare.net/cloudera/1-serving-apparel-catalog-from-h-base-suraj-varma-gap-inc-finalupdated-last-minute -- Cloudera, Inc. On Fri, Dec 5, 2014 at 2:01 PM, Ted Yu yuzhih...@gmail.com wrote: Please see the following: Facebook

Re: What companies are using HBase to serve a customer-facing product?

2014-12-05 Thread iain wright
Hi Jeremy, pinterest is using it for their feeds: http://www.slideshare.net/cloudera/case-studies-session-3a http://www.slideshare.net/cloudera/operations-session-1 Not sure on their dataset size, they are doing cluster level replication for DR. We based our architecture on their success