Questions related to HBase general use

2015-05-07 Thread java8964
Hi, I am kind of new to HBase. Currently our production run IBM BigInsight V3, comes with Hadoop 2.2 and HBase 0.96.0. We are mostly using HDFS and Hive/Pig for our BigData project, it works very good for our big datasets. Right now, we have a one dataset needs to be loaded from Mysql, about 10

Re: Questions related to HBase general use

2015-05-10 Thread Jerry He
Hi, Yong You have a good understanding of the benefit of HBase already. Generally speaking, HBase is suitable for real time read/write to your big data set. Regarding the HBase performance evaluation tool, the 'read' test use HBase 'get'. For 1m rows, the test would issue 1m 'get' (and RPC) to the

Re: Questions related to HBase general use

2015-05-13 Thread Nick Dimiduk
+ Swarnim, who's expert on HBase/Hive integration. Yes, snapshots may be interesting for you. I believe Hive can access HBase timestamps, exposed as a "virtual" column. It's assumed across there whole row however, not per cell. On Sun, May 10, 2015 at 9:14 PM, Jerry He wrote: > Hi, Yong > > You

Re: Questions related to HBase general use

2015-05-13 Thread Krishna Kalyan
I know that BigInsights comes with BigSQL which interacts with HBase as well, have you considered that option. We have a similar use case using BigInsights 2.1.2. On Thu, May 14, 2015 at 4:56 AM, Nick Dimiduk wrote: > + Swarnim, who's expert on HBase/Hive integration. > > Yes, snapshots may be

Re: Questions related to HBase general use

2015-05-14 Thread kulkarni.swar...@gmail.com
+ hive-dev Thanks for your question. We recently have been busy adding quite a few features on top on Hive/HBase Integration to make it more stable and easy to use. We also did a talk very recently at HBaseCon 2015 showing off the latest improvements. Slides here[1]. Like Jerry mentioned, if you r