Re: Performance: hive+hbase integration query against the row_key

2012-09-12 Thread Bejoy KS
apache.org Subject: Re: Performance: hive+hbase integration query against the row_key   Hi Ashok   'LOAD DATA INPATH ..' issues a hdfs move under the hood, that is why the original data in hdfs is not present after the load operation. If you want to preserve the data in some hdfs location a

RE: Performance: hive+hbase integration query against the row_key

2012-09-12 Thread ashok.samal
ernal table and point it to the required hdfs location. Regards, Bejoy KS From: "ashok.sa...@wipro.com" To: user@hive.apache.org Sent: Wednesday, September 12, 2012 8:55 AM Subject: RE: Performance: hive+hbase integration query against the row_key after l

Re: Performance: hive+hbase integration query against the row_key

2012-09-12 Thread Bejoy KS
uired hdfs location.    Regards, Bejoy KS From: "ashok.sa...@wipro.com" To: user@hive.apache.org Sent: Wednesday, September 12, 2012 8:55 AM Subject: RE: Performance: hive+hbase integration query against the row_key after loading the data into hi

RE: Performance: hive+hbase integration query against the row_key

2012-09-11 Thread ashok.samal
integration query against the row_key On Sep 11, 2012, at 7:00 AM, bharath vissapragada wrote: > Hey, > > Hive does all kinds of parsing , metadata lookups, query tree building and > stuff before executing the query. Not sure if this all was included in those > 36 seconds ! > > A

Re: Performance: hive+hbase integration query against the row_key

2012-09-11 Thread Alan Gates
On Sep 11, 2012, at 7:00 AM, bharath vissapragada wrote: > Hey, > > Hive does all kinds of parsing , metadata lookups, query tree building and > stuff before executing the query. Not sure if this all was included in those > 36 seconds ! > > Also what hive does is, it builds a scan object wi

Re: Performance: hive+hbase integration query against the row_key

2012-09-11 Thread bharath vissapragada
Hey, Hive does all kinds of parsing , metadata lookups, query tree building and stuff before executing the query. Not sure if this all was included in those 36 seconds ! Also what hive does is, it builds a scan object with ranges based on predicates (and mappers too ) on key column and not a dire

Performance: hive+hbase integration query against the row_key

2012-09-11 Thread Shengjie Min
Hi, I am trying to get hive working on top of my hbase table following the guide below: https://cwiki.apache.org/Hive/hbaseintegration.html CREATE EXTERNAL TABLE hive_hbase_test (key string, a string, b string, c string) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPE