Re: limit clause + fetch optimization

2015-07-22 Thread Adam Silberstein
Thanks Gopal. I filed an issue to cover JDBC+setMaxRows: https://issues.apache.org/jira/browse/HIVE-11342 For your first offer of testing a patch, unfortunately we tend to run our production software on customers' Hadoop clusters, so we can't easily patch their Hive instances. But I'll still tak

Re: limit clause + fetch optimization

2015-07-21 Thread Adam Silberstein
Thanks for the quick answer Gopal, and also for the details on that param. I indeed use JDBC in production, so will stay away from it. Just want to make sure I understand the behavior once that bug is fixed...a 'select *' with no limit will run without a M/R job and instead stream. Is that correc

limit clause + fetch optimization

2015-07-21 Thread Adam Silberstein
Hi, I've been experimenting with 'select *' and 'select * limit X' in beeline and watching the hive-server2 log to understand when a M/R job is triggered and when not. It seems like whenever I set a limit, the job is avoided, but with no limit, it is run. I found this param: hive.limit.optimize.f

DDL stmt for showing views only

2015-06-23 Thread Adam Silberstein
Hey All, Is there a DDL command like 'SHOW TABLES' that returns only the tables or only the views so they can be differentiated? Apologies if this has been answered, I see the question but no great answers. BTW, know how to get this with per-table DDL calls, but hoping to get the whole list with

Re: org.apache.hadoop.hive.metastore.HiveMetaStoreClient with webhcat REST

2014-03-17 Thread Adam Silberstein
Hi, Didn't get any answers on this, trying one more time. Thanks, Adam On Mar 14, 2014, at 9:50 AM, Adam Silberstein wrote: > Hi, > I'm testing out the REST interface to webhcat and stuck doing basic DDL > operations. > > Background on installation: > --I ins

org.apache.hadoop.hive.metastore.HiveMetaStoreClient with webhcat REST

2014-03-14 Thread Adam Silberstein
Hi, I'm testing out the REST interface to webhcat and stuck doing basic DDL operations. Background on installation: --I installed packages with apt-get --I'm on CDH4.5 I successfully have created and loaded tables with chat command line. E.g.:hcat -e 'create table testtable (a string, b string