RE: read a Hive Map without knowing keys

2014-03-17 Thread Frank Luo
That is helpful, Thx! More dumb questions. What is "select *?" ? Also, any hints on how to find whether the map_keys contains a substring? For example, supposing the map_keys contains emails, I want to see if one of the emails contains "gmail.com". From: Szehon Ho [mailto:sze...@cloudera.com]

Call for papers: Big Data track - ICAC'14 by USENIX/ACM

2014-03-17 Thread Dani Rayan
Join us for the 11th International Conference on Autonomic Computing - Sponsored by USENIX in corporation with ACM Call for Papers for Management of Big Data (MBDS) track is open. Submit your short paper or panel presentation by *March 31, 2014, 11:59 p.m. PDT.* The objective of the MBDS track at

Re: read a Hive Map without knowing keys

2014-03-17 Thread Szehon Ho
Select *? There are other built-in functions like map_keys and map_values you can use in queries on maps. Not sure if this addresses the question. Thanks Szehon On Mon, Mar 17, 2014 at 3:05 PM, Frank Luo wrote: > Is there a way to read Hive Map datatype without knowing keys? > > > > Accordi

Re: org.apache.hadoop.hive.metastore.HiveMetaStoreClient with webhcat REST

2014-03-17 Thread Adam Silberstein
Hi, Didn't get any answers on this, trying one more time. Thanks, Adam On Mar 14, 2014, at 9:50 AM, Adam Silberstein wrote: > Hi, > I'm testing out the REST interface to webhcat and stuck doing basic DDL > operations. > > Background on installation: > --I installed packages with apt-get > --I

read a Hive Map without knowing keys

2014-03-17 Thread Frank Luo
Is there a way to read Hive Map datatype without knowing keys? According to Hive document, the only way to read a Map is to access through keys, ie: myMap['myKey']. However, in many cases, the keys are unknown, for example, HTable sparse columns, so in that kind of situation, what is the ways

Re: the php client seems to be broken

2014-03-17 Thread Jeremy
I have been researching for a week now on how to use the PHP hive client. https://cwiki.apache.org/confluence/display/Hive/HiveClient#HiveClient-PHP but the |$GLOBALS||[||'THRIFT_ROOT'||] = ||'/lib/php/'||; is broken. |one thing is the autoloader is no generated properly. second packages/hive_servi

Re: Writing data to LOCAL with Hive Server2

2014-03-17 Thread Kumar V
Stephen,    Thanks for your reply.  I won't be given login access to the host. I cannot run 'hdfs dfs -get' since my host is not a gateway and does not have direct access to HDFS.  Also, I can't run hive CLI since it is not installed on my host !! Finally, to circumvent all these problems, I tr

the php client seems to be broken

2014-03-17 Thread Jeremy
I am trying to use the php hive thift client and there is name space and autoload issues. Autoload is not generated and I have not found any instructions how to properly generate it. Also some files contain namespace; which is a syntax issue. Is any one aware of these issues and know how to fix the

Re: running out of memory with orc

2014-03-17 Thread Prasanth Jayachandran
Try setting table properties “orc.compress.size” to lesser value. Default is 256KB. Thanks Prasanth Jayachandran On Mar 17, 2014, at 8:12 AM, Saltys, Zilvinas wrote: > Hi, > > My write queries using ORC keep dying with out of memory errors. Sample query: > insert overwrite table test_orc_sma

running out of memory with orc

2014-03-17 Thread Saltys, Zilvinas
Hi, My write queries using ORC keep dying with out of memory errors. Sample query: insert overwrite table test_orc_small select * from test_orc_billion where date = '2014-03-14'; Hive version is 0.11 .. Error looks like this: Diagnostic Messages for this Task: Container [pid=29685,containerID=