Re: read a Hive Map without knowing keys

2014-03-18 Thread Szehon Ho
You can try to check other string udf's for that case, here https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF , they will be in the section on string functions. Thanks Szehon On Mon, Mar 17, 2014 at 5:06 PM, Frank Luo wrote: > That is helpful, Thx! > > > > More dumb question

Re: read a Hive Map without knowing keys

2014-03-18 Thread Lefty Leverenz
> What is "select *?" ? I think he just meant "select *" and ended the suggestion with a question mark. Admittedly, "select *?" looks like syntax with an extra wildcard. -- Lefty On Tue, Mar 18, 2014 at 3:07 AM, Szehon Ho wrote: > You can try to check other string udf's for that case, here

Re: read a Hive Map without knowing keys

2014-03-18 Thread Szehon Ho
Yes Lefty is completely right, the sentence unfortunately came out like some strange regex. Thanks Szehon On Tue, Mar 18, 2014 at 12:29 AM, Lefty Leverenz wrote: > > What is "select *?" ? > > I think he just meant "select *" and ended the suggestion with a question > mark. > > Admittedly, "sel

RE: org.apache.hadoop.hive.metastore.HiveMetaStoreClient with webhcat REST

2014-03-18 Thread Peter Marron
Hi, I'm reluctant to answer this as I am very far from knowledgeable about this. However the error that you're getting looks the one that I always get when I do not have a hive server running. I think that your hcat commands can be serviced without a hive server, but that your failing command cann

Re: BinarySortableSerde not working with TextInputFormat

2014-03-18 Thread twinkle sachdeva
You are trying to use BinarySortableSerDe as deserialization protocol on top of Text input format. Please correct one of these. On Wed, Mar 12, 2014 at 4:59 AM, Vaibhav Jain wrote: > Hi, > > I have a table created by the following query > > CREATE EXTERNAL TABLE IF NOT EXISTS partition_table (pa

Re: additional hive functions

2014-03-18 Thread twinkle sachdeva
Thanks for sharing the link. On Thu, Mar 13, 2014 at 2:50 AM, Stephen Sprague wrote: > just a public service announcement. > > I had a case where i had a nested json array in a string and i needed that > to act like a first class array in hive. natively, you can pull it out but > it'll just a s

RE: read a Hive Map without knowing keys

2014-03-18 Thread Frank Luo
I think I figured out. I can get map keys as an array then use concat_ws(string SEP, array) to convert the array to a string, then I can use instr(string str, string substr) to test if a substring exists or not. From: Szehon Ho [mailto:sze...@cloudera.com] Sent: Tuesday, March 18, 2014 2:08 AM T

Trouble with transform and dynamic partitions into table with custom field delimiters.

2014-03-18 Thread Nurdin Premji
Hello, I'm having trouble with loading data into a table with a dynamic partition with custom field delimiters. When I use tabs, it works, when I have fields delimited by '001' it does not. I'm using hive 0.10 on top of hadoop 2.0.0-cdh4.6.0 Here is some example code I was trying: create ex

Re: Trouble with transform and dynamic partitions into table with custom field delimiters.

2014-03-18 Thread Nurdin Premji
I figured out my problem, I wasn't using the outRowFormat section when calling the transform. I had tried with a row format, but I guess I put it in the inRowFormat section which had changed the way the data was passed to my transform function and thought that there was only one place to speci

Re: Trouble with transform and dynamic partitions into table with custom field delimiters.

2014-03-18 Thread Stephen Sprague
but why go through all this and make it so long-winded, verbose and non-standard? That's a pain to maintain! just use tabs as your transform in/out separator and go easy on the next guy who has to maintain your code. :) On Tue, Mar 18, 2014 at 4:59 PM, Nurdin Premji < nurdin.pre...@casalemedia.