RE: Querying JSON/Thrift data?

2009-03-06 Thread Stephen Corona
From: Stephen Corona Sent: Friday, March 06, 2009 6:16 PM To: hive-user-subscr...@hadoop.apache.org Subject: Querying JSON/Thrift data? Hey guys, I am currently loading data into Hive in a CSV delimited format. This works but turns out to be a huge pain

Re: Querying JSON/Thrift data?

2009-03-06 Thread Prasad Chakka
Can you use ThriftDeserializer? Look at Complex class to see how it is used. Prasad From: Stephen Corona Reply-To: Date: Fri, 6 Mar 2009 16:02:02 -0800 To: Subject: RE: Querying JSON/Thrift data? From: Stephen

Re: Querying JSON/Thrift data?

2009-03-06 Thread Stephen Corona
;> Date: Fri, 6 Mar 2009 16:02:02 -0800 To: <hive-user@hadoop.apache.org<mailto:hive-user@hadoop.apache.org>> Subject: RE: Querying JSON/Thrift data? From: Stephen Corona Sent: Friday, March 06, 2009 6:16 PM To: hive-user-subscr...@hadoo

RE: Querying JSON/Thrift data?

2009-03-06 Thread Stephen Corona
> ; FAILED: Parse Error: line 2:7 mismatched input 'table' expecting TEMPORARY in create function statement Steve Corona From: Prasad Chakka [pra...@facebook.com] Sent: Friday, March 06, 2009 7:33 PM To: hive-user@hadoop.apache.org Subject: R

RE: Querying JSON/Thrift data?

2009-03-06 Thread Joydeep Sen Sarma
scenario for most people (we haven't gotten around to fixing this yet) -Original Message- From: Stephen Corona [mailto:scor...@adknowledge.com] Sent: Friday, March 06, 2009 8:05 PM To: hive-user@hadoop.apache.org Subject: RE: Querying JSON/Thrift data? I took a look at this clas

RE: Querying JSON/Thrift data?

2009-03-06 Thread Stephen Corona
ords are the "struct" type) in a TFileTransport. Hopefully this makes sense... -Steve From: Joydeep Sen Sarma [jssa...@facebook.com] Sent: Friday, March 06, 2009 11:24 PM To: hive-user@hadoop.apache.org Subject: RE: Querying JSON/Thrift data? can

RE: Querying JSON/Thrift data?

2009-03-06 Thread Joydeep Sen Sarma
m: Stephen Corona [mailto:scor...@adknowledge.com] Sent: Friday, March 06, 2009 8:46 PM To: hive-user@hadoop.apache.org Subject: RE: Querying JSON/Thrift data? The input format can be whatever it needs to be to get it loaded into Hive. I've been googling around all night and havn't really fou

RE: Querying JSON/Thrift data?

2009-03-07 Thread Stephen Corona
t need nested maps/lists. Thanks again! Steve Corona From: Joydeep Sen Sarma [jssa...@facebook.com] Sent: Saturday, March 07, 2009 1:43 AM To: hive-user@hadoop.apache.org Subject: RE: Querying JSON/Thrift data? Yes - it makes complete sense. This is wh

RE: Querying JSON/Thrift data?

2009-03-07 Thread Joydeep Sen Sarma
ailto:scor...@adknowledge.com] Sent: Saturday, March 07, 2009 7:53 AM To: hive-user@hadoop.apache.org Subject: RE: Querying JSON/Thrift data? Thanks for the reply. Would it be possible to add the tfiletransport -> sequencefile process to the hive code base? If so, what type of timeframe would be as

RE: Querying JSON/Thrift data?

2009-03-07 Thread Stephen Corona
: Querying JSON/Thrift data? No process required. Please file a jira - I will try to upload a patch this weekend (just cut'n'paste for most part). Would appreciate some help in finessing it out .. (the internal code is hardwired to some assumptions etc. ) -Original Message- From: Step