Thanks I will check this out. Any other examples/documentation would be helpful. I've been looking on the wiki but anything that mentions thrift is pretty sparse
Steve C Sent from my iPhone On Mar 6, 2009, at 7:33 PM, "Prasad Chakka" <pra...@facebook.com<mailto:pra...@facebook.com>> wrote: Can you use ThriftDeserializer? Look at Complex class to see how it is used. Prasad ________________________________ From: Stephen Corona <<scor...@adknowledge.com>scor...@adknowledge.com<mailto:scor...@adknowledge.com>> Reply-To: <<hive-user@hadoop.apache.org>hive-user@hadoop.apache.org<mailto:hive-user@hadoop.apache.org>> Date: Fri, 6 Mar 2009 16:02:02 -0800 To: <<hive-user@hadoop.apache.org>hive-user@hadoop.apache.org<mailto:hive-user@hadoop.apache.org>> Subject: RE: Querying JSON/Thrift data? ________________________________________ From: Stephen Corona Sent: Friday, March 06, 2009 6:16 PM To: <hive-user-subscr...@hadoop.apache.org> hive-user-subscr...@hadoop.apache.org<mailto:hive-user-subscr...@hadoop.apache.org> Subject: Querying JSON/Thrift data? Hey guys, I am currently loading data into Hive in a CSV delimited format. This works but turns out to be a huge pain when adding and removing columns (since they can only be added to the end of the table). Is there any way to load and query data that's in some sort of JSON/thrift format? That way the data is already associated with some column and not just in a seemingly arbitrary data format? I am pretty open on which format to use and how to load it into Hive. FWIW, Our data is generated in PHP and pushed to Scribe. Scribe aggregates the CSV files and we load them into Hive every night. Thanks, Steve
