________________________________________ From: Stephen Corona Sent: Friday, March 06, 2009 6:16 PM To: hive-user-subscr...@hadoop.apache.org Subject: Querying JSON/Thrift data?
Hey guys, I am currently loading data into Hive in a CSV delimited format. This works but turns out to be a huge pain when adding and removing columns (since they can only be added to the end of the table). Is there any way to load and query data that's in some sort of JSON/thrift format? That way the data is already associated with some column and not just in a seemingly arbitrary data format? I am pretty open on which format to use and how to load it into Hive. FWIW, Our data is generated in PHP and pushed to Scribe. Scribe aggregates the CSV files and we load them into Hive every night. Thanks, Steve