Re: Importing data into Hive

One of similar use case which I worked in , the record timestamp is not guaranteed to arrive in some order. So we used Pig to do some processing similar to what your custom code is doing and after the records are in required order of timestamp we push them to hive. --- Sent from Mobile , s

Importing data into Hive

Hi all, I'm interested in knowing how everyone is importing their data into their production Hive clusters. Let me explain a little more. At the moment, I have log files (which are divided into 5 minute chunks, per event type (of which there are around 10), per server (a few 10s) arriving on one

Re: hive newbie - importing data into hive

Sean, You can refer to http://wiki.apache.org/hadoop/Hive/LanguageManual/DDL#Create.2BAC8-Drop_Table You can define the ROW FORMAT DELIMITED as part of the table definition and then load your data into the table. Thanks and Regards, Sonal Connect Hadoop with d

Re: hive newbie - importing data into hive

Hi Sean, The delimiter used is specified in the create table statement, not the LOAD DATA statement. Kirk On 12/14/2010 08:59 PM, Sean Curtis wrote: thanks Bryan should have been more specific. checked that guide and it didnt seem obvious with LOAD INFILE how to take a file that was alread

Re: hive newbie - importing data into hive

thanks Bryan should have been more specific. checked that guide and it didnt seem obvious with LOAD INFILE how to take a file that was already pipe-delimited and straight import that. is there a section of the doc i may have missed or some tip that can help there? sean On Dec 14, 2010, at 11:

Re: hive newbie - importing data into hive

I'll help by recommending that you get started by looking at the "Getting Started Guide". http://wiki.apache.org/hadoop/Hive/GettingStarted -Bryan On Tue, Dec 14, 2010 at 8:23 PM, Sean Curtis wrote: > just wondering if i have a pipe delimited file, how i can just import this > data into hive

hive newbie - importing data into hive

just wondering if i have a pipe delimited file, how i can just import this data into hive: basically i am using the microlens database, which is pipe separated. for example: user id | age | gender | occupation | zip code translates to 123 | 24 | M | worker | 12345 i'd like to just import th