Introducing Parquet: efficient columnar storage for Hadoop

2013-03-13 Thread Jarek Jarcec Cecho
Fellow Hive users, We'd like to introduce a joint project between Twitter and Cloudera engineers -- a new columnar storage format for Hadoop called Parquet [1]. Official announcement is available on Cloudera blog [2]. Parquet is designed to bring efficient columnar storage to Hadoop. Compared to

Re: Add external jars automatically

2013-03-13 Thread Krishna Rao
Ah great, the auxlib dir option sounds perfect. Cheers On 13 March 2013 17:41, Alex Kozlov wrote: > If you look into ${HIVE_HOME}/bin/hive script there are multiple ways to > add the jar. One of my favorite, besides the .hiverc file, has been to put > the jar into ${HIVE_HOME}/auxlib dir. Th

Re: Add external jars automatically

2013-03-13 Thread Alex Kozlov
If you look into ${HIVE_HOME}/bin/hive script there are multiple ways to add the jar. One of my favorite, besides the .hiverc file, has been to put the jar into ${HIVE_HOME}/auxlib dir. There always is the HIVE_AUX_JARS_PATH environment variable (but this introduces a dependency on the environmen

Add external jars automatically

2013-03-13 Thread Krishna Rao
Hi all, I'm using the hive json serde and need to run: "ADD JAR /usr/lib/hive/lib/hive-json-serde-0.2.jar;", before I can use tables that require it. Is it possible to have this jar available automatically? I could do it via adding the statement to a .hiverc file, but I was wondering if there is

Exporting hive table data into oracle give date format error

2013-03-13 Thread Ajit Kumar Shreevastava
Hi All, Can you please let me know how can I bypass this error. I am currently using Apache SQOOP version 1.4.2. [hadoop@NHCLT-PC44-2 sqoop-oper]$ sqoop export --connect jdbc:oracle:thin:@10.99.42.11:1521/clouddb --username HDFSUSER --table BTTN_BKP_TEST --export-dir /home/hadoop/user/hive