Re: How to change the separator of input reocrd in TRANSFORM of Hive

Oh sorry , I find the solution on wiki: https://cwiki.apache.org/Hive/languagemanual-transform.html by specifying the inrowformat and outrowformat . 2013/5/24 Felix.徐 > Hi all, > > I am trying to use Transform in Hive, but I do not find a way to change > the separator between fields of input re

How to change the separator of input reocrd in TRANSFORM of Hive

Hi all, I am trying to use Transform in Hive, but I do not find a way to change the separator between fields of input records in Transform. I create a table A by specify ROW FORMAT DELIMITED FIELDS TERMINATED BY '\0' However, while using SELECT TRANSFORM(id,name) USING 'python script.py' AS (id,

Re: hive.log

Ok figured it out - vi /etc/hive/conf/hive-log4j.properties - Modify this line #hive.log.dir=/tmp/${user.name} hive.log.dir=/data01/workspace/hive/log/${user.name} From: Sanjay Subramanian mailto:sanjay.subraman...@wizecommerce.com>> Reply-To: "user@hive.apache.org

Requesting Write Access to wiki

Hi, I am Ramayan Tiwari, started working on moving HCatalog wiki to Hive wiki page. Please provide me write access to Apache Hive wiki page. Thanks, - Ramayan

hive.log

How do I set the property in hive-site.xml that defines the local linux directory for hive.log ? Thanks sanjay CONFIDENTIALITY NOTICE == This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged i

Re: Hive tmp logs

Clarification This property defines a file on HDFS hive.exec.scratchdir /data01/workspace/hive scratch/dir/on/local/linux/disk From: Sanjay Subramanian mailto:sanjay.subraman...@wizecommerce.com>> Date: Wednesday, May 22, 2013 12:23 PM To: "user@hive.apache.org

Re: using Avro unions with HIVE

Hi Ran, Unfortunately, there's no real way to manipulate unions in Hive. The Avro SerDe translates Avro unions into Hive unions correctly, but the support for accessing those fields is not there. The exception to this is the [null, T] pattern for nullable fields, which is handled by the Avro SerDe

Re: io.compression.codecs not found

io.compression.codecs org.apache.hadoop.io.compress.DefaultCodec,org.apache.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.BZip2Codec,org.apache.hadoop.io.compress.SnappyCodec From: "bejoy...@yahoo.com" mailto:bejoy...@yahoo.com>> Reply-To: "user@hive.a

Re: Snappy with HIve

Thanks Bejoy…I tracked down the issue..there was an earlier table (with leo definition) that I had not dropped and recreated - hence giving input snappy to that was giving issues Regards sanjay From: "bejoy...@yahoo.com" mailto:bejoy...@yahoo.com>> Reply-To: "user@hiv

Re: io.compression.codecs not found

These are the default, add snappy as well along io.compression.codecs org.apache.hadoop.io.compress.DefaultCodec,org.apache.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.BZip2Codec Regards Bejoy KS Sent from remote device, Please excuse typos -Original Message- Fr

Re: Snappy with HIve

Hi Please find responses below. Do I have to give some INPUTFORMAT directive to make the Hive Table read Snappy Codec files ? For example for LZO its STORED AS INPUTFORMAT "com.hadoop.mapred.DeprecatedLzoTextInputFormat" Bejoy : No custom input format required. Add the snappy codec in io.compr

Re: io.compression.codecs not found

Hi Bejoy, Thanks for the reply. I would like to know "what" are the codecs that are available by default in the Hadoop system, among which i can choose to set in the core-site.xml. For ex: LZO compression codecs are not available by default and we have to install the required libraries for it. T

Re: io.compression.codecs not found

Go to $HADOOP_HOME/config open and edit core-site.xml Add a new property 'io.compression.codecs' and assign the required compression codecs as its value. Regards Bejoy KS Sent from remote device, Please excuse typos -Original Message- From: Sachin Sudarshana Date: Thu, 23 May 2013 19

Re: io.compression.codecs not found

Hi, I'm not using CM. I have installed CDH 4.2.1 using Linux packages. Thank you, Sachin On Thu, May 23, 2013 at 7:13 PM, Sanjay Subramanian < sanjay.subraman...@wizecommerce.com> wrote: > This property needs to be set in core-site.xml. If u r using > clouderamanager then ping me I will tell u

Re: io.compression.codecs not found

This property needs to be set in core-site.xml. If u r using clouderamanager then ping me I will tell u how to set it there. Out of the box hive works beautifully with gzip and snappy. And if u r using lzo then needs some plumbing. Depends on what ur usecase is I can provide guidance. Regards

Re: Hive skipping first line

Since you have a text file, have you visually inspected the first few lines to make sure there's nothing unusual, like a missing line feed, field separator, or anything like that? The missing line feed would be my first suspicion. Just because you're paranoid doesn't mean Pig isn't out to get you!

io.compression.codecs not found

Hi, I'm trying to run some queries on compressed tables in Hive 0.10. I wish to know what all compression codecs are available which i can make use of. However, when i run set io.compression.codecs in the hive CLI, it throws an error saying the io.compression.codecs is not found. I'm unable to fi

AW: Hive skipping first line

Excuting "hive -e select * from tablename" gives me back all my sample rows without skipping one Thanks Tim Von: Sanjay Subramanian [mailto:sanjay.subraman...@wizecommerce.com] Gesendet: Mittwoch, 22. Mai 2013 19:16 An: user@hive.apache.org Betreff: Re: Hive skipping first line Can u