Definitely Raja, but looks like the one for zip is blocked for some time now
https://issues.apache.org/jira/browse/MAPREDUCE-210
Regards
Bejoy KS
> Date: Sun, 30 Sep 2012 12:41:29 -0700
> Subject: Re: zip file or tar file cosumption
> From: thiruvath...@gmail.com
> To: user@hiv
we can write custom codecs
On Sun, Sep 30, 2012 at 11:47 AM, Bejoy KS wrote:
> Yes Manish, Zip is not supported in hadoop. You may have to use gzip
> instead.
>
> Regards
> Bejoy KS
>
>
> ____
> Subject: RE: zip file or tar file
Yes Manish, Zip is not supported in hadoop. You may have to use gzip
instead.Regards
Bejoy KS
Subject: RE: zip file or tar file cosumption
From: manishbh...@rocketmail.com
To: user@hive.apache.org
CC: chuck.conn...@nuance.com
Date: Sun, 30 Sep 2012 20:35:35 +0530
Thanks Bejoy. I have
equisite.
>
>
>
> Regards
> Bejoy KS
>
>
>
>
>
> __
> To: user@hive.apache.org; keshav.c.sav...@fisglobal.com
> Subject: Re: zip file or tar file cosumption
> From: manishbh...@rocketmail.com
> Da
a prerequisite.
RegardsBejoy KS
To: user@hive.apache.org; keshav.c.sav...@fisglobal.com
Subject: Re: zip file or tar file cosumption
From: manishbh...@rocketmail.com
Date: Sun, 30 Sep 2012 12:32:15 +
What about .gz OR tar file. Does this unzip require at HDFS and load into hive?
How you re
y-To: user@hive.apache.org
Subject: RE: zip file or tar file cosumption
I have seen that error when I try to overwrite an existing file.
But, more importantly, Hive cannot understand ZIP files. There was a long
thread about this just a few days ago. Your table def says "stored as textfile"
but you
le.
Chuck
From: Manish [manishbh...@rocketmail.com]
Sent: Sunday, September 30, 2012 7:38 AM
To: Savant, Keshav
Cc: user@hive.apache.org
Subject: RE: zip file or tar file cosumption
I am getting below error when loading zip file
Driver returned: 9. Errors: Hive history
fil
> >
> > Keshav C Savant
> >
> >
> >
> >
> > From: Manish.Bhoge [mailto:manish.bh...@target.com]
> > Sent: Thursday, September 27, 2012 4:26 PM
> > To: user@hive.apache.org; manishbh...@rocketmail.com
> > Subject: RE: zip file o
Manish
On Thu, 2012-09-27 at 11:11 +, Savant, Keshav wrote:
> True Manish.
>
>
>
> Keshav C Savant
>
>
>
>
> From: Manish.Bhoge [mailto:manish.bh...@target.com]
> Sent: Thursday, September 27, 2012 4:26 PM
> To: user@hive.apache.org; manishbh.
True Manish.
Keshav C Savant
From: Manish.Bhoge [mailto:manish.bh...@target.com]
Sent: Thursday, September 27, 2012 4:26 PM
To: user@hive.apache.org; manishbh...@rocketmail.com
Subject: RE: zip file or tar file cosumption
Thanks Savant. I believe this will hold good for .zip file also.
Thank
Thanks Savant. I believe this will hold good for .zip file also.
Thank You,
Manish.
From: Savant, Keshav [mailto:keshav.c.sav...@fisglobal.com]
Sent: Thursday, September 27, 2012 10:19 AM
To: user@hive.apache.org; manishbh...@rocketmail.com
Subject: RE: zip file or tar file cosumption
Manish
hese files, for example
load data local inpath 'path-to-csv-file.gz' into table my_table_zip;
hope this helps
Keshav C Savant
From: Manish Bhoge [mailto:manishbh...@rocketmail.com]
Sent: Wednesday, September 26, 2012 9:43 PM
To: user@hive.apache.org
Subject: Re: zip file or tar file c
e.org
Subject: RE: zip file or tar file cosumption
You are right Chuck. I thought his question was how to use zip files or any
compressed files in Hive tables.
Yeah, seems like you can't do that see:
http://mail-archives.apache.org/mod_mbox/hive-user/201203.mbox/%3CCAENxBwxkF--3P
t you can always compress your files in gzip format and they should be good
to go.
Richin
From: ext Connell, Chuck [mailto:chuck.conn...@nuance.com]
Sent: Wednesday, September 26, 2012 10:44 AM
To: user@hive.apache.org
Subject: RE: zip file or tar file cosumption
But TEXTFILE in Hive always has ne
, MA
From: richin.j...@nokia.com<mailto:richin.j...@nokia.com>
[mailto:richin.j...@nokia.com]
Sent: Wednesday, September 26, 2012 10:14 AM
To: user@hive.apache.org<mailto:user@hive.apache.org>;
manishbh...@rocketmail.com<mailto:manishbh...@rocketmail.com>
Subject: RE: zip file or t
nesday, September 26, 2012 9:13 AM
To: user@hive.apache.org
Subject: Re: zip file or tar file cosumption
Hi Savant,
Got it. But I still need to understand that how to load zip? Can I directly use
zip file in external table. can u pls help to get the load statement.
Sent from my BlackBe
To: user@hive.apache.org
Reply-To: user@hive.apache.org
Cc: manish.bh...@target.com;
chuck.conn...@nuance.com
Subject: RE: zip file or tar file cosumption
Another solution would be
Using shell script do following
1. unzip txt files,
2. one by one merge those 50 (or N number of)
Savant
From: Connell, Chuck [mailto:chuck.conn...@nuance.com]
Sent: Wednesday, September 26, 2012 4:04 PM
To: user@hive.apache.org
Subject: RE: zip file or tar file cosumption
This could be a problem. Hive uses newline as the record separator. A ZIP file
will certainly newline characters. So I doubt
er type of
compressed file.
Chuck
From: Manish.Bhoge [manish.bh...@target.com]
Sent: Wednesday, September 26, 2012 3:17 AM
To: user@hive.apache.org
Subject: zip file or tar file cosumption
Hivers,
I want to understand that would it be possible to utilize zip
Hivers,
I want to understand that would it be possible to utilize zip/tar files
directly into Hive. All the files has similar schema (structure). Say 50 *.txt
files are zipped into a single zip file can we load data directly from this zip
file OR should we need to unzip first?
Thanks & Regard
20 matches
Mail list logo
