Re: hive multiple inserts

hi, I've tested branch 0.5 rev 903141. The sql runs as expected. Thx. I can't compile trunk version, so haven't test it. 2010/1/12 Ning Zhang > HIVE-1039 is created for the bug when inserting to multiple local > directories. > > Thanks, > Ning > On Jan 11, 2010, at 11:05 AM, Zheng Shao wrote: >

Re: hive multiple inserts

To: hive-user@hadoop.apache.org > Subject: Re: hive multiple inserts > > It should be a bug of hive. see below > > hive> set hive.merge.mapfiles=true; > hive> explain from netflix insert overwrite table t1 select movie_id > insert overwrite table t2 select user_id; >

RE: hive multiple inserts

Which version are you using ? The bug mentioned was fixed by: https://issues.apache.org/jira/browse/HIVE-1039 Thanks, -namit -Original Message- From: Min Zhou [mailto:coderp...@gmail.com] Sent: Thursday, January 21, 2010 12:40 AM To: hive-user@hadoop.apache.org Subject: Re: hive

Re: hive multiple inserts

It should be a bug of hive. see below hive> set hive.merge.mapfiles=true; hive> explain from netflix insert overwrite table t1 select movie_id insert overwrite table t2 select user_id; OK ABSTRACT SYNTAX TREE: (TOK_QUERY (TOK_FROM (TOK_TABREF netflix)) (TOK_INSERT (TOK_DESTINATION (TOK_TAB t1))

Re: hive multiple inserts

https://issues.apache.org/jira/browse/HIVE-634 As far as I know there is nobody working on that right now. If you are interested, we can work together on that. Let's move the discussion to the JIRA. Zheng On Tue, Jan 12, 2010 at 3:27 AM, Anty wrote: > Thanks Zheng. > We have used RegexSerDe in

Re: hive multiple inserts

Thanks Zheng. We have used RegexSerDe in some use cases, but the speed is indeed slower, so we don't want to use regular expression if not necessary. yes, we have used RegexSerDe in some use cases. I found HIVE-634 is what i need ,allowing for the

Re: hive multiple inserts

Yes we only support one-byte delimiter for performance reasons. You can use the RegexSerDe in the contrib package for any row format that allows a regular expression (including your case "<>"), but the speed will be slower. Zheng On Mon, Jan 11, 2010 at 5:54 PM, Anty wrote: > Thanks Zheng. > I

Re: hive multiple inserts

Thanks Zheng. It does works. I have a another question,if the field delimiter is a string ,e.g. "<>",it looks like the LazySimpleSerDe can't works.Does the LazySimpleSerDe didn't support string field delimiter,only one byte of control characters? On Tue, Jan 12, 2010 at 3:05 AM, Zheng Shao wrote:

Re: hive multiple inserts

HIVE-1039 is created for the bug when inserting to multiple local directories. Thanks, Ning On Jan 11, 2010, at 11:05 AM, Zheng Shao wrote: > For your second question, currently we can do it with a little extra work: > 1. Create an external table on the target directory with the field > delimite

Re: hive multiple inserts

For your second question, currently we can do it with a little extra work: 1. Create an external table on the target directory with the field delimiter you want; 2. Run the query and insert overwrite the target external table. For the first question we can also do the similar thing (create a bunch

Re: hive multiple inserts

HI: I came across the same problean, therein is no data.I have one more question,can i specify the field delimiter for the output file,not just the default ctrl-a field delimiter? On Fri, Jan 8, 2010 at 2:23 PM, wd wrote: > hi, > > I'v tried use hive svn version, seems this bug still exists.

Re: hive multiple inserts

hi, I'v tried use hive svn version, seems this bug still exists. svn st -v 896805 896744 namit. 896805 894292 namiteclipse-templates 896805 894292 namiteclipse-templates/.classpath 896805 765509 zshao eclipse-templates/Te

Re: hive multiple inserts

hi, Single insert can extract data into '/tmp/out/1'.I even can see "xxx rows loaded to '/tmp/out/0', xxx rows loaded to '/tmp/out/1'...etc in multi inserts, but there is no data in fact. Havn't try svn revision, will try it today.thx. 2010/1/5 Zheng Shao > Looks like a bug. > What is the svn

Re: hive multiple inserts

Looks like a bug. What is the svn revision of Hive? Did you verify that single insert into '/tmp/out/1' produces non-empty files? Zheng On Tue, Jan 5, 2010 at 12:51 AM, wd wrote: > In hive wiki: > > Hive extension (multiple inserts): > FROM from_statement > INSERT OVERWRITE [LOCAL] DIRECTORY di