hive runs slowly

2011-10-21 Thread bangbig
HI all,HIVE runs too slowly when it is doing such things(see the log below), what's the problem? because I'm joining two large table?it runs pretty fast at first. when the job finishes 95%, it begins to slow down.--INFO

Re: hive runs slowly

2011-10-21 Thread john smith
Hi list, I am also facing the same problem. My reducers hang at this position and it takes hours to complete a single reduce task. Can any hive guru help us out with this issue. Thanks, jS 2011/10/21 bangbig lizhongliangg...@163.com HI all, HIVE runs too slowly when it is doing such

Re: hive runs slowly

2011-10-21 Thread Edward Capriolo
On Fri, Oct 21, 2011 at 9:22 AM, john smith js1987.sm...@gmail.com wrote: Hi list, I am also facing the same problem. My reducers hang at this position and it takes hours to complete a single reduce task. Can any hive guru help us out with this issue. Thanks, jS 2011/10/21 bangbig

Re: hive runs slowly

2011-10-21 Thread Edward Capriolo
On Fri, Oct 21, 2011 at 10:21 AM, john smith js1987.sm...@gmail.com wrote: Hi Edward, Thanks for replying. I have been using the query select a,b from a,b where a.id=b.id . According to my knowledge of Hive, it reads data of both A and B and emits join_key,rowid/required row data pairs as

Re: hive runs slowly

2011-10-21 Thread john smith
You mean select a,b from a inner join b on (a.id=b.id) ? or Does those brackets make some difference? Because the inner keyword is no where mentioned in the language manual https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Joins Any hints? On Fri, Oct 21, 2011 at 8:47 PM,