Re: Composite blob key mapping in hive

2013-08-01 Thread G.S.Vijay Raajaa
Thanks kulkarni, WIll check the same and reply back ASAP. Regards, Vijay Raajaa G S On Tue, Jul 30, 2013 at 10:27 AM, kulkarni.swar...@gmail.com < kulkarni.swar...@gmail.com> wrote: > Yes. It is possible to do that. The attached patch on the bug adds in a > new HBaseCompositeKey class that c

RE: Hive index error

2013-08-01 Thread Omkar Joshi
Hi Mark, I'm using single node Hive installation with all settings default. Yes, the table is partitioned on the column comp_code. Regards, Omkar Joshi From: Mark Wagner [mailto:wagner.mar...@gmail.com] Sent: Thursday, August 01, 2013 11:15 PM To: user@hive.apache.org Subject: Re: Hive index er

Re: single MR stage for join and group by

2013-08-01 Thread Yin Huai
If the join is a reduce side join, https://issues.apache.org/jira/browse/HIVE-2206 will optimize this query and generate a single MR job. The optimizer introduced by HIVE-2206 is in trunk. Currently, it only handles the same column(s). If the join is a MapJoin, hive 0.11 can generate a single MR j

Re: hive.optimize.skewjoin problem

2013-08-01 Thread Chandraprakash Bhagtani
Thanks Venki.. This is exactly the issue I am facing.. On Fri, Aug 2, 2013 at 4:30 AM, Venki Korukanti wrote: > Looks like there is already a JIRA for this: > https://issues.apache.org/jira/browse/HIVE-4693. It repros in Hive 0.11 > too. > > > On Thu, Aug 1, 2013 at 3:30 AM, Chandraprakash Bhag

Hive Authorization is bypassed with -h option

2013-08-01 Thread Sanjay Subramanian
Hi Hive version 0.9.0 (hive-common-0.9.0-cdh4.1.2.jar) hive.security.authorization.enabled true enable or disable the hive client authorization Linux User = hiveuser1 (no hive permissions) CASE 1 hive -e "select * from outpdir_ptitle_explanation_parsed limit 10" Authorization failed:

Re: Multiple Insert with Where Clauses

2013-08-01 Thread Stephen Sprague
yeah.i agree. that doesn't make any sense. why in the world would the "where clause" not be supported with that syntax? something's rotten in denmark there with your query. what version of hive are you seeing this on? On Tue, Jul 30, 2013 at 9:34 PM, Sha Liu wrote: > Doesn't INSERT INTO do

Re: single MR stage for join and group by

2013-08-01 Thread Stephen Sprague
and what version of hive are you running your test on? i do believe - not certain - that hive 0.11 includes the optimization you seek. On Thu, Aug 1, 2013 at 10:19 AM, Chen Song wrote: > Suppose we have 2 simple tables > > A > id int > value string > > B > id > > When hive translates the follo

Nice hive notes and cheat sheets from Minwoo Kim

2013-08-01 Thread Sanjay Subramanian
http://julingks.tistory.com/category/Hive Thanks sanjay CONFIDENTIALITY NOTICE == This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure

Re: hive.optimize.skewjoin problem

2013-08-01 Thread Venki Korukanti
Looks like there is already a JIRA for this: https://issues.apache.org/jira/browse/HIVE-4693. It repros in Hive 0.11 too. On Thu, Aug 1, 2013 at 3:30 AM, Chandraprakash Bhagtani < cpbhagt...@gmail.com> wrote: > I got some clue on this.. Actually I was running a patched hive, so it was > eating u

Re: Hive index error

2013-08-01 Thread Mark Wagner
Hi Omkar, What Serde does the table use? Given that you're able to index on leg_id it doesn't sound quite the same as the issue I hit. Is there any partitioning of the table? -Mark On Wed, Jul 31, 2013 at 10:39 PM, Omkar Joshi wrote: > I'm facing issues while building an index on multiple col

single MR stage for join and group by

2013-08-01 Thread Chen Song
Suppose we have 2 simple tables A id int value string B id When hive translates the following query select max(A.value), A.id from A join B on A.id = A.id group by A.id; It launches 2 stages, one for the join and one for the group by. My understanding is that if the join key set is a sub set

回复: BUG IN HIVE-4650 seems not fixed

2013-08-01 Thread wzc1989
Hi Yin: Thanks for the patch, I patch it and pass this testcase, I will use it with our hive11 production test. 在 2013年8月1日星期四,上午5:09,Yin Huai 写道: > I just uploaded a patch to https://issues.apache.org/jira/browse/HIVE-4968. > You can try it and see if the problem has been resolved for you

Re: hive.optimize.skewjoin problem

2013-08-01 Thread Chandraprakash Bhagtani
I got some clue on this.. Actually I was running a patched hive, so it was eating up the exception. When i reverted the patch, i see the following exception in either case (query1 and query2) ava.io.FileNotFoundException: File hdfs://mycluster/tmp/hive-training/hive_2013-08-01_03-24-07_554_3719658

hive.optimize.skewjoin problem

2013-08-01 Thread Chandraprakash Bhagtani
Hi, I was facing a weird issue with hive today. I ran the following 2 queries query1: select co.city from company1 co inner join customer1 cu on (co.city=cu.city); query2: select distinct co.city from company1 co inner join customer1 cu on (co.city=cu.city); the difference in both these que