Re: Hive Query failing !!!

2015-09-22 Thread Nitin Pawar
Ok Sorry my bad I had overlooked your query that you are doing joins via where clause. On Tue, Sep 22, 2015 at 12:20 PM, @Sanjiv Singh wrote: > Nitin, > > Following setting already there at HIVE. > set hive.exec.mode.local.auto=false; > > Surprisingly , when it did

Re: Hive Query failing !!!

2015-09-22 Thread @Sanjiv Singh
Nitin, Following setting already there at HIVE. set hive.exec.mode.local.auto=false; Surprisingly , when it did following setting , it started working set hive.auto.convert.join=true; can you please help me understand , what had happened ? Regards Sanjiv Singh Mob : +091 9990-447-339

Re: Hive Query failing !!!

2015-09-22 Thread Nitin Pawar
Can you try setting these set hive.exec.mode.local.auto=false; On Tue, Sep 22, 2015 at 11:25 AM, @Sanjiv Singh wrote: > > > *Hi Folks,* > > > *I am running given hive query . it is giving error while executing. > please help me get out of it and understand possible

Re: mapjoin with left join

2015-09-22 Thread Gopal Vijayaraghavan
> select small.* from small s left join large l on s.id = >l.id where l.id is null; ... > We simply want to load the 81K rows in to RAM, then for each row in >large, check the small hash table and if it the row in small is not in >large, then add it to

Re: Transaction deadlocks

2015-09-22 Thread Steve Howard
Hi Eugene, This is HDP 2.3, 1.2.1.2.3.0.0-2557. I see the deadlock count is 10, and we haven't overriden ConfVars.HMSHANDLERATTEMPTS, which also defaults to 10. I am at a loss why the call stack would be that large (I think it is 1,000), as that indicates to me it keeps failing to get the lock

Re: Transaction deadlocks

2015-09-22 Thread Steve Howard
Am I missing it, or do you reset the deadlock count to 0 every time the lock method is taken, so the ten count is never reached in checkRetryable()? public LockResponse lock(LockRequest rqst) throws NoSuchTxnException, TxnAbortedException, MetaException { >>>this.deadlockCnt = 0; <<<

Transaction deadlocks

2015-09-22 Thread Steve Howard
Thread A… "HiveServer2-Background-Pool: Thread-35" #35 prio=5 os_prio=0 tid=0x7fd150e4 nid=0x2c97 runnable [0x7fd146e0a000] java.lang.Thread.State: RUNNABLE at java.net.SocketInputStream.socketRead0(Native Method) at

Re: mapjoin with left join

2015-09-22 Thread Steve Howard
Hi Gopal/All, Yep, I absolutely understand the limitation of what we are trying to do. We will try the settings you suggested. Thanks, Steve On Tue, Sep 22, 2015 at 1:44 PM, Gopal Vijayaraghavan wrote: > > > select small.* from small s left join large l on s.id

Re: Transaction deadlocks

2015-09-22 Thread Eugene Koifman
What version of Hive are you running? In the current codebase at least, TxnHandler.checkRetryable() keeps track of how many retries it allowed – it will not retry forever. From: Steve Howard > Reply-To:

hive ORC wrong number of index entries error

2015-09-22 Thread Patrick Duin
Hi all, I am struggling trying to understand a stack trace I am getting trying to write an ORC file: I am using hive-0.13.0/hadoop-2.4.0. 2015-09-21 09:15:44,603 INFO [main] org.apache.hadoop.mapred.MapTask: Ignoring exception during close for

Error while executing hive Query : org.apache.hadoop.hive.serde2.io.HiveDecimalWritable cannot be cast to org.apache.hadoop.io.IntWritable

2015-09-22 Thread @Sanjiv Singh
Hi Folks, I am running query on hive seems from logs , it is failing because of erroneous record in table [*date_dim*] causing casting exception when I looked for other records in [*date_dim*], nothing different in particular record(see sample records at last) Can you please help me