Tez Hive Job failing during initialization

2015-01-15 Thread peterm_second
Hi Guys, I am running a docker based hadoop cluster, with hive 0.14 and tez 0.6 I've had successfully managed to make my setup work before, I've increased the input data to my jobs and now I get this exception : 2015-01-15 14:56:32,872 ERROR [HistoryEventHandlingThread]

Re: Hive being slow

2015-01-15 Thread Ashutosh Chauhan
which hive version you are using ? On Thu, Jan 15, 2015 at 12:44 AM, Abhishek kumar abhishekiit...@gmail.com wrote: Hi, Thanks for the reply. I tried that, but no luck. The map-reduce seems to be stuck (taking a lot of time, just for 65 lakhs of Hbase rows). I am attaching the log file (or

Re: NegativeArraySizeException in table join

2015-01-15 Thread Ashutosh Chauhan
Seems like you are hitting into : https://issues.apache.org/jira/browse/HIVE-9324 On Thu, Jan 15, 2015 at 1:53 AM, Guodong Wang wangg...@gmail.com wrote: Hi, I am using hive 0.13.1 and currently I am blocked by a bug when joining 2 tables. Here is the sample query. INSERT OVERWRITE TABLE

Re: Hive being slow

2015-01-15 Thread Abhishek kumar
0.14.0 -- Abhishek On Thu, Jan 15, 2015 at 10:43 PM, Ashutosh Chauhan hashut...@apache.org wrote: which hive version you are using ? On Thu, Jan 15, 2015 at 12:44 AM, Abhishek kumar abhishekiit...@gmail.com wrote: Hi, Thanks for the reply. I tried that, but no luck. The map-reduce

date_add statement problem

2015-01-15 Thread Yashwanth M
Hi, I've been facing some issues in using date_add() I have column 'day_key' that is short integer and stores day keys with respect to 1985/01/01. I need to extract actual date from this column. Date_add('1985/01/01',day_key) However I get an error saying the second argument needs integer.

Load columns changed name

2015-01-15 Thread Patcharee Thongtra
Hi, I have a hive table with a column which was changed its name. Pig is not able to load data from this column, it is all empty. Any ideas how to fix it? BR, Patcharee

Re: struggling with Hive ACID - need help

2015-01-15 Thread Devopam Mittra
Any ideas as to where I am going wrong here.. .Between , observed that by changing hive txn manager , some other things are breaking in my existing setup so I have reverted to the old configuration for now to keep the cluster in a workable mode. regards Devopam On Wed, Jan 14, 2015 at 4:25 PM,

full query submitted to hiveserver2

2015-01-15 Thread Vikas Parashar
Hi, I have written an application that is contacting with my hive server2. I just want to check how may queries has been submitted on my hive and full details about the query. But when i have grep this remote command in my hiveserver2 logs. I got below information only: [abc@xyz ~]# cat

Re: Hive being slow

2015-01-15 Thread Abhishek kumar
Hi, Thanks for the reply. I tried that, but no luck. The map-reduce seems to be stuck (taking a lot of time, just for 65 lakhs of Hbase rows). I am attaching the log file (or http://pastebin.com/BUYDUiEu) My only question is why the filter push-down for row-key (*startKey* and *stopKey* for the

Re: NegativeArraySizeException in table join

2015-01-15 Thread Guodong Wang
Hi Ashutosh, Thanks for your reply. Not sure if HIVE-9324 is the same issue we met. We found it is a bug in CDH when using MR1 with hive 0.13.1. This bug does not exist when using yarn with 0.13.1. Guodong On Fri, Jan 16, 2015 at 1:21 AM, Ashutosh Chauhan hashut...@apache.org wrote: Seems

Re: NegativeArraySizeException in table join

2015-01-15 Thread Ashutosh Chauhan
Interesting. You mean to say there is no bug in Hive, but in some other component (yarn / MR). Stack trace seems to indicate there is something going on in Hive side as well. Granted stack trace of 9324 is not identical to yours, but both points problem in similar area. On Thu, Jan 15, 2015 at