Re: What to choose, hive 0.11 (marked as stable release ) or hive 0.12

2014-02-27 Thread twinkle sachdeva
any thought regarding what is more stable? hive 0.11 or hive 0.12? On Thu, Feb 27, 2014 at 12:42 PM, twinkle sachdeva twinkle.sachd...@gmail.com wrote: Hi, I am planning to use hive for my use case, but I am confused between hive 0.12 and hive 0.11. Hive 0.12 has been there for

Re: What to choose, hive 0.11 (marked as stable release ) or hive 0.12

2014-02-27 Thread Nitin Pawar
here is a mail from Edward on a different thread All stable really is is a sym link, Hive is heavily unit and integration tested. Also the release is not made after some manual testing as well. releases have historically been very stable. 12 has been out for some time. You can use 0.12, It has

Hive query parser bug resulting in FAILED: NullPointerException null

2014-02-27 Thread Krishna Rao
Hi all, we've experienced a bug which seems to be caused by having a query constraint involving partitioned columns. The following query results in FAILED: NullPointerException null being returned nearly instantly: EXPLAIN SELECT col1 FROM tbl1 WHERE (part_col1 = 2014 AND part_col2 = 2) OR

Re: Metastore performance on HDFS-backed table with 15000+ partitions

2014-02-27 Thread Norbert Burger
Thanks everyone for the feedback. Just to follow up in case someone else runs into this: I can confirm that local client works around the OOMEs, but it's still very slow. It does seem like we were hitting some combination of HIVE-4051 and HIVE-5158. We'll try reducing partition count first, and

Log Progress of Queries

2014-02-27 Thread Edson Ramiro
Hi all, I was using hive-0.11 and I used to get the query status from log files. But I changed from 0.11.0 to 0.12.0 and, even if it's configured, hive is not more generating the logs with the progress of the queries. Does the query status have been disabled or may be I've misconfigured hive?

RE: Metastore performance on HDFS-backed table with 15000+ partitions

2014-02-27 Thread java8964
That is good to know. We are using Hive 0.9. Right now the biggest table contains 2 years data, and we partitioned by hour, as the data volume is big. So right now, it has 2*365*24 around 17000+ partitions. So far we didn't see too much problem yet, but I do have some concerns about it. We are

RE: Hive query parser bug resulting in FAILED: NullPointerException null

2014-02-27 Thread java8964
Can you reproduce with an empty table? I can't reproduce it. Also, can you paste the stack trace? Yong From: krishnanj...@gmail.com Date: Thu, 27 Feb 2014 12:44:28 + Subject: Hive query parser bug resulting in FAILED: NullPointerException null To: user@hive.apache.org Hi all, we've

Re: java.lang.RuntimeException: cannot find field key from [0:_col0, 1:_col2, 2:_col3]

2014-02-27 Thread Kumar V
Hi,    I wrote a similar simple UDTF and a new table. This simple UDTF does work on hive 0.10.  But my original one doesn't.  Still don't understand why. Does the fact that the original query works with the setting 'set hive.optimize.ppd=true' give any clue ? Please let me know. On

Re: ORC 'BETWEEN' Error

2014-02-27 Thread Prasanth Jayachandran
Hi Martin This is an known issue and its fixed in hive trunk. It should be available in 0.13 release. https://issues.apache.org/jira/browse/HIVE-5601 Thanks Prasanth Jayachandran On Feb 26, 2014, at 8:55 AM, Martin, Nick nimar...@pssd.com wrote: Hi all, (Running Hive 12.0) I have

move hive tables from one cluster to another cluster

2014-02-27 Thread soniya B
Dear experts, I want to move my hive tables from one cluster to another cluster. how can i do it? Thanks Soniya.

Re: move hive tables from one cluster to another cluster

2014-02-27 Thread Krishnan K
1. you can use distcp to copy the files to the new cluster 2. rebuild metadata On Thu, Feb 27, 2014 at 8:07 PM, soniya B soniya.bigd...@gmail.com wrote: Dear experts, I want to move my hive tables from one cluster to another cluster. how can i do it? Thanks Soniya.

Re: move hive tables from one cluster to another cluster

2014-02-27 Thread soniya B
Hi, I have moved warehouse file to another cluster. but still i didn't see the tables on the other cluster. How to rebulid the metadata? Thanks Soniya On Fri, Feb 28, 2014 at 9:26 AM, Krishnan K kkrishna...@gmail.com wrote: 1. you can use distcp to copy the files to the new cluster 2.