Hive .13 issue with hive.map.aggr=true

2014-08-28 Thread Peyman Mohajerian
Hi Guys, In this query: select min(YYY), max(YYY) from where trim(YYY) is not null and trim(YYY)<>''; we expect the following result: #42684 ZYP7250455 Column 'YYY' is of type 'string' the file format is ORC with Snappy compression. However we get: ZYP7250455 (empty for the minimum)

RE: hive 13: dynamic partition inserts

2014-07-22 Thread Gajendran, Vishnu
Hi Prasanth, Thanks a lot for your quick response. From: Gajendran, Vishnu Sent: Tuesday, July 22, 2014 11:47 AM To: user@hive.apache.org Cc: d...@hive.apache.org Subject: RE: hive 13: dynamic partition inserts Hi Prasanth, Thanks a lot for your quick response

RE: hive 13: dynamic partition inserts

2014-07-22 Thread Gajendran, Vishnu
Hi Prasanth, Thanks a lot for your quick response. From: Prasanth Jayachandran [pjayachand...@hortonworks.com] Sent: Tuesday, July 22, 2014 11:28 AM To: user@hive.apache.org Cc: d...@hive.apache.org Subject: Re: hive 13: dynamic partition inserts Hi Vishnu Yes

Re: hive 13: dynamic partition inserts

2014-07-22 Thread Prasanth Jayachandran
Hi Vishnu Yes. There is change in the way dynamic partitions are inserted in hive 13. The new dynamic partitioning is highly scalable and uses very less memory. Here is the related JIRA https://issues.apache.org/jira/browse/HIVE-6455. Setting "hive.optimize.sort.dynamic.partition"

RE: hive 13: dynamic partition inserts

2014-07-22 Thread Gajendran, Vishnu
adding user@hive.apache.org for wider audience From: Gajendran, Vishnu Sent: Tuesday, July 22, 2014 10:42 AM To: d...@hive.apache.org Subject: hive 13: dynamic partition inserts Hello, I am seeing a difference between hive 11 and hive 13 when inserting to a table

dynamic partition inserts in hive 13

2014-07-22 Thread Gajendran, Vishnu
Hello, I am seeing a difference between hive 11 and hive 13 when inserting to a table with dynamic partition. In Hive 11, when I set hive.merge.mapfiles=false before doing a dynamic partition insert, I see number of files (generated my each mapper) in the specified hdfs location as expected

HIVE 13 : Simple Join Throwing java.io.IOException

2014-06-11 Thread Siddhartha Gunda
Hi, I am trying to run a simple join query on hive 13. Both tables are in text format. Both tables are read in mappers, and the error is thrown in reducer. I don't get why a reducer is reading a table when the mappers have read it already and the reason for assuming that the video file i

Re: Hive 13

2014-03-21 Thread Alan Gates
: > Hello. > > Is there a firm release date for Hive 13? I know there was talk several > weeks ago about cutting a branch and looking at stability. > > Regards, > > Bryan Jeffrey -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual o

Hive 13

2014-03-19 Thread Bryan Jeffrey
Hello. Is there a firm release date for Hive 13? I know there was talk several weeks ago about cutting a branch and looking at stability. Regards, Bryan Jeffrey