Re: Load CSV files with embedded map and arrays to Hive

2014-08-20 Thread Nitin Pawar
Hey sorry .. got stuck with work. I will take a look today On Wed, Aug 20, 2014 at 5:43 PM, Sushant Prusty wrote: > Hi Nitin, > Hope you have received the dataset. If you have any further requirement, > please feel free to contact. Will appreciate your help. > > Regards, > Sushant > On Tuesda

Hive Runtime Error: Unable to deserialize reduce input key from...

2014-08-20 Thread Ch Wan
Hi, I have two hive (0.13) tables with the following create syntax: CREATE TABLE `src`( > `a` string, > `b` int, > `c` int, > `p` string > ); CREATE TABLE `tgt`( > `a` string, > `b` int, > `c` int > )PARTITIONED BY (`p` string); And the table src contains only one row : hive> select * from s

Re: Yarn Containers using all the space

2014-08-20 Thread Arun Murthy
Karthik, You might find https://github.com/hortonworks/hdp-configuration-utils useful. That should help provide all the right configs for YARN, Tez & Hive. thanks, Arun On Sat, Aug 16, 2014 at 4:40 PM, karthik Srivasthava < karthiksrivasth...@gmail.com> wrote: > I have total Memory of 48 G

Re: hbase-handler predicate pushdown with multiple scans

2014-08-20 Thread Andrew Mains
If anyone needs it in the future, I've submitted a patch for this feature here: https://issues.apache.org/jira/browse/HIVE-7805 On 7/21/14, 5:26 PM, Andrew Mains wrote: Hi all, We have a table in hive/HBase with a composite row key, the first field of which is a "bucket". Since the bucket is

Re: Help needed: Out of memory with windowing functions

2014-08-20 Thread Furcy Pin
Thank you very much for your answer Ashutosh, it seems non-trivial indeed ! 2014-08-20 17:51 GMT+02:00 Ashutosh Chauhan : > Hi Furcy, > > Sorry that you run into this, but this is a non-trivial problem. But, good > news is Harish has done some good work in this area. See following links. > All

Re: Hive Server 2 Python Client Drivers

2014-08-20 Thread Lefty Leverenz
Brad, after long delay I've updated the code in the wiki and included Python 2.6+ certification in Setting Up HiveServer2 -- Python Client Driver . I also added the Ruby client driver

Re: Help needed: Out of memory with windowing functions

2014-08-20 Thread Ashutosh Chauhan
Hi Furcy, Sorry that you run into this, but this is a non-trivial problem. But, good news is Harish has done some good work in this area. See following links. All this will be available in upcoming release, date for which is under discussion on dev list. 1. https://issues.apache.org/jira/browse/H

Help needed: Out of memory with windowing functions

2014-08-20 Thread Furcy Pin
Hi all, I have an event table with (user_id, timestamp, event) and I'm trying to write a query to get the first 10 events for each user. My query goes like this : SELECT user_id, event FROM ( SELECT user_id, event, ROW_NUMBER() OVER (PARTITION BY user_id ORDER BY time) as rownum FROM eventTable

Re: Load CSV files with embedded map and arrays to Hive

2014-08-20 Thread Sushant Prusty
Hi Nitin, Hope you have received the dataset. If you have any further requirement, please feel free to contact. Will appreciate your help. Regards, Sushant On Tuesday 19 August 2014 02:33 PM, Nitin Pawar wrote: can you give an example of your dataset? On Tue, Aug 19, 2014 at 2:31 PM, Sushant