How to configure Hive intermediate result file format?

2013-10-28 Thread Shangzhong zhu
Hi, Is there any configuration that can change the Hive intermediate result file format (between MR jobs)? I think right now, the default is SequenceFile. I am not sure if I can set to something else like RCFile. The Hive version I am using is 0.9.0 Thanks.

SerDe for Fixed Columns?

2013-10-28 Thread P Reeder
Hi! Sorry to ask such a basic question, but How do I import data from a text file with fixed columns (no delimiter)? I.e, column 1 is characters 1-6, column 2 is characters 7-11, column 3 is character 12, column 4 is character 13, and so forth? I'd be surprised if no one has written a SerDe

Using Cluster by to improve Group by Performance

2013-10-28 Thread KayVajj
Hi, I have a question if I could use the cluster by clause in a sub query to improve the performance of a group by query in hive Lets I have a Table A with columns (all strings) col1..col5 and the table is not Clustered now I 'm trying to run the below query select col1, col2, col3, col4,

Re: SerDe for Fixed Columns?

2013-10-28 Thread Roberto Congiu
Also, you could use the regexp serde using a regexp like (.{10})(.{3})(.{4}) etc (1st column - 10 characters, 2nd col - 3 characters, etc). On Mon, Oct 28, 2013 at 1:03 PM, Nitin Pawar nitinpawar...@gmail.comwrote: I am not aware of any such serde. Till others reply you can wait or if you

request Hive wiki write access

2013-10-28 Thread Eric Hanson (SQL SERVER)
Hi, I would like write access to the Hive wiki to add documentation on how to used vectorized query. Can the owner please add me? I got no reply before when sending to user@hive.apache.org. Thanks, Eric From: Eric Hanson (SQL SERVER) [mailto:eric.n.han...@microsoft.com] Sent: Thursday,

Re: [ANNOUNCE] New Hive PMC Members - Thejas Nair and Brock Noland

2013-10-28 Thread Chris Drome
Congratulations Brock and Thejas! On 10/24/13 3:10 PM, Carl Steinbach c...@apache.org wrote: I am pleased to announce that Thejas Nair and Brock Noland have been elected to the Hive Project Management Committee. Please join me in congratulating Thejas and Brock! Thanks. Carl

Re: request Hive wiki write access

2013-10-28 Thread Ashutosh Chauhan
Hi Eric, Added you as a contributor to Hive wiki. Thanks, Ashutosh On Mon, Oct 28, 2013 at 4:39 PM, Eric Hanson (SQL SERVER) eric.n.han...@microsoft.com wrote: Hi, I would like write access to the Hive wiki to add documentation on how to used vectorized query. Can the owner please add

Re: request Hive wiki write access

2013-10-28 Thread Mikhail Antonov
Could you please also add me? olorinb...@gmail.com I wanted to add details about LDAP integration -Mikhail 2013/10/28, Ashutosh Chauhan hashut...@apache.org: Hi Eric, Added you as a contributor to Hive wiki. Thanks, Ashutosh On Mon, Oct 28, 2013 at 4:39 PM, Eric Hanson (SQL SERVER)

Re: request Hive wiki write access

2013-10-28 Thread Ashutosh Chauhan
Hi Mikhail, Sure, but first you first need to create an account on https://cwiki.apache.org/confluence/display/Hive/Home Once you have done that, than let me know your cwiki id and I will add you as a contributor. Ashutosh On Mon, Oct 28, 2013 at 5:55 PM, Mikhail Antonov

Re: request Hive wiki write access

2013-10-28 Thread Brad Ruderman
3rd as well. I would like to add information about hs2 client libraries (ruby,node,python). bradruder...@gmail.com Thanks, Brad On Mon, Oct 28, 2013 at 5:55 PM, Mikhail Antonov olorinb...@gmail.comwrote: Could you please also add me? olorinb...@gmail.com I wanted to add details about LDAP