Re: EXTERNAL: setting HIVE table property to READ ONLY

Have you looked into file and folder level permissions? Or is your requirement to do this through DDL options? Thanks, Ranjith From: Babe Ruth [mailto:gtevelde-h...@hotmail.com] Sent: Wednesday, October 24, 2012 09:49 PM To: user@hive.apache.org user@hive.apache.org Subject: EXTERNAL: setting

RE: HiveServer can not handle concurrent requests from more than one client?

. Thanks, Ranjith From: Bertrand Dechoux [mailto:decho...@gmail.com] Sent: Monday, August 27, 2012 11:01 AM To: user@hive.apache.org Subject: HiveServer can not handle concurrent requests from more than one client? Hi, I would like to have more information about this specific sentence from

Re: Hive and joins

Thanks Bejoy. What if those values a,b are not static and are housed in a table. Much like a type 2 dimension. Is the current solution still to put it in the where clause? Thanks, Ranjith From: Bejoy Ks [mailto:bejoy...@yahoo.com] Sent: Wednesday, August 08, 2012 06:55 AM To: user

RE: Converting rows into dynamic colums in Hive

You can do this using case statements and summing the values. The only item to remember here is that the values in the grid need to be numeric for the sum to work. Thanks, Ranjith From: richin.j...@nokia.com [mailto:richin.j...@nokia.com] Sent: Tuesday, August 07, 2012 3:58 PM To: user

Hive and joins

Since Hive (0.7.1) only supports equi-based join how are people using it for joins employing the between clause? Thanks, Ranjith

Hive job tuning

is 300, where does the rest of the 200 mb get assigned to? Is sitting there idle? If I increase the io.sort mb to the size of the jvm what effects does that have? Thanks, Ranjith

Re: Map side aggregations

Thanks philip. Thanks, Ranjith On May 23, 2012, at 4:15 AM, Philip Tromans philip.j.trom...@gmail.com wrote: Hi Ranjith, I haven't checked the code (so this might not be true), but I think that the map side aggregation stuff uses it's own hash map within the map phase to do

Map side aggregations

? Thanks, Ranjith

Re: Map side aggregations

Thanks Matt. I am not performing a join so does that matter? What does this local task do? Thanks, Ranjith On May 22, 2012, at 8:17 PM, Tucker, Matt matt.tuc...@disney.com wrote: Try setting hive.auto.convert.join to true. The CLI will have a local task before it starts a map-reduce job

Re: Is there a way to create user account and grant read only permissions?

How are others setting up hive for use in production? I guess my real question how are many of us getting around these security gaps? Thanks, Ranjith On May 19, 2012, at 12:05 AM, Bejoy Ks bejoy...@yahoo.com wrote: Hi Ranjith AFAIK Segmenting tables into databases won't help much

RE: Is there a way to create user account and grant read only permissions?

Take a look at this, https://cwiki.apache.org/Hive/languagemanual-auth.html. This may be what you are looking for . From: shashwat shriparv [mailto:dwivedishash...@gmail.com] Sent: Friday, May 18, 2012 3:08 PM To: user@hive.apache.org Subject: Re: Is there a way to create user account and grant

Re: Reduce operation stuck

This could be a result of the data being skewed. When you look at the job tracker page are you noticing just a few lurking around? Thanks, Ranjith On May 18, 2012, at 1:57 PM, Balaji Rao sbalaji...@gmail.com wrote: I have a simple query running on HIVE using Amazon EMR where the reduce

Re: Is there a way to create user account and grant read only permissions?

Is separate metastores and separate hive servers the only way to go here? Or can we segment tables into databases and then use hive authorization. Thanks, Ranjith On May 18, 2012, at 11:08 PM, Bejoy KS bejoy...@yahoo.com wrote: Hi patrick The Authorization mechanisms in hive are not as solid

Indexing in hive

) AS 'org.apache.hadoop.hive.ql.index.compact.CompactIndexHandler' WITH DEFERRED REBUILD The query is as follows: Select a,count(*) from x where j='and' group by a Is there anything I am doing incorrectly? Thanks, Ranjith

Re: Can one Hadoop cluster hold multiple Hive instances?

Given that hive has the concept of multiple databases to categorize objects. What is the motivation behind having multiple hive instances? I am curious here...is it for security? Thanks, Ranjith On May 13, 2012, at 9:53 AM, Vinod Singh vi...@vinodsingh.com wrote: That if perfectly fine

Re: Can one Hadoop cluster hold multiple Hive instances?

With 0.7.1 hive allows for grants on tables and some ability to restrict table alterations. What shortcomings are compensated for with multiple instances versus those? Thanks, Ranjith On May 13, 2012, at 3:32 PM, Vinod Singh vi...@vinodsingh.com wrote: Yes, security is one of the motivation

Re: Managed vs external tables in hive

Indexes can be built on tables managed by hive. For external tables I do not believe that to be true. Please feel to correct if I am wrong. Thanks, Ranjith On May 12, 2012, at 9:24 PM, Nanda Vijaydev nanda.vijay...@gmail.com wrote: In hive, the raw data is in HDFS and there is a metadata

Security and permissions within Hive

Anyone implementing authorization and roles within their hive environment? If so how successful has it been? Thanks, Ranjith

Re: Re: how to join like a In A but not in B operation?

Thinking out loud here and may be worth a shot. Please perform an explain to see if the where takes place after the join but this may work, Select a.* from a left join b on a.key=b.key where b.key is null Thanks, Ranjith From: Richard [mailto:codemon...@163.com] Sent: Monday, March 12, 2012

RE: Need a smart way to delete the first row of my data

Give you a key column that is unique within your dataset I think this could work. 1. Load the file as is, gunzipped, into a hive table 2. Determine the total row size. 3. Perform a insert into table Select * from Order by col_name desc limit total_size -1 From:

RE: Regex and serde with hive

Thanks Mark, Loren, and Vijay for helping out with this. I did try the serde configuration and it worked well. I did come across the performance implications as I increased the volume so I went ahead and cleansed the data prior to inserting it. Thanks again. Thank you, Ranjith

Schemas/Databases in Hive

What is the intent of having tables in different databases or schemas in Hive? Thanks Thank you, Ranjith

Re: Schemas/Databases in Hive

Thanks Bejoy. This was helpful. Thanks, Ranjith From: bejoy...@yahoo.com [mailto:bejoy...@yahoo.com] Sent: Thursday, December 22, 2011 11:23 AM To: user@hive.apache.org user@hive.apache.org Subject: Re: Schemas/Databases in Hive Also multiple databases have proved helpful for me in organizing

Re: bucketing in hive

Thanks Bejoy. Appreciate the insight. Do you know of altering the number of buckets once a table has been set up? Thanks, Ranjith From: Bejoy Ks [mailto:bejoy...@yahoo.com] Sent: Thursday, December 15, 2011 06:13 AM To: user@hive.apache.org user@hive.apache.org; hive dev list d

RE: Hive connecting to squirrel on windows

. From: Patrick Hunt [ph...@apache.org] Sent: Friday, May 20, 2011 11:39 AM To: user@hive.apache.org Cc: Raghunath, Ranjith Subject: Re: Hive connecting to squirrel on windows What's the error you get? Perhaps this one? https://issues.apache.org/jira/browse/HIVE-2163 (seems

Hive connecting to squirrel on windows

I have followed the document outlining how to perform the connection listed in http://wiki.apache.org/hadoop/Hive/HiveJDBCInterface. However, I keep getting a error when trying to connect. I would appreciate any input on this. Thank you, Ranjith

RE: What does 'TempStatsStore' do ?

Is there some advantage to gathering stats in this case? Thank you, Ranjith N. Raghunath From: wd [mailto:w...@wdicc.com] Sent: Tuesday, May 10, 2011 9:54 PM To: user@hive.apache.org Subject: Re: What does 'TempStatsStore' do ? Thanks, I found some new configure options for hive.stats, I'll

Re: Export data with column names

Thanks. Is there something I can do with cli? Thanks, Ranjith - Original Message - From: Matthew Rathbone matt...@foursquare.com To: user@hive.apache.org user@hive.apache.org Sent: Tue May 03 09:45:58 2011 Subject: Re: Export data with column names If you use the thrift client you

RE: Export data with column names

Thanks Loren. Pardon my ignorance but what is an NPE? Thank you, Ranjith N. Raghunath -Original Message- From: Loren Siebert [mailto:lo...@siebert.org] Sent: Tuesday, May 03, 2011 1:23 PM To: user@hive.apache.org Cc: user@hive.apache.org Subject: Re: Export data with column names

RE: Export data with column names

Thanks for the help on this. The option to set the header worked out great. Is there a way that I can export data out to the local file system with the header information? Thank you, Ranjith N. Raghunath -Original Message- From: Steven Wong [mailto:sw...@netflix.com] Sent: Tuesday

Re: Cross join in Hive.

Very cool. What is the non strict option for? Thanks, Ranjith From: Ashish Thusoo athu...@fb.com To: user@hive.apache.org user@hive.apache.org Sent: Mon May 02 16:00:39 2011 Subject: Re: Cross join in Hive. you could probably just say (1 = 1) in the on clause

Export data with column names

Does anyone know how to export data out with column names? Any help here is appreciated. Thanks, Ranjith

Re: Cross join in Hive.

Forgot to mentionthe condition for the inner join should be the column set to 1 in the first table to be equal to the same column in the other table. Thanks, Ranjith From: Raghunath, Ranjith ranjith.raghuna...@usaa.com To: 'user@hive.apache.org' user