start hive cli error

2012-05-18 Thread dianbo . zhu
hi there, I got the following trace stack when startuping hive cli. It worked well last week when i just installed it. Anybody can help? thanks, Dianbau [dzhu@bbdw-194 bin]$ ./hive Logging initialized using configuration in

SASL and kerberos principal

2012-05-18 Thread ameet chaubal
Hi all, I am trying to make SASL work with hive. it is enabled via  hive.metastore.sasl.enabled = true hive.metastore.kerberos.keytab.file=/etc/hive/conf/hive.keytab hive.metastore.kerberos.principal = hive/cdh4.ec2.internal@EC2.INTERNAL I have checked the keytab and looks ok, [root@cdh4

Is there a way to create user account and grant read only permissions?

2012-05-18 Thread Patrick Luo
My use case requires individual accounts for business users groups. Is there a way to mimic MySQL (or other database) to create users with read-only permissions? This avoid business user accidental table drop. Metastore has table ROLES but don’t see documentation on that. Much appreciated if

Reduce operation stuck

2012-05-18 Thread Balaji Rao
I have a simple query running on HIVE using Amazon EMR where the reduce operation seems to be stuck. The table is small with just 300,000+ rows (data_analysis). I intend to work on a 30,000,000 row table once I'm able to fix this. The query (modified to hide some information) is as follows:

Running Multiple Hive Versions

2012-05-18 Thread Tucker, Matt
We're currently running CDH3u3 with Hive 0.7.1. Is it possible to upgrade Hive clients to Hive 0.9 while still executing jobs on a CDH3u3 cluster? I'm specifically interested in Hive 0.9 for the HIVE-2203 patch. Is there any known compatibility issues with a CDH3u3 cluster and Hive 0.9

Re: Is there a way to create user account and grant read only permissions?

2012-05-18 Thread shashwat shriparv
Check out this https://ccp.cloudera.com/display/CDHDOC/Hive+Security+Configuration On Sat, May 19, 2012 at 12:17 AM, Patrick Luo l...@trulia.com wrote: My use case requires individual accounts for business users groups. Is there a way to mimic MySQL (or other database) to create users with

RE: Is there a way to create user account and grant read only permissions?

2012-05-18 Thread Raghunath, Ranjith
Take a look at this, https://cwiki.apache.org/Hive/languagemanual-auth.html. This may be what you are looking for . From: shashwat shriparv [mailto:dwivedishash...@gmail.com] Sent: Friday, May 18, 2012 3:08 PM To: user@hive.apache.org Subject: Re: Is there a way to create user account and grant

Re: Reduce operation stuck

2012-05-18 Thread Ranjith
This could be a result of the data being skewed. When you look at the job tracker page are you noticing just a few lurking around? Thanks, Ranjith On May 18, 2012, at 1:57 PM, Balaji Rao sbalaji...@gmail.com wrote: I have a simple query running on HIVE using Amazon EMR where the reduce

Re: Is there a way to create user account and grant read only permissions?

2012-05-18 Thread Bejoy KS
Hi patrick The Authorization mechanisms in hive are not as solid as other RDBMS. A user can grant himself rights and can then drop a table or do whatever operations he likes to do. There is no super user(admin) and sub user concept in hive yet, but the community is having plans to

Re: Reduce operation stuck

2012-05-18 Thread Bejoy KS
Hi Balaji How many reduce tasks are being triggered? If more than 1, how many of them are completed and and how many are still running? Can you try increasing the number of reduce tasks and post in the behavior you are seeing. I believe skew is already enabled for joins in your hive

Re: Is there a way to create user account and grant read only permissions?

2012-05-18 Thread Ranjith
Is separate metastores and separate hive servers the only way to go here? Or can we segment tables into databases and then use hive authorization. Thanks, Ranjith On May 18, 2012, at 11:08 PM, Bejoy KS bejoy...@yahoo.com wrote: Hi patrick The Authorization mechanisms in hive are not as solid

Re: How can I import other file in a python transform script

2012-05-18 Thread wzc
hi all: I have found the answer here http://osdir.com/ml/hive-user-hadoop-apache/2010-05/msg00038.html : Adding the following lines before the import solved the problem: import sys import os sys.path.append(os.getcwd()) 2012/5/14 wzc wzc1...@gmail.com Hi all: I try to run simple transform

Re: Is there a way to create user account and grant read only permissions?

2012-05-18 Thread Bejoy Ks
Hi Ranjith      AFAIK Segmenting tables into databases won't help much as, again the Authorization issues would pop out. An user himself may be able to grant rights to access another db. Different metastores is an option, but again maintaining all of them is still a hassle, still you can do