Re: need help with an error - script used to work and now it does not :-(

:-( Still facing problems in large datasets Were u able to solve this Edward ? Thanks sanjay From: Sanjay Subramanian mailto:sanjay.subraman...@wizecommerce.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: Thursday, May 16, 2013 8:25 PM To:

Re: need help with an error - script used to work and now it does not :-(

Thanks Edward…I just checked all instances of guava jars…except those in red all seem same version /usr/lib/hadoop/client/guava-11.0.2.jar /usr/lib/hadoop/client-0.20/guava-11.0.2.jar /usr/lib/hadoop/lib/guava-11.0.2.jar /usr/lib/hadoop-httpfs/webapps/webhdfs/WEB-INF/lib/guava-11.0.2.jar /usr/lib

Re: need help with an error - script used to work and now it does not :-(

Ironically I just got a misleading error like this today. What happened was I upgraded to hive 0.10.One of my programs was liked to guava 15 but hive provides guava 09 on the classpath confusing things. I also had a similar issue with mismatched slf 4j and commons-logger. On Thu, May 16, 2013 at

need help with an error - script used to work and now it does not :-(

2013-05-16 18:57:21,094 FATAL [IPC Server handler 19 on 40222] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: attempt_1368666339740_0135_m_000104_1 - exited : java.lang.RuntimeException: Error in configuring object at org.apache.hadoop.util.ReflectionUtils.setJobConf(Reflection

Hive metastore on Oracle

Hi, I am looking for suggestions from the hadoop and hive user community on the following - 1) How good is the choice of choosing Oracle for Hive Metastore ? In my organization, we only use Oracle database and so we wanted to know whether there are any known issues with Oracle Hive Metastore.

Hive views

Hi all, We had created views in hive, but when we restart the cluster then the views created in the hive are deleted automatically. I know hive view doesn't persist after cluster restart, but I want figure it out a way to persist it. Can someone help me how to do that? Regards Abhishek

Re: Hive Authorization and Views

Edward - I agree that hive and rdbms are different animals, so in looking at that current work around hive authorization, I get that the user would still have access to the underlying file system. We have to assume that permissions are only enforced from a metadata perspective. But given that it

Re: [ANNOUNCE] Apache Hive 0.11.0 Released

Congratulations! On Thu, May 16, 2013 at 4:19 PM, Owen O'Malley wrote: > The Apache Hive team is proud to announce the the release of Apache > Hive version 0.11.0. > > The Apache Hive data warehouse software facilitates querying and > managing large datasets residing in distributed storage. Buil

Re: Hive Authorization and Views

Also we have all external tables to ensure that accidental dropping of tables does not delete data…Plus the good part of HDFS architecture is data is immutable….which means u cannot update rows….u can move partitions or delete/insert data from hdfs which IMHO is very cool….but may not solve all

[ANNOUNCE] Apache Hive 0.11.0 Released

The Apache Hive team is proud to announce the the release of Apache Hive version 0.11.0. The Apache Hive data warehouse software facilitates querying and managing large datasets residing in distributed storage. Built on top of Apache Hadoop, it provides: * Tools to enable easy data extract/transf

Re: Hive Authorization and Views

The largest issue is that the RDBMS security model does not match with hive. Hive/Hadoop has file permissions, RDMBS have column and sometimes row level permissions. When you physically have access to the underlying file (row level) permissions are not enforceable. The only way to enforce this typ

Re: Hive Authorization and Views

I am curious on the thoughts of the community here, this seems like something many enterprises would drool over with Hive... I am not a coder so the level coding involved something like this is unknown. On Sat, May 4, 2013 at 8:31 AM, John Omernik wrote: > We were doing some tests this past wee

Re: Hive Web Interface

Thanks Aniket... From: Aniket Mokashi mailto:aniket...@gmail.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: Thursday, May 16, 2013 10:18 AM To: "user@hive.apache.org" mailto:user@hive.apache.org>> Cc: "hive-u..

Re: Hive Web Interface

Again, you need to set value to "lib/hive-hwi-0.9.0.war". value = '/path/to/lib/hive-hwi-0.9.0.war' will not work. ~Aniket On Thu, May 16, 2013 at 9:57 AM, Sanjay Subramanian < sanjay.subraman...@wizecommerce.com> wrote: > 1. U will need to set this in the hive-site.xml > > > hive.hwi.war.f

Re: Hive Web Interface

1. U will need to set this in the hive-site.xml hive.hwi.war.file /path/to/lib/hive-hwi-0.9.0.war This sets the path to the HWI war file, relative to ${HIVE_HOME}. 2. Get this http://archive.apache.org/dist/hive/hive-0.9.0/hive-0.9.0.tar.gz 3. Tar xvf hive-0.9.0.tar.gz 4. hive-0.9.0/l

Re: Hive Web Interface

+1 agreed…beeswax is way better From: "kulkarni.swar...@gmail.com" mailto:kulkarni.swar...@gmail.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: Thursday, May 16, 2013 9:21 AM To: "user@hive.apache.org

Re: Hive Web Interface

In your hive-site.xml, change value to "lib/hive-hwi-0.9.0.war" from "/lib/hive-hwi-0.9.0.war". I guess its a known issue with hwi. ~Aniket On Thu, May 16, 2013 at 8:58 AM, Stephen Sprague wrote: > ok. i'll bite. you've cut 'n pasted the stderr to us -- but have you any > further comment on w

Re: Hive Web Interface

AFAIK Hive HWI has been deprecated and you should be using hue/beeswax for all your web interface needs. On Thu, May 16, 2013 at 11:18 AM, Aniket Mokashi wrote: > In your hive-site.xml, change value to "lib/hive-hwi-0.9.0.war" from > "/lib/hive-hwi-0.9.0.war". I guess its a known issue with hwi.

Re: Hive Web Interface

ok. i'll bite. you've cut 'n pasted the stderr to us -- but have you any further comment on what you did after reading it? Take that second line for instance. What action would you take after reading that? On Wed, May 15, 2013 at 10:24 PM, Something Something < mailinglist...@gmail.com> wrot

RE: Filtering

>>On Wed, May 15, 2013 at 3:38 AM, Peter Marron >> wrote: … >I've started doing similar work for the ORC reader. I guess that I’m glad that I’m not completely alone here. >> >>Firstly although that page mentions InputFormat there doesn’t seem to be any >>way (that I can find) >>to perform filte

Re: Partitioning an external hbase table

Unfortunately I don't think there is a clean way to achieve that (atleast not one that I know of). Your option at this point is to run your queries with a WHERE clause so that the predicate behind the scenes gets converted to a range scan and restricts the amount of data that is being getting scann