RE: Hive query failing

2012-09-25 Thread Manish . Bhoge
Sarath, Is this the external table where you have ran the query? How did you loaded the table? Because it looks like the error is about the file related to table than CDH Jar. Thank You, Manish From: Sarath [mailto:sarathchandra.jos...@algofusiontech.com] Sent: Tuesday, September 25, 2012

RE: Custom MR scripts using java in Hive

2012-09-25 Thread Manish . Bhoge
Manu, If you have written UDF in Java for Hive then you need to copy your JAR on your Hadoop cluster in /usr/lib/hive/lib/ folder to hive to use this JAR. Thank You, Manish From: Manu A [mailto:hadoophi...@gmail.com] Sent: Tuesday, September 25, 2012 3:44 PM To: user@hive.apache.org Subject:

Re: Hive query failing

2012-09-25 Thread kulkarni . swarnim
The jar is being looked on HDFS as the exception suggests. Run the following commands: $ hadoop fs -mkdir /usr/lib/hive/lib $ hadoop fs -put $HIVE_HOME/lib/hive-builtins-0.8.1-cdh4.0.1.jar /usr/lib/hive/lib Your queries should work now. On Sep 25, 2012, at 6:46 AM, Manish.Bhoge

Re: Custom MR scripts using java in Hive

2012-09-25 Thread Tamil A
Hi Manish, Thanks for your help.I did the same using UDF.Now trying with Transform,Map and Reduce clauses.so is it mean by using java we have to goahead through UDF and for other languages using MapReduce Scripts i.e., the Transform,Map and Reduce clauses. Please correct me if am wrong.

Re: Custom MR scripts using java in Hive

2012-09-25 Thread Manu A
Thanks Manish. ll try with the same. Thanks Regards, Manu On Tue, Sep 25, 2012 at 5:19 PM, Manish.Bhoge manish.bh...@target.comwrote: Manu, ** ** If you have written UDF in Java for Hive then you need to copy your JAR on your Hadoop cluster in /usr/lib/hive/lib/

Re: Custom MR scripts using java in Hive

2012-09-25 Thread Bertrand Dechoux
For java, you can also consider reflection : http://hive.apache.org/docs/r0.9.0/udf/reflect.html Regards Bertrand On Tue, Sep 25, 2012 at 3:18 PM, Tamil A 4tamil...@gmail.com wrote: Hi Manish, Thanks for your help.I did the same using UDF.Now trying with Transform,Map and Reduce clauses.so

How connect to hive server without using jdbc

2012-09-25 Thread Abhishek
Hi all, Is there any way to connect to hive server through API?? Regards Abhi Sent from my iPhone

Re: How connect to hive server without using jdbc

2012-09-25 Thread Haijia Zhou
https://cwiki.apache.org/Hive/hiveclient.html#HiveClient-JDBC On Tue, Sep 25, 2012 at 1:13 PM, Abhishek abhishek.dod...@gmail.com wrote: Hi all, Is there any way to connect to hive server through API?? Regards Abhi Sent from my iPhone

Re: How connect to hive server without using jdbc

2012-09-25 Thread Abhishek
Hi Zhou, But Iam looking to connect to hive server without jdbc. Some other way through API Regards Abhi Sent from my iPhone On Sep 25, 2012, at 1:15 PM, Haijia Zhou leons...@gmail.com wrote: https://cwiki.apache.org/Hive/hiveclient.html#HiveClient-JDBC On Tue, Sep 25, 2012 at 1:13 PM,

Re: How connect to hive server without using jdbc

2012-09-25 Thread Haijia Zhou
the page also contains information about using other APIs to connect to Hive. On Tue, Sep 25, 2012 at 1:44 PM, Abhishek abhishek.dod...@gmail.com wrote: Hi Zhou, But Iam looking to connect to hive server without jdbc. Some other way through API Regards Abhi Sent from my iPhone On Sep

Re: How connect to hive server without using jdbc

2012-09-25 Thread Doug Houck
Also, this is all open source, right? So you could take a look at the CLI code to see how it does it. - Original Message - From: Abhishek abhishek.dod...@gmail.com To: user@hive.apache.org Cc: user@hive.apache.org Sent: Tuesday, September 25, 2012 1:44:41 PM Subject: Re: How connect to

Re: How connect to hive server without using jdbc

2012-09-25 Thread Abhishek
Hi Zhou, Thanks for the reply, we are shutting down thrift service due to security issues with hive. Regards Abhi Sent from my iPhone On Sep 25, 2012, at 1:53 PM, Doug Houck doug.ho...@trustedconcepts.com wrote: Also, this is all open source, right? So you could take a look at the CLI

Re: How connect to hive server without using jdbc

2012-09-25 Thread Abhishek
Hi Doug, Thanks for the reply.Can you point me to the CLI code. Regards Abhi Sent from my iPhone On Sep 25, 2012, at 1:53 PM, Doug Houck doug.ho...@trustedconcepts.com wrote: Also, this is all open source, right? So you could take a look at the CLI code to see how it does it. -

Hive File Sizes, Merging, and Splits

2012-09-25 Thread John Omernik
I am really struggling trying to make hears or tails out of how to optimize the data in my tables for best query times. I have a partition that is compressed (Gzip) RCFile data in two files total 421877 263715 -rwxr-xr-x 1 darkness darkness 270044140 2012-09-25 13:32 00_0 158162 -rwxr-xr-x 1

How can I get the constant value from the ObjectInspector in the UDF

2012-09-25 Thread java8964 java8964
Hi, I am using Cloudera release cdh3u3, which has the hive 0.71 version. I am trying to write a hive UDF function as to calculate the moving sum. Right now, I am having trouble to get the constrant value passed in in the initialization stage. For example, let's assume the function is like the

Re: How connect to hive server without using jdbc

2012-09-25 Thread Bertrand Dechoux
I am interested in the response of Dilip. I didn't look at the details and stopped my proof of concept using hive with jdbc due to the thrift server not being 'concurrent safe'. Of course, like Dilip said, the driver call can be done directly from java (or any languages having a binding to it).