Re: way to add custom udf jar in hadoop 2.x version

2015-01-04 Thread Niels Basjes
-archives.apache.org/mod_mbox/hive-user/201303.mbox/%3ccamgr+0h3smdw4zhtpyo5b1b4iob05bpw8ls+daeh595qzid...@mail.gmail.com%3E >> ) >> >> >> >> From: Ted Yu >> Reply-To: "user@hadoop.apache.org" >> Date: Wednesday, December 31, 2014 at 8:25 A

Re: way to add custom udf jar in hadoop 2.x version

2015-01-04 Thread Niels Basjes
smdw4zhtpyo5b1b4iob05bpw8ls+daeh595qzid...@mail.gmail.com%3E > ) > > > > From: Ted Yu > Reply-To: "user@hadoop.apache.org" > Date: Wednesday, December 31, 2014 at 8:25 AM > To: "d...@hive.apache.org" > Subject: Fwd: way to add custom udf jar in

Re: way to add custom udf jar in hadoop 2.x version

2015-01-02 Thread Yakubovich, Alexey
quot; mailto:d...@hive.apache.org>> Subject: Fwd: way to add custom udf jar in hadoop 2.x version Forwarding Niels' question to hive mailing list. On Wed, Dec 31, 2014 at 1:24 AM, Niels Basjes mailto:ni...@basjes.nl>> wrote: Thanks for the pointer. This seems to work for fun

Re: way to add custom udf jar in hadoop 2.x version

2014-12-31 Thread Binglin Chang
On hiveserver machine, create a dir: HIVE_HOME/auxlib , and add all extend jars here, when hiveserver2 starts, it will automatically pick up all jars in this directory and set hive.aux.jars.path properly. So every new session will first add those jars automatically, you don't need to add those jars

Re: way to add custom udf jar in hadoop 2.x version

2014-12-31 Thread Ted Yu
The location for lib jars may change across releases. e.g. in HDP 2.2, /usr/lib/hadoop-mapred doesn't exist. FYI On Wed, Dec 31, 2014 at 12:53 AM, Alexander Pivovarov wrote: > I found that the easiest way is to put udf jar to /usr/lib/hadoop-mapred > on all computers in the cluster. Hive cli,

Fwd: way to add custom udf jar in hadoop 2.x version

2014-12-31 Thread Ted Yu
Forwarding Niels' question to hive mailing list. On Wed, Dec 31, 2014 at 1:24 AM, Niels Basjes wrote: > Thanks for the pointer. > This seems to work for functions. Is there something similar for CREATE > EXTERNAL TABLE ?? > > Niels > On Dec 31, 2014 8:13 AM, "Ted Yu" wrote: > >> Have you seen t

Re: way to add custom udf jar in hadoop 2.x version

2014-12-31 Thread Niels Basjes
Thanks for the pointer. This seems to work for functions. Is there something similar for CREATE EXTERNAL TABLE ?? Niels On Dec 31, 2014 8:13 AM, "Ted Yu" wrote: > Have you seen this thread ? > > http://search-hadoop.com/m/8er9TcALc/Hive+udf+custom+jar&subj=Best+way+to+add+custom+UDF+jar+in+HiveS

Re: way to add custom udf jar in hadoop 2.x version

2014-12-31 Thread Alexander Pivovarov
I found that the easiest way is to put udf jar to /usr/lib/hadoop-mapred on all computers in the cluster. Hive cli, hiveserver2, oozie launcher, oozie hive action, mr will see the jar then. I'm using hdp-2.1.5 On Dec 30, 2014 10:58 PM, "reena upadhyay" wrote: > Hi, > > I am using hadoop 2.4.0 ve

Re: way to add custom udf jar in hadoop 2.x version

2014-12-30 Thread Ted Yu
Have you seen this thread ? http://search-hadoop.com/m/8er9TcALc/Hive+udf+custom+jar&subj=Best+way+to+add+custom+UDF+jar+in+HiveServer2 On Dec 30, 2014, at 10:56 PM, reena upadhyay wrote: > Hi, > > I am using hadoop 2.4.0 version. I have created custom udf jar. I am trying > to execute a simpl

way to add custom udf jar in hadoop 2.x version

2014-12-30 Thread reena upadhyay
Hi, I am using hadoop 2.4.0 version. I have created custom udf jar. I am trying to execute a simple select udf query using java hive jdbc client program. When hive execute the query using map reduce job, then the query execution get fails because the mapper is not able to locate the udf class. So