Re: UDF Configure method not getting called

2015-08-28 Thread Moore, Douglas
that? Maybe someone might have a suggestion. From: Rahul Sharma kippy@gmail.commailto:kippy@gmail.com Sent: Wednesday, August 26, 2015 9:39 AM To: user@hive.apache.orgmailto:user@hive.apache.org Subject: Re: UDF Configure method not getting called Thanks again

Re: UDF Configure method not getting called

2015-08-28 Thread Rahul Sharma
. -- *From:* Rahul Sharma kippy@gmail.com *Sent:* Wednesday, August 26, 2015 9:39 AM *To:* user@hive.apache.org *Subject:* Re: UDF Configure method not getting called Thanks again Jason. I tried hive.fetch.task.conversion=minimal/none and it ran a map-reduce task

Re: UDF Configure method not getting called

2015-08-26 Thread Rahul Sharma
, 2015 2:48 PM *To:* user@hive.apache.org *Subject:* Re: UDF Configure method not getting called Or alternatively, is there a way to pass configuration without using the configure method? The configuration to the UDF is essentially a list of parameters that tells the UDF, what it should morph

Re: UDF Configure method not getting called

2015-08-26 Thread Jason Dere
: Wednesday, August 26, 2015 9:39 AM To: user@hive.apache.org Subject: Re: UDF Configure method not getting called Thanks again Jason. I tried hive.fetch.task.conversion=minimal/none and it ran a map-reduce task and the UDF ran fine. The problem with this approach is that the property needs

UDF Configure method not getting called

2015-08-25 Thread Rahul Sharma
Hi Guys, We have a UDF which extends GenericUDF and does some configuration within the public void configure(MapredContext ctx) method. MapredContext in configure method gives access to the HiveConfiguration via JobConf, which contains custom attributes of the form xy.abc.something. Reading

Re: UDF Configure method not getting called

2015-08-25 Thread Jason Dere
hive.fetch.task.conversion=minimal/none and hive.optimize.constant.propagation=false and see how it works. From: Rahul Sharma kippy@gmail.com Sent: Tuesday, August 25, 2015 2:48 PM To: user@hive.apache.org Subject: Re: UDF Configure method not getting called

Re: UDF Configure method not getting called

2015-08-25 Thread Rahul Sharma
Also seems like the UDF is being run on the client machine (I am using beeline). No map reduce job gets spawned. I have removed limit clause as I found that solved the issue for someone else in the mailing list. However, still no luck. I looked at the MapredContext class's needConfigure method and

Re: UDF Configure method not getting called

2015-08-25 Thread Jason Dere
not be called. From: Rahul Sharma kippy@gmail.com Sent: Tuesday, August 25, 2015 11:32 AM To: user@hive.apache.org Subject: UDF Configure method not getting called Hi Guys, We have a UDF which extends GenericUDF and does some configuration within the public

Re: UDF Configure method not getting called

2015-08-25 Thread Rahul Sharma
Configure method not getting called Hi Guys, We have a UDF which extends GenericUDF and does some configuration within the public void configure(MapredContext ctx) method. MapredContext in configure method gives access to the HiveConfiguration via JobConf, which contains custom attributes