Re: UDTF registration fails for hiveEnabled SQLContext

I am trying to register a UDTF not a UDF. So I don't think this applies Mick -- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ - To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Re: UDTF registration fails for hiveEnabled SQLContext

You can register udf's by using the in-built udf function as well using (import org.apache.spark.sql.functions._) Something along the lines of val flattenUdf = udf(udfutils.flatten) where udfutils is another object and flatten is a method in it. On Tue, May 15, 2018 at 3:27 AM Mick Davies

Re: UDTF registration fails for hiveEnabled SQLContext

Hi Gourav, I don't think you can register UDTFs via sparkSession.udf.register Mick -- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ - To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Re: UDTF registration fails for hiveEnabled SQLContext

Hi Mick, the error practically gives you the suggestion to correct it "use sparkSession.udf.register(...) instead". Regards, Gourav Sengupta On Mon, May 14, 2018 at 8:59 AM, Mick Davies wrote: > The examples were lost by formatting: > > Exception is: > > No

Re: UDTF registration fails for hiveEnabled SQLContext

The examples were lost by formatting: Exception is: No handler for UDAF 'com.iqvia.rwas.omop.udtf.ParallelExplode'. Use sparkSession.udf.register(...) instead.; line 1 pos 7 org.apache.spark.sql.AnalysisException: No handler for UDAF 'com.iqvia.rwas.omop.udtf.ParallelExplode'. Use

UDTF registration fails for hiveEnabled SQLContext

Hi, If I try to register a UDTF using SQLContext ( with enableHiveSupport set) using the code: I get the following error: It works OK if I use deprecated HiveContext. Is there a way to register UDTF without using deprecated code? This is happening in some tests I am writing using but I