[ https://issues.apache.org/jira/browse/SPARK-21533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106000#comment-16106000 ]
Takeshi Yamamuro commented on SPARK-21533: ------------------------------------------ I feel supporting this function makes little sense because Spark does not use `MapredContext` inside. But, this is some error-prone, so probably we better print warning messages or something if the function found in Hive UDFs. > "configure(...)" method not called when using Hive Generic UDFs > --------------------------------------------------------------- > > Key: SPARK-21533 > URL: https://issues.apache.org/jira/browse/SPARK-21533 > Project: Spark > Issue Type: Bug > Components: Java API, SQL > Affects Versions: 2.1.1 > Reporter: Dean Gurvitz > Priority: Minor > > Using Spark 2.1.1 and Java API, when executing a Hive Generic UDF through the > Spark SQL API, the configure() method in it is not called prior to the > initialize/evaluate methods as expected. > The method configure receives a MapredContext object. It is possible to > construct a version of such an object adjusted to Spark, and therefore > configure should be called to enable a smooth execution of all Hive Generic > UDFs. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org