Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18906 For https://github.com/apache/spark/blob/master/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ScalaUDF.scala#L42, I don't think it's a public API. So, Scala side are: ```scala case class UserDefinedFunction protected[sql] ( f: AnyRef, dataType: DataType, inputTypes: Option[Seq[DataType]]) { ``` ```scala def udf[RT: TypeTag](f: Function0[RT]): UserDefinedFunction = { ``` ```scala def register[RT: TypeTag](name: String, func: Function0[RT]): UserDefinedFunction = { ``` You are proposing adding `nullable` as below: ```python class UserDefinedFunction(object): """ User defined function in Python .. versionadded:: 1.3 """ def __init__(self, func, returnType=StringType(), name=None, evalType=PythonEvalType.SQL_BATCHED_UDF, nullable=True): ``` ```python def udf(f=None, returnType=StringType(), nullable=True): ``` ```python def registerFunction(self, name, f, returnType=StringType(), nullable=True): ``` I don't think these are quite consistent?
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org