Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/19630#discussion_r148806731 --- Diff: python/pyspark/rdd.py --- @@ -56,6 +56,22 @@ __all__ = ["RDD"] +class PythonEvalType(object): + """ + Evaluation type of python rdd. + + These values are internal to PySpark. + """ + NON_UDF = 0 + + SQL_BATCHED_UDF = 100 + + PANDAS_SCALAR_UDF = 200 + PANDAS_GROUP_MAP_UDF = 201 + PANDAS_GROUP_AGGREGATE_UDF = 202 + PANDAS_GROUP_FLATMAP_UDF = 203 --- End diff -- This is new, what's the mean of flatmap here?
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org